By double-clicking the application icon the WORD application window will close and the application button from the taskbar will disappear.
Closing Word - Control Button - Double Click, steps:
Starting and closing Index