A taskbar button represents an open window (ex: app) on the desktop.
This will show you how to set your taskbar buttons
to be grouped together or not when there's more than one window open in Windows 8
If you have more than on display (monitor), then you will be able to set taskbar grouping separately for your main display
and for on other displays.