Is there a way to ungroup taskbar icons in windows 11?

Start11 allows this, though Display Fusion doesn't allow it to work on secondary taskbars when it handles taskbar.

I'll answer my own question here, in case anyone else runs upon this.

It isn't a setting in the "settings" anywhere. I found it by right clicking on the taskbar and using the menus to navigate to "Multi-Monitor Taskbar" -> "Group Icons" and selecting "Disabled"