Click the Taskbar page on the right side. (Option 1) Select the "Always" option in the "Show smaller taskbar buttons" setting ...
The Windows 11 taskbar may look modern, but it's surprisingly rigid. Beyond a few basic tweaks, Microsoft gives you very little room to personalize, even less than in previous versions of Windows.