I was able to fix it by resetting Layer for GUI (changed it to 1) and resetting Z Index for ItemContainer (changed it to 0) and changing Mouse -> Filter setting to Ignore for these nodes:
Control
HBoxContainer
LeftArrowContainer
RightArrowContainer
I've learned that whenever you have a problem with catching mouse input, it's usually fixable by changing the mouse filter setting.