It looks like all the container controls in Godot reset the scale of their children to their own scale, which means you can't have a child control with a different scale than it's parent if the parent is a container node.
The solution is ugly: use a parent that doesn't reset the scale of it's children. For example, a Panel node seems to behave well in that regard.