I returned there later and the ball got pushed off the button by one of those things that spawn there, lucky me :)
