You're meant to hold it for longer. It's about one minute. The game warns you when you can let go. The initial text in theory tells you of this, but it should've probably been made clearer :)
thx
