You were probably just spamming too much, so you hit after you had already hit the note, and got the missed note penalty
