Great idea, but mediocre execution. It'd be more fun if the ball got faster with each hit.
Some background music would also help.