You'll have just as much fun on a 250, honestly. Unless you plan on doing a lot of highway riding, where the 250 will be totally wound out and revving like crazy at cruising speed. It'll be a lot cheaper too.
But even on the track, a skilled rider can hand bigger bikes their asses:
Ninja 250 vs. the big bikes at Laguna Seca - YouTube