I know that Dana slapped a 525 in one of their 23's. The boat ran insane fast for a boat that size. Their standard is the 496.
I don't think there would be driveability issues as long as you only put the throttle down when conditions were accomodating. It's about the driver behind the wheel when ample power is available.
Where you going to do most of your boating? Bigger is always better.