...as long as I don't rev it up in nuetral
What happens if you rev it up in neutral?
If this problem only happens while you're in gear, check to see if your rubber between the spline and your prop blades (hub) is split or shows evidence of slipping. Does the prop look like it may have hit something?