Not to be too negative to your post, but coming from someone that spent their first 20 years living in HB. There is not a better place to be then the Harbor & I mean on the water with a boat slip. For that type of $ you can get a very very nice home, 2.5 will get you a very nice house with a slip, 3+ can get you possibly on the main channel with great views and you are 5 min to break water.
I also sell homes so if you want details on the area, let me know. Not too many people know more about the Harbor !