I went with a friend for two nights, and we camped and had a blast. (It rained for one of the days and it was pretty thick tree cover - so it wasn't too bad.) Hiked around the lighthouse, climbed on the rocks, tried crabbing (and failed) and went kayaking around the campground in the bay.
The trails by the water around the campsites are fun to wander around on. :)
We got a basic camp site with no power hookup. It was a bit loud on one of the evenings - no one was reinforcing quiet hours in the middle of the night (which happens, but it was a little bit of a nuisance.)
Overall, a nice experience.