Lovely views and great lake swimming
We had 3 couples who spent the long weekend for 4th of July (2016) on two sites in the walk-in tent camping area. There are (non-flush) potties at the tent camping area, but if you're grossed out by those, it's a couple of minutes drive to the closest bath house. The bath house was very satisfactory and pretty clean, plus plenty of hot water. There's a (steep!) trail from the tent camping area down to the lake with some good places for swimming. It would probably be tough to walk a kayak down to the water from tent sites, though. We found the gravel tent pads well maintained and clean.
The location near Ellijay is great. We visited a couple of area wineries, and there's a fun mountain bike trail at Woodring Branch rec area (directly across the lake from Doll Mtn. Campground, but no direct route to get there, so it's about a 45 minute drive.)