Your experience will depend heavily on your neighbors!
A friend and I decided to camp here before a backpacking trip in the Whites, to cut down on morning-of driving time. Our site, #02 on Loop 2, was in very close proximity to all of the neighboring sites. We had children on several sides, and a rowdy group of adult men on another side. Quiet hours are supposed to start at 10:00pm, but our rowdy male neighbors were up, playing music, talking loudly, and singing, until midnight. Then, just when we thought they were ready to settle in, they turned on a headlamp aimed directly into our tent. We are both very experienced car campers and backcountry campers, but even we struggled to get any rest through all the noise and light. The staff drove by a few times in a golf cart but never stopped to encourage this group to quiet down or use a little etiquette/common sense with their headlamp use. It wouldn't have been so much of a problem if the sites weren't SO close to each other. I attached a photo to show just how closely all the sites are situated; that's my backpacking tent, for scale.