Piney Point is not far (about a 20 minute drive) from Bear Creek, which we kayak many times every summer.  It is easy to kayak or canoe with one mandatory portage.  Be prepared to have to get out and move your boat over the rocks at the portage.  Bear Creek Canoe Run rents canoes and kayaks, and they have staff to help at the portage if you rent from them.