The nearby Nantahala Outdoor Center offers river fun and hiking opportunities