The sign is right before (or after) you cross the dam. Port Oliver Recreation  is directly across from the entrance.