The Library Permissions/Access request only relates for the media picker used to upload photos/videos. If you do not enable this permission, the media picker will only have access to a subset of your photo library, requiring a two-step selection process of allowing visibility to the photos and then actually adding the photos to your circles.

Allowing full library access will not upload any of your media to PhotoCircle.