If your community is private (not done solely by permissions), then it is likely configured to disable anonymous access, which redirects a non authenticated user to the SSO flow. That is a setting that has to be updated by Support, not in the Admin.
You would want to disable this after building out your desired "To Be" structure using the standard techniques other have described.
... View more
