Survive inaccessible types when computing implicit scope

Survive inaccessible types when computing implicit scope #32444