If they don't welcome you, quietly withdraw. Don't make a scene. Shrug your shoulders and be on your way.