N
UPDATE: It's not only Google Gemini AI, some people tried out others and it also pulled information out. From describing people's profile to sometimes even going deeper in detail (giving email out) or making shit up.
Warning 
️ Google Gemini AI apparently can describe some fediverse profiles correctly to the point of exposing people's full name or making shit up. Implement safety ASAP.
Edit: I think my braincells after hours of being fried might figured out that some of those situations might be Gemini grabbing references from other websites that the person/user might have same or similar username. Even higher chances if the user has mentioned their fedi profile there. It got information that shouldn't be displayed. I guess it's time to not use same username everywhere. It's wrong anyway because ????? Why would an AI do that ?????