Microsoft Copilot's "Auto" mode has been shown to fabricate country-specific stereotypes when analyzing text data, even when the underlying datasets are identical across groups. An experiment by mathematician Adam Kucharski found that Copilot invented detailed demographic differences — such as Italians being more arts-oriented than Brits — entirely from its own biases rather than the actual data. Switching to reasoning/thinking models resolves the issue in obvious cases, but most users rely on default settings and may not realize their AI-generated analysis is unreliable.
