Рубрики NewsTechnologiesWTF

A researcher has determined how artificial intelligence represents an average person: a woman in her 30s, working in IT and living… in Russia/Japan

Published by Kateryna Danshyna

Interestingly, American AI models do not suspect that anyone lives in China at all, while none of the — subjects could imagine a world outside the gender binary.

English developer James Hancock presented Imagine a person project, which allows us to explore how modern artificial intelligence perceives the average person.

Hancock created a special promt that included questions about the name, age, gender, region, and a day in the life of this average person, and ran it through Llama3.1, Gemma2, and Qwen2.5 models 100 times, eventually collecting the results they produced most often.

The query that Hancock used during the analysis

Detailed results for each model can be found on Hancock’s page, However, the main picture today is that he is a 27-32 year old man, female — according to Llama3.1 and Gemma2, and male in Qwen2.5.

Interestingly, small language models believe that there are only people aged 25-35 in the world Also, none of the tested models was able to imagine a world outside the gender binary, at least in the first 100 answers.

As for the region, each had a different distribution: Gemma2 believed that people mainly live in Russia, the UK, or India, while Llama3 most often mentioned Japan At the same time, none of the American models mentioned the Chinese region, while the Chinese chatbot Qwen 2.5, on the contrary, did not provide answers about any other place of residence of the average person except China.

Among the names in Gemma2’s responses, “Anya” was the most frequently used, with the variation “Anya Petrova” leading the model’s responses to names by a wide margin. In his report, Hancock clarified that a user with this name registered as a book seller on Amazon with covers created by Stable Diffusion, so this may be some automated customization. Llama3 most often stated that the average person’s name was Emilia Garcia, while Qwen 2.5 mostly mentioned the name Li Wen.

Most of the similar answers were in the category of «specialty», where the Meta and Google models converged on a graphic designerand the Chinese chatbot chose a software developer (although graphic designer was also in its answers, the third most frequently mentioned)

Source code for Imagine a person also available on GitHub. The developer himself clarifies that he created the project primarily for entertainment:

«This is just for fun. These language models are running on my local machine using quantized versions of the original models (llama3.1 8b Q4_0, gemma2 2b Q4_0, qwen2.5 7b Q4_K_M). I set the query temperatureTemperature — is a hyperparameter used in some natural language processing models, including ChatGPT, to control the level of randomness or «creativity» in the generated text. to 1.0. Hopefully, using a non-quantized model, experimenting with temperature values, or simply changing the prompt will yield more creative responses».