Gendered Artificial Intelligence:  The Social Construction Of Gender Identity In Replika Apps

Rino Andreas; Nisa Dwi Septiyanti; Adimas Maditra Permana

Authors

Rino Andreas Sebelas Maret University
Nisa Dwi Septiyanti State University of Surabaya
Adimas Maditra Permana Sebelas Maret University

Keywords:

Gendered Artificial Intelligence; Gender Identity, Replikas Apps, AI Algorithm

Abstract

The 21st century has brought advancements in artificial intelligence (AI) that increasingly mimic human-like characteristics, offering novel possibilities for understanding gender identity in the digital realm. This indicates that gender studies have expanded to the locus of AI technology. The main aim of this research is to elaborate on the construction of gender identity in AI (artificial intelligence) characters in the Replika application. This qualitative research uses the virtual ethnography method, which positions the researcher as directly involved in this locus. As a result, the AI characters created by users of the Replika application are constructed based on user preferences through clothing, gestures, and personality. The AI character can be formed through the Replikas application feature as an entity with a gender that is "feminine" or "masculine" or "non-binary". This allows users to shape the AI character according to the user's goals and interests. The Identity of AI Character construction can be explored through texting, video chat, augmented reality, and audio call features. Thus, a gendered artificial intelligence character is formed by referring to gender attributes and behavior implanted by users in the form of media representation. This debate also highlights how Replika Apps' AI algorithms have reinforced gender stereotypes.

References

Ahn, J., Kim, J., & Sung, Y. (2022). The effect of gender stereotypes on artificial intelligence recommendations. Journal of Business Research, 141, 50-59.

Bernotat, J. (2021). Keep an Eye on Stereotypes–The Impact of Gender Stereotypes (Toward Humans and Robots) on Language Processing (Doctoral dissertation, Dissertation, Bielefeld, Universität Bielefeld).

Bolt, B. (2023). Performance, Performativity, and Subjectivity at the Intersection of Art and Digital Cultures. In Choreomata(pp. 95-121). Chapman and Hall/CRC.

Butler, J. (1993). Poststructuralism and postmarxism. diacritics, 23(4), 3.

Butler, J. (1999). Revisiting bodies and pleasures. Theory, culture & society, 16(2), 11-20.

Costa, P., & Ribas, L. (2019). AI becomes her: Discussing gender and artificial intelligence. Technoetic Arts: A Journal of Speculative Research, 17(1-2), 171-193.

Craiut, M. V., & Iancu, I. R. (2022). Is technology gender neutral? A systematic literature review on gender stereotypes attached to artificial intelligence. Human Technology, 18(3), 297-315.

Hine, C. (2020). Ethnography for the internet: Embedded, embodied and everyday. Routledge.

Laestadius, L., Bishop, A., Gonzalez, M., Illenčík, D., & Campos-Castillo, C. (2024). Too human and not human enough: A grounded theory analysis of mental health harms from emotional dependence on the social chatbot Replika. New Media & Society, 26(10), 5923-5941.

Leavy, S. (2018). Gender bias in artificial intelligence: The need for diversity and gender theory in machine learning. In Proceedings of the 1st international workshop on gender equality in software engineering (pp. 14-16).

Nass, C., Moon, Y., & Green, N. (1997). Are Machines Gender Neutral? Gender-Stereotypic Responses to Computers with Voices. Journal of Applied Social Psychology, 27(10), 864 -876

Pentina, I., Hancock, T., & Xie, T. (2023). Exploring relationship development with social chatbots: A mixed-method study of replika. Computers in Human Behavior, 140, 107600.

Possati, L. M. (2023). Psychoanalyzing artificial intelligence: The case of Replika. AI & SOCIETY, 38(4), 1725-1738.

Ringrose, J., & Rawlings, V. (2015). Posthuman performativity, gender and “school bullying”: Exploring the material-discursive intra-actions of skirts, hair, sluts, and poofs. Confero: Essays on education, philosophy and politics, 3(2), 80-119. https://doi.org/10.3384/confero.2001-4562.150626

Thellman, S., Hagman, W., Jonsson, E., Nilsson, L., Samuelsson, E., & Simonsson, C. et al. (2018). He is not more persuasive than her. Proceedings of the 18Th International Conference On Intelligent Virtual Agents.

Weber-Guskar, E. (2022). Reflecting (on) Replika. Social Robotics and the Good Life, 103.

Wellner, G. P. (2020). When AI Is Gender-biased. HUMANA. MENTE Journal of Philosophical Studies, 13(37), 127-150.

Xie, T., & Pentina, I. (2022). Attachment theory as a framework to understand relationships with social chatbots: a case study of Replika.

Xie, T., Pentina, I., & Hancock, T. (2023). Friend, mentor, lover: does chatbot engagement lead to psychological dependence?. Journal of service Management, 34(4), 806-828.

Yoon, H. (2021). Digital flesh: A feminist approach to the body in cyberspace. Gender and Education, 33(5), 578-593.