Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Study
Publikation: Bidrag til bog/antologi/rapport › Konferencebidrag i proceedings › Forskning › fagfællebedømt
Standard
Assessing Cross-Cultural Alignment between ChatGPT and Human Societies : An Empirical Study. / Cao, Yong; Zhou, Li; Lee, Seolhwa; Cabello, Laura; Chen, Min; Hershcovich, Daniel.
Proceedings of the First Workshop on Cross-Cultural Considerations in NLP (C3NLP). Association for Computational Linguistics (ACL), 2023. s. 53-67.Publikation: Bidrag til bog/antologi/rapport › Konferencebidrag i proceedings › Forskning › fagfællebedømt
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - GEN
T1 - Assessing Cross-Cultural Alignment between ChatGPT and Human Societies
T2 - 1st Workshop on Cross-Cultural Considerations in NLP, C3NLP 2023
AU - Cao, Yong
AU - Zhou, Li
AU - Lee, Seolhwa
AU - Cabello, Laura
AU - Chen, Min
AU - Hershcovich, Daniel
N1 - Publisher Copyright: © 2023 Association for Computational Linguistics.
PY - 2023
Y1 - 2023
N2 - The recent release of ChatGPT has garnered widespread recognition for its exceptional ability to generate human-like responses in dialogue. Given its usage by users from various nations and its training on a vast multilingual corpus that incorporates diverse cultural and societal norms, it is crucial to evaluate its effectiveness in cultural adaptation. In this paper, we investigate the underlying cultural background of ChatGPT by analyzing its responses to questions designed to quantify human cultural differences. Our findings suggest that, when prompted with American context, ChatGPT exhibits a strong alignment with American culture, but it adapts less effectively to other cultural contexts. Furthermore, by using different prompts to probe the model, we show that English prompts reduce the variance in model responses, flattening out cultural differences and biasing them towards American culture. This study provides valuable insights into the cultural implications of ChatGPT and highlights the necessity of greater diversity and cultural awareness in language technologies.
AB - The recent release of ChatGPT has garnered widespread recognition for its exceptional ability to generate human-like responses in dialogue. Given its usage by users from various nations and its training on a vast multilingual corpus that incorporates diverse cultural and societal norms, it is crucial to evaluate its effectiveness in cultural adaptation. In this paper, we investigate the underlying cultural background of ChatGPT by analyzing its responses to questions designed to quantify human cultural differences. Our findings suggest that, when prompted with American context, ChatGPT exhibits a strong alignment with American culture, but it adapts less effectively to other cultural contexts. Furthermore, by using different prompts to probe the model, we show that English prompts reduce the variance in model responses, flattening out cultural differences and biasing them towards American culture. This study provides valuable insights into the cultural implications of ChatGPT and highlights the necessity of greater diversity and cultural awareness in language technologies.
UR - http://www.scopus.com/inward/record.url?scp=85162113418&partnerID=8YFLogxK
M3 - Article in proceedings
AN - SCOPUS:85162113418
SP - 53
EP - 67
BT - Proceedings of the First Workshop on Cross-Cultural Considerations in NLP (C3NLP)
PB - Association for Computational Linguistics (ACL)
Y2 - 5 May 2023
ER -
ID: 372530330