Human and ChatGPT Translations of José Rizal’s Poetry: A Qualitative Comparison

Christopher Britanico; Nelia A. Britanico; Maricon V. Quinto; Marissa Del Rosario

doi:10.56741/IISTR.bei.002724

Authors

Christopher Britanico
cbritanico@usant.edu.ph
University of Saint Anthony https://orcid.org/0000-0002-6269-7507
Nelia A. Britanico University of Saint Anthony
Maricon V. Quinto University of Saint Anthony
Marissa Del Rosario University of Saint Anthony

DOI:

https://doi.org/10.56741/IISTR.bei.002724

Keywords:

ChatGPT, Corpus-Based Qualitative Analysis, Cultural Fidelity, José Rizal, Literary Translation

Abstract

This qualitative corpus-based study compares selected passages from José Rizal’s Spanish poems “Mi Último Adiós” and “A la juventud filipina” with human-produced English and Tagalog translations and ChatGPT outputs documented in an earlier manuscript. Guided by translation-shift analysis, reflexive thematic interpretation, and critical discourse analysis, it examines semantic transfer, metaphor, cultural references, ideological framing, and poetic form. The source manuscript reports several illustrative instances in which ChatGPT retains propositional meaning but simplifies metaphor or changes the register of patriotic expressions. The evidence is interpreted as a small, purposively selected set of examples rather than as proof of model-wide failure. The revised analysis distinguishes observable textual differences from claims requiring additional documentation, including the identities and editions of human translations, the exact ChatGPT model, generation dates, and independently checked source-text alignments. Findings support cautious, context-dependent use of AI as a drafting aid alongside historically informed human review. The article offers a transparent coding framework and a reproducibility checklist for future multilingual literary-translation research.

Downloads

Download data is not yet available.

Author Biographies

Christopher Britanico, University of Saint Anthony

is a professor at the University of Saint Anthony in Iriga City, Philippines. He holds a Master of Arts in Education and is actively engaged in academic research, scholarly writing, and research data analysis. His academic interests include higher education, adult education, and teacher education. His scholarly activities focus on contributing to educational research and advancing knowledge in teaching, learning, and educational practices across various academic contexts. (email: cbritanico@usant.edu.ph).

Nelia A. Britanico, University of Saint Anthony

is an educator and researcher affiliated with the University of Saint Anthony, Philippines. Her academic interests include educational research, multiple intelligences, teaching and learning practices, and social and cultural studies. She has experience in teaching and supervising student research. Her scholarly contributions include studies on senior high school students’ multiple intelligences and the cultural significance of tattoos in professional settings, reflecting her interdisciplinary research interests. (email: nabritanico@usant.edu.ph).

Maricon V. Quinto, University of Saint Anthony

is an educator and researcher associated with the University of Saint Anthony in Iriga City, Philippines. Her academic interests include social studies education, historical research, cultural heritage, and community-based learning. Her research has explored the sociocultural and historical significance of local religious traditions and their implications for community life. Her scholarly interests emphasize the relationship between education, cultural identity, historical understanding, and the preservation of local heritage. (email: mvquinto@usant.edu.ph).

Marissa Del Rosario, University of Saint Anthony

is the Dean at the University of Saint Anthony in Iriga City, Philippines. Her academic and professional interests focus on language education, teacher education, and teaching methods. She is engaged in educational research and academic leadership, with particular attention to teaching and learning practices. Her scholarly interests encompass instructional approaches, teacher development, and the advancement of educational practices that support effective teaching and meaningful learning experiences across diverse educational contexts. (email: mdrosario@usant.edu.ph).

References

L. Venuti, The Translator’s Invisibility: A History of Translation, 3rd ed. London, UK: Routledge, 2017.

S. Bassnett, Translation Studies, 4th ed. London, UK: Routledge, 2014.

E. A. Nida, Toward a Science of Translating. Leiden, Netherlands: Brill, 1964.

A. Lefevere, Translating Poetry: Seven Strategies and a Blueprint. Assen, Netherlands: Van Gorcum, 1975.

M. Karpinska and M. Iyyer, “Large language models effectively leverage document-level context for literary translation, but critical errors persist,” in Proc. 8th Conf. Machine Translation, 2023, pp. 419–451, doi: 10.18653/v1/2023.wmt-1.41.

S. Wang, D. Wong, J. Yao, and L. Chao, “What is the best way for ChatGPT to translate poetry?,” in Proc. 62nd Annual Meeting Assoc. Computational Linguistics, 2024, pp. 14025–14043, doi: 10.18653/v1/2024.acl-long.756.

R. Gao, Y. Lin, N. Zhao, and Z. G. Cai, “Machine translation of Chinese classical poetry: A comparison among ChatGPT, Google Translate, and DeepL Translator,” Humanities and Social Sciences Communications, vol. 11, art. 835, 2024, doi: 10.1057/s41599-024-03363-0.

R. Zhang, W. Zhao, and S. Eger, “How good are LLMs for literary translation, really? Literary translation evaluation with humans and LLMs,” in Proc. NAACL, 2025, doi: 10.18653/v1/2025.naacl-long.548.

L. Macken, “Machine translation meets large language models: Evaluating ChatGPT’s ability to automatically post-edit literary texts,” in Proc. 1st Workshop Creative-text Translation and Technology, 2024, pp. 65–81. [Online]. Available: https://aclanthology.org/2024.ctt-1.7/

L. Wang et al., “Findings of the WMT 2024 shared task on discourse-level literary translation,” in Proc. 9th Conf. Machine Translation, 2024, pp. 699–700, doi: 10.18653/v1/2024.wmt-1.58.

Y. Liu, Y. Yao, R. Zhan, Y. Lin, and D. F. Wong, “NovelTrans: System for WMT24 discourse-level literary translation,” in Proc. 9th Conf. Machine Translation, 2024, pp. 980–986, doi: 10.18653/v1/2024.wmt-1.98.

J. C. Catford, A Linguistic Theory of Translation. Oxford, UK: Oxford University Press, 1965.

W. Jiao et al., “Is ChatGPT a good translator? A preliminary study,” arXiv:2301.08745, 2023. [Online]. Available: https://arxiv.org/abs/2301.08745

V. Braun and V. Clarke, “Using thematic analysis in psychology,” Qualitative Research in Psychology, vol. 3, no. 2, pp. 77–101, 2006, doi: 10.1191/1478088706qp063oa.

N. Fairclough, Discourse and Social Change. Cambridge, UK: Polity Press, 1992.

V. Braun and V. Clarke, Thematic Analysis: A Practical Guide. London, UK: SAGE, 2022.

A. Mukherjee, S. Yadav, and M. Shrivastava, “CoST of breaking the LLMs,” in Proc. 9th Conf. Machine Translation, 2024, pp. 299–306, doi: 10.18653/v1/2024.wmt-1.24.

T. Glushkova, C. Zerva, and A. F. T. Martins, “BLEU meets COMET: Combining lexical and neural metrics towards robust machine translation evaluation,” in Proc. 24th Annual Conf. European Assoc. Machine Translation, 2023, pp. 47–58. [Online]. Available: https://aclanthology.org/2023.eamt-1.6/

L. Yu, Q. Liu, and D. Xiong, “LFED: A literary fiction evaluation dataset for large language models,” in Proc. LREC-COLING, 2024. [Online]. Available: https://aclanthology.org/2024.lrec-main.915/

Q. Lu, B. Qiu, L. Ding, K. Zhang, T. Kocmi, and D. Tao, “Error analysis prompting enables human-like translation evaluation in large language models,” in Findings ACL, 2024, pp. 8801–8816, doi: 10.18653/v1/2024.findings-acl.520.

O. F. Ahmed, I. K. Dewi, and M. Y. Anis, “Translating Arabic literary metaphors: A comparative evaluation of ChatGPT-4.0 and Google Translate 2024,” IDEAS: Journal on English Language Teaching and Learning, Linguistics and Literature, 2025, doi: 10.24256/ideas.v13i2.7439.

I. Yuliasri et al., “Student poetry translations with and without the use of AI: An evaluation of translation quality,” LITE: Jurnal Bahasa, Sastra, dan Budaya, 2025, doi: 10.33633/lite.v21i2.14336.