Narrating Creativity: Human Translation vs. Machine Translation Post-Editing in Subtitling Training

Beyza Havvanur Sarımehmet; Mustafa Kırca

doi:10.59045/nalans.2026.108

Authors

Beyza Havvanur Sarımehmet Department of Translation and Interpreting Studies, Çankaya University Author https://orcid.org/0000-0002-8263-0086
Mustafa Kırca Department of Translation and Interpreting Studies, Çankaya University Corresponding Author https://orcid.org/0000-0003-1437-4567

DOI:

https://doi.org/10.59045/nalans.2026.108

Keywords:

audiovisual translation (AVT), subtitling, machine translation post-editing (MTPE), translation creativity, translator training, translation pedagogy

Abstract

This study investigates the effects of machine translation post-editing (MTPE) training on the creativity of fourth-year Translation and Interpreting students in subtitling narrative, in comparison with conventional human translation (HT) practice. Employing a pre-test/post-test experimental design where creativity was measured in terms of accuracy and novelty, the study analysed performance changes before and after the instructional intervention in order to assess the pedagogical effects of MTPE training. Statistical analyses revealed no significant differences between the HT and MTPE groups in overall Creativity Scores. However, the HT group produced more Creative Shifts, while the MTPE group tended to produce fewer errors. ANCOVA analyses confirmed that these between-group differences were attributable to pre-existing baseline differences rather than training mode. Within-group analyses using proportional scores further revealed that both groups significantly improved in acceptability after training with large effect sizes, and both showed a non-significant trend toward increased Creative Shifts. The HT group additionally showed a statistically significant improvement in overall Creativity Scores. The MTPE group also showed greater variability in performance, suggesting the possible influence of individual factors. These findings indicate that HT and MTPE support different dimensions of creativity rather than one having a greater impact. The study contributes to the limited research on creativity in Turkish subtitling and suggests that an integrated training model combining both approaches may be pedagogically beneficial.

Author Biographies

Beyza Havvanur Sarımehmet , Department of Translation and Interpreting Studies, Çankaya University

Beyza Havvanur Sarımehmet is a researcher and translator currently pursuing a PhD in English Translation and Interpreting at Hacettepe University (Ankara, Turkiye), where she also completed her Master's and Bachelor's degrees. Her academic interests focus on audiovisual translation, feminist translation, and machine translation post-editing (MTPE). She is currently working at Çankaya University as a Research Assistant in the department of Translation and Interpreting.
Mustafa Kırca, Department of Translation and Interpreting Studies, Çankaya University

Mustafa Kirca is Associate Professor of English and Comparative Literature at Çankaya University in Ankara. He holds his MA and PhD in English Literature from the Middle East Technical University. He conducts research into translation and comparative studies, postcolonial and postmodern narratives, metafiction and parodic re-writing in contemporary fiction.

References

Bayer-Hohenwarter, G. (2011). Creative shifts as a means of measuring and promoting translational creativity. Meta, 56(3), 663–692. https://doi.org/10.7202/1008339ar

Buijzen, M., & Valkenburg, P. M. (2004). Developing a typology of humor in audiovisual media. Media Psychology, 6, 147–167. https://doi.org/10.1207/s1532785xmep0602_2

Burchardt, A., Lommel, A., Bywood, L., Harris, K., & Popović, M. (2016). Machine translation quality in an audiovisual context. Target: International Journal of Translation Studies, 28(2), 206–231. https://doi.org/10.1075/target.28.2.03bur

Carl, M., Gutermuth, S., & Hansen-Schirra, S. (2015). Post-editing machine translation: A usability test for professional translation settings. In A. Ferreira & J. W. Schwieter (Eds.), Psycholinguistic and cognitive inquiries into translation and interpreting (pp. 145–174). John Benjamins. https://doi.org/10.1075/btl.115.07car

Castaldo, A., Castilho, S., Moorkens, J., & Monti, J. (2025). Extending CREAMT: Leveraging large language models for literary translation post-editing. In Proceedings of the Machine Translation Summit XX (Vol. 1, pp. 506–515). European Association for Machine Translation.

Corpas Pastor, G., & Noriega-Santiáñez, L. (2024). Human versus neural machine translation creativity: A study on manipulated MWEs in literature. Information, 15(9), Article 530. https://doi.org/10.3390/info15090530

Daems, J., Vandepitte, S., Hartsuiker, R. J., & Macken, L. (2017). Translation methods and experience: A comparative analysis of human translation and post-editing with students and professional translators. Meta, 62(2), 245–270. https://doi.org/10.7202/1041023ar

De Almeida, G., & O'Brien, S. (2010). Analysing post-editing performance: Correlations with years of translation experience. In V. Hansen & F. Yvon (Eds.), Proceedings of the 14th Annual Conference of the European Association for Machine Translation.

Dede, V., & Antonova-Ünlü, E. (2022). Does a formal post-editing training affect the performance of novice post-editors? An experimental study. Cankaya University Journal of Humanities and Social Sciences, 16(2), 131–148. https://doi.org/10.47777/cankujhss.1106326

Depraetere, I., Tezcan, A., & Şahin, M. (2014). Post-edited quality, post-editing behaviour and human evaluation: A case study (pp. 78–108). HAL Open Science. https://hal.archives-ouvertes.fr/halshs-01060447

Díaz Cintas, J. (2012). Subtitling: Theory, practice and research. In C. Millán & F. Bartrina (Eds.), The Routledge handbook of translation studies (pp. 273–287). Routledge. https://doi.org/10.4324/9780203102893

Díaz Cintas, J., & Remael, A. (2007). Audiovisual translation: Subtitling. St. Jerome Publishing. https://doi.org/10.4324/9781315759678

Du, S., Guerberof Arenas, A., Toral, A., Gerrits, K., & Marco Borillo, J. (2025). Optimising ChatGPT for creativity in literary translation: A case study from English into Dutch, Chinese, Catalan and Spanish. In Proceedings of the Machine Translation Summit XX (Vol. 1, pp. 578–591). European Association for Machine Translation.

García, I. (2011). Translating by post-editing: Is it the way forward? Machine Translation, 25(3), 217–237. https://doi.org/10.1007/s10590-011-9110-4

Guerberof-Arenas, A. (2013). What do professional translators think about post-editing? The Journal of Specialised Translation, 19, 75–95. https://doi.org/10.26034/cm.jostrans.2013.424

Guerberof-Arenas, A., Valdez, S., & Dorst, A. (2024). Does training in post-editing affect creativity? The Journal of Specialised Translation, 74–97. https://doi.org/10.26034/cm.jostrans.2024.4712

Guerberof-Arenas, A., & Toral, A. (2020). The impact of post-editing and machine translation on creativity and reading experience. Translation Spaces, 9(2), 255–282. https://doi.org/10.1075/ts.20035.gue

Guerberof-Arenas, A., & Toral, A. (2022). Creativity in translation: Machine translation as a constraint for literary texts. Translation Spaces, 11(2), 184–212. https://doi.org/10.1075/ts.21025.gue

Juckel, J., Bellman, S., & Varan, D. (2016). A humor typology to identify humor styles used in sitcoms. HUMOR, 29, 583–603. https://doi.org/10.1515/humor-2016-0047

Karakanta, A., Bentivogli, L., Cettolo, M., Negri, M., & Turchi, M. (2022). Post-editing in automatic subtitling: A subtitlers' perspective. In Proceedings of the 23rd Annual Conference of the European Association for Machine Translation (pp. 261–270). European Association for Machine Translation.

Kenny, D. (2020). Technology in translator training. In M. O'Hagan (Ed.), The Routledge handbook of translation and technology, (pp. 498–515). Routledge.

Li, Q., & Huang, T.-Y. (2023). Scaling students' self-efficacy on machine translation post-editing: Psychometric properties of the scale and their associations. Participatory Educational Research, 10(6), 229–244. https://doi.org/10.17275/per.23.98.10.6

Lommel, A., Burchardt, A., & Uszkoreit, H. (2014). Multidimensional quality metrics (MQM): A framework for declaring and describing translation quality metrics. Tradumàtica: Tecnologies de la Traducció, 12, 455–463. https://doi.org/10.5565/rev/tradumatica.77

Loock, R. (2018). Traduction automatique et usage linguistique : Une analyse de traductions anglais-français réunies en corpus. Meta: Translators' Journal, 63(3), 785–805. https://doi.org/10.7202/1060173ar

Marvil, C. (2019). Translating dialect humor in the American sitcom: A case study (Master’s thesis). Universitat Pompeu Fabra. https://hdl.handle.net/10230/43223

Noriega-Santiáñez, L., & Corpas Pastor, G. (2023). Machine vs. human translation of formal neologisms in literature: Exploring e-tools and creativity in students. Revista Tradumàtica. Tecnologies de la Traducció, 21, 233–264. https://doi.org/10.5565/rev/tradumatica.338

Nunes Vieira, L., & Alonso, E. (2019). Translating perceptions and managing expectations: An analysis of management and production perspectives on machine translation. Perspectives: Studies in Translation Theory and Practice. https://doi.org/10.1080/0907676X.2019.1646776

O'Brien, S. (2002). Teaching post-editing: A proposal for course content. In Proceedings of the 6th EAMT Workshop on Teaching Machine Translation. European Association for Machine Translation. https://aclanthology.org/2002.eamt-1.11

Pérez M, L. (2020). What do translators think about post-editing? A mixed-methods study of translators' fears, worries and preferences on machine translation post-editing. Revista Tradumàtica. Tecnologies de la Traducció, 18, 11–32. https://doi.org/10.5565/rev/tradumatica.227

Şahin, M. (2011). Using MT post-editing for translator training. In Tralogy II (pp. 1–6). https://hal.science/hal-02497609v1

Şahin, M., & Gürses, G. (2019). Would MT kill creativity in literary retranslation? In Proceedings of the Qualities of Literary Machine Translation (pp. 26–34). European Association for Machine Translation.

Sullivan, C. (2013). Creativity. In Y. Gambier & L. van Doorslaer (Eds.), Handbook of translation studies (Vol. 4, pp. 42–46). John Benjamins Publishing Company. https://doi.org/10.1075/HTS.4.CRE1

Toral, A., & Way, A. (2018). What level of quality can neural machine translation attain on literary text? In J. Moorkens, S. Castilho, F. Gaspari, & S. Doherty (Eds.), Translation quality assessment: From principles to practice (pp. 263–287). Springer. https://doi.org/10.48550/arXiv.1801.04962

Reiss, K. (2000). Translation criticism: Potentials and limitations: Categories and criteria for translation quality assessment (E. F. Rhodes, Trans.; 1st ed.). Routledge. https://doi.org/10.4324/9781315760407 (Original work published 1971)

Reiss, K. (1971). Grenzen und Möglichkeiten der Übersetzungskritik: Kategorien und Kriterien für eine sachgerechte Beurteilung von Übersetzungen. Hueber.

Yang, Y., Liu, R., Qian, X., Wang, L., & Li, X. (2023). Performance and perception: Machine translation post-editing in Chinese–English news translation by novice translators. Humanities and Social Sciences Communications, 10, Article 798. https://doi.org/10.1057/s41599-023-02285-7

Yau, W. P. (2010). Translating audiovisual humour: A Hong Kong case study. In Translation, humour and the media: Translation and humour (Vol. 2, pp. 108–120). Bloomsbury. https://scholars.hkbu.edu.hk/en/publications/translating-audiovisual-humour-a-hong-kong-case-study-10/

Youdale, R. (2020). Using computers in the translation of literary style: Challenges and opportunities. Routledge. https://doi.org/10.4324/9780429030345

Zhao, Y., Zhang, R., Li, W., Chen, S., Guo, W., Jin, X., Wang, X., & Wang, R. (2025). Assessing and understanding creativity in large language models. Machine Intelligence Research, 22, 417–436. https://doi.org/10.1007/s11633-025-1546-4