Research Article


DOI :10.26650/jos.1324416   IUP :10.26650/jos.1324416    Full Text (PDF)

The Efficiency of Neural Machine Translation Models in ArabicTurkish Translation Types: Example of ChatGPT

Sezer Yılmaz

Artificial intelligence applications, which are gaining currency day by day due to their new features, in parallel with the development of technology, have attracted attention with the development of neural machine translation models, such as ChatGPT in the field of translation, especially in recent times, and have been regarded as a valuable phase and promising development in the translation world. With the development of ChatGPT, which is a neural machine translation model, “translation proofreading” has gained popularity in the translation industry and some changes have been made in translators’ job descriptions. Also, the question that has been a topic of discussion in the translation industry since the first years of the development of machine translation models has gained currency again: “Can machine translations replace translators?” The purpose of this study is to describe the quality of Arabic-Turkish translation outputs and the distance covered by artificial intelligence in the context of translation as a result of these developments. Artificial intelligence-based machine translation models, their development stages, and their most recent stage were included in the study, and then the ChatGPT Arabic-Turkish translation outputs were analyzed comparatively. In this study, the language of the source text has been determined to be Arabic and the language of the target text to be Turkish, and comparative analyses were carried out within the framework of ChatGPT translation outputs and human translations. Plain text, literary text, and technical texts, which were translated from Arabic into Turkish, were re-translated from Arabic into Turkish using ChatGPT, and the ChatGPT translation outputs were examined in the context of semantic and linguistic equivalence in general. The success rate achieved in the translation of different text types in the Arabic-Turkish language pair were evaluated. 

DOI :10.26650/jos.1324416   IUP :10.26650/jos.1324416    Full Text (PDF)

Arapça – Türkçe Çeviri Türlerinde Nöral Makine Çeviri Modellerinin Verimliliği: ChatGPT Örneği

Sezer Yılmaz

Teknolojinin gelişimine paralel olarak gün geçtikçe yeni özellikleriyle gündeme gelen yapay zekâ uygulamaları, özellikle son dönemlerde çeviri alanında ChatGPT gibi nöral makine çeviri modellerinin geliştirilmesiyle dikkatleri üzerine çekmeyi başarmış, bu durum çeviri dünyasında kıymetli bir aşama ve umut verici bir gelişme olarak kabul görmüştür. Nöral makine çeviri modelleri arasında yer alan ChatGPT modelinin geliştirmesiyle çeviri sektöründe “çeviri editörlüğü” popülerlik kazanmış ve çevirmenlerin iş tanımlarında bir dizi değişiklikler yapılmıştır. Öte yandan makine çeviri modellerinin geliştirildiği ilk yıllardan beri çeviri sektöründe bir tartışma konusu olarak karşımıza çıkan; “makine çevirileri çevirmenin yerini alabilir mi?” sorusu yeniden gündeme gelmiştir. Bu gelişmeler neticesinde; Arapça-Türkçe çeviri çıktılarındaki kalitenin ve yapay zekânın çeviri bağlamında katettiği mesafenin betimlenmesi çalışmanın ereğini oluşturmuştur. Çalışmada sırasıyla, yapay zekâ tabanlı makine çeviri modellerine, gelişim evrelerine ve geldiği son aşamaya yer verilmiş, akabinde Arapça – Türkçe ChatGPT çeviri çıktılarının karşılaştırmalı analizleri yapılmıştır. Kaynak metin dili Arapça, hedef metin dili Türkçe olarak belirlenen bu çalışmada karşılaştırılmalı analizler ChatGPT çeviri çıktıları ile insan çevirileri çerçevesinde sürdürülmüştür. Arapçadan Türkçeye çevirisi yapılan; düz metin, yazınsal metin ve teknik metinler ChatGPT ile Arapçadan Türkçeye yeniden çevrilmiş, ChatGPT çeviri çıktıları; genel olarak semantik ve dilbilimsel eşdeğerlik bağlamında incelenmiştir. Bu inceleme neticesinde Arapça – Türkçe farklı metin türü çevirilerinde yakaladığı başarı grafiği değerlendirmiştir. 


EXTENDED ABSTRACT


In the globalizing world, the major obstacle, especially in the field of communication, is language. Scientists have been carrying out studies systematically for a long time to eliminate this obstacle. Artificial intelligence technologies are the most important efforts to solve this problem. Fortunately, artificial intelligence studies have gained great momentum recently, and this is undoubtedly reflected in translation studies. Especially with the development of the ChatGPT model, new job opportunities have been introduced into the translation profession in the translation industry. On the other hand, this development has made the question of whether artificial intelligence can replace translators a current issue. The main purpose of this study, which we have approached as an answer to this question, is to determine the role of ChatGPT in Arabic-Turkish translations. In line with this purpose, by focusing on artificial intelligence-based translation types and development phases thereof, Arabic-Turkish ChatGPT translation outputs were examined comparatively. In the study, the source text was determined to be Arabic and the target text to be Turkish. Plain texts, literary texts, and technical texts were re-translated using ChatGPT in this language pair, and equivalence and linguistic analyses of the translation outputs were carried out.

While until recently, translations made using machine translation were incomprehensible, since these translations included serious errors, today, it is seen that more accurate translations are presented with artificial intelligence technologies, such as ChatGPT. The machine translations can generally be studied under 4 headings. These are rule-based models, statistical models, hybrid models, and neural models. When machine translation had a rule-based process form, it started to provide outputs in a hardware format with statistical, hybrid, and finally neural networks in line with the needs of the time. In this process, the file volumes and time problems of international companies, the inability of rule-based machine translations to capture context, and the resulting erroneous or poor translation outputs were among the leading reasons for the development of machine translation models. With neural machine translations, sourceoriented translation outputs have largely been replaced by target-oriented translation outputs. Therefore, the development of artificial intelligence and the integration of neural technology into translation have brought artificial intelligence translations into a different state today. As a result of the trial outputs in the application section, first of all, it can be said that ChatGPT is not an adequate translation tool for the Arabic-Turkish language pair. However, its contributions to the translation process and its success in some translation types should not be ignored. The differences between human translations and artificial intelligence translations are as follows: the error margin is lower in human translations, and the error margin is higher in artificial intelligence translations. However artificial intelligence translations are faster and also less costly. On the other hand, neural network models such as ChatGPT constantly renew themselves and offer better quality translations every day. In summary, some findings, conclusions, and determinations have been reached in this study that artificial intelligence translations cannot replace human translations, so there will be a need for an editor to check the artificial intelligence translation outputs for a long time. Therefore, regardless of which machine translation model is chosen, machine translation is not sufficient on its own, and even the neural machine translation model cannot offer “acceptable” translation in every field. However, it has been concluded in this study that the promise of ChatGPT for the future is a valuable development, and the development of ChatGPT will make the work of translators easier. In the application section of the study, a comparative analysis of ChatGPT outputs and “human translations” was carried out. The examples in the application section were randomly selected. Arabic simple, compound, and complex sentences were translated in Example 1, a legal text from the technical text group in Example 2, and literary texts consisting of poetry and proverbs in Example 3. The translation outputs were examined from many aspects such as grammar, semantics, and context. The results of the examination showed that the quality of ChatGPT translation outputs varied by the text type. Furthermore, the following findings, conclusions, and determinations were obtained as a result of the study: ChatGPT is very successful in plain text translations in the Arabic-Turkish language pair. In technical text translations, it is possible to create a good translation with minor corrections, even if ChatGPT presents erroneous translations. However, unfortunately, for literary texts, ChatGPT could not provide the translation quality output offered by human translators. 


PDF View

References

  • Aksan, Doğan. Her Yönüyle Dil-Ana Çizgileriyle Dilbilim. Ankara: Türk Dil Kurumu Yayınları. 2009. google scholar
  • Anugu, A. ve Ramesh, G. “Survey on Hybrid Machine Translation.” 2nd International Conference on Meaningful Education: Tam Metin Bildiri Kitabı. Yogyakarta: Icmed. 2020. 1-6. google scholar
  • Aşkın, Meryem ve Balkul, H. İbrahim. “Bu Kış Kimse Üşümeyecek Kitabının İngilizce Çevirisinin Makine Çevirisi ile Karşılaştırılması: Google Çeviri’nin Yazın Çevirisinde Kullanılabilirliği Üzerine Bir İnceleme”. International Journal of Languages’ Education and Teaching. 10/4 (2022): 117-131. google scholar
  • Ayık, A, Tuba. “Edebi Metinlerde ve Uzmanlık Alan Metinlerinde Makine Çevirisinin Olanakları/Olanaksızlığı: Çevirmenin Değişen Görev Tanımlarına Yeniden Bakmak”. RumeliDE Dil ve Edebiyat Araştırmaları Dergisi. 30 (2022): 1321-1343. google scholar
  • Ceylan, Senem. “Sosyo-Kültürel Bağlamda Çevir(i)mek:Arapça-Türkçe Dilleri Örneği.” Uluslararası Dil Ve Çeviribilim Kongresi Tam Metin Bildiri Kitabı. Ed. Prof. Dr. Onur Köksal. İstanbul: Eğitim Yayınevi. 2021. 140-147. google scholar
  • Costa-Juss. Marta R, Farrus Mireia ve Marino Jose. “Study and comparison of rule- based and statistical Catalan- Spanish Machine Translation Systems”. Computing and Informatics. 31 (2012): 245-270. google scholar
  • Çinkılıç, Recep. “Eş Zamanlı Çeviri (Arapça-Türkçe, Türkçe-Arapça) Derslerinde Karşılaşılan Sorunlar ve Çözüm Önerileri.” Fatih Sultan Mehmet Vakıf Üniversitesi II. Uluslararası Arap Dili ve Edebiyatı Araştırmaları Kongresi’nde sunulan bildiri. İstanbul, 05-07 Mayıs 2023. google scholar
  • Doğru, İhsan. ‘’Harîrî’nin Makamatı’ndaki Atasözlerinin Nida’nın Çeviride Eşdeğerlik Kuramı Bağlamında İncelenmesi’’. Çeviribilim Üzerine Kuramsal Çalışmalar. Ed. Esra Uluşahin & Emrah Eriş, içinde 185216. Ankara: Nobel Bilimsel Eserler, 2020. google scholar
  • Ehab, Rana, Amer Eslam ve Gadallah, Mahmoud “English-Arabic Hybrid Machine Translation System using EBMT and Translation Memory”. International Journal of Advanced Computer Science and Applications. 10 (2019): 195-203. google scholar
  • el- 'Uceylî Şezâ 'Abdulbâkî ve el- 'Azzâvî Muhammed İlyâs. “İtticâhât A'dâ’ el-Hey’e et-Tedrîsîyye Fi’l-Câmi 'ât Nahve Fâ’ideti İstihdâmi’t-Terceme el-’Âliyye Li Google fî Ebhâsihim ve İ'dâdi Muhâdarâtihim”. et-Terceme el-Âliyye el-Aşabiyye ve Tehaddiyâti’z-Zekâel-İştinâ'î. 32-44. Berlîn: li’l-Merkez ed-Dîmukrâtî el-'Arabî, 2021. google scholar
  • Er, Rahmi. Çağdaş Arap Edebiyatı Seçkisi. Ankara: Vadi Yayınları. 2012. google scholar
  • Hutchins, WJ ve Somers, HL. An Introduction to Machine Translation. Londra: Academic Press. 1992. google scholar
  • Kızılgeçit, Muhammet, Çinici, Murat ve Nurullah Okan. “Yapay Zekâ Sohbet Robotu Chatgpt ile İnanç-İnançsızlık, Doğal Afet ve Ölüm Konuları Üzerine Nitel Bir Araştırma: Din ve Maneviyatın Psikolojik Sağlığa Etkileri”. Ağrı İbrahim Çeçen Üniversitesi Sosyal Bilimler Enstitüsü Dergisi. 9/1 (2023): 137-172. google scholar
  • König, Wolf. “Dilbilim ve Yapay Zekâ”. Dilbilim ve Araştırmalar Dergisi. (1994): 219-235. google scholar
  • Kuşçu, Ertan. “Çeviride Yapay Zekâ Uygulamaları”. Kazım Karabekir Eğitim Fakültesi Dergisi. 30 (2015): 45-58. google scholar
  • Munday, Jeremy. The Routledge Companion to Translation Studies. London: Routledge. 2009. google scholar
  • Rahzeb, Choudhury ve McConnell, Brian. Translation Technology Landscape Report. Amsterdam: TAUS BV, De Rijp. 2013. google scholar
  • Sadıkov, Taşpolot ve Kerim Sarıgül. “Makine Çeviri Yöntemleri ve Makine Çevirisinin Bugünkü Durumu”. Uluslararası Türkçe Edebiyat Kültür Eğitim Dergisi. 10/1 (2021): 192-205. google scholar
  • Seçkin, Sevcan. “Türkiye’deki Teknik Çevirmenlerin Makine Çevirisi Sonrası Düzeltme İşlemine Karşı Tutumları”. İstanbul Üniversitesi Çeviribilim Dergisi. 17 (2022): 135-150. google scholar
  • Şahin, Mehmet. Çeviri ve Teknoloji. İzmir: İzmir Ekonomi Üniversitesi Yayınları. 2013. google scholar
  • Şanverdi, İbrahim ve Abdulmuttalip Işıdan. “Makine Çevirisi: Türkçe-Arapça Çeviri Bağlamında Google ve Yandex Çeviri Örneği”. Söylem Filoloji Dergisi. 6/1 (2021): 207-221. google scholar
  • Tarcan, Ahmet ve Ecevit Bekler. “İngilizce-Türkçe, Türkçe-İngilizce Makine Çevirisinde Yazılımların Karşılaştırılması”. (Akademik Bilişim Konferansında sunulan bildiri 31 Ocak - 2 Şubat 2007). google scholar
  • Thorp, Holden. “ChatGPT is fun, but not an author”. Science. (2023), 313-313. google scholar
  • Tok, Ziya. “Makine Çevirisi ve Çeviri Kuramları”. International Journal of Language Academy. 8/1 (2020): 394-403. google scholar
  • Zağlûl, Hişâm Sa'd. “Şiyâğatu’l-Muhtevâ el-’İbdâ'î Bi’l-’İ'lâm et-Terbevî Bi’stihdâm Tekaniyye ez-Zeka’ el-İştinâ'î: ChatGPT İstikşâf el-Furaş ve’t-Tehaddiyât”. Mecelletu Ebhâs et-Terbiye el-Hâşşa. 75 (2023): 56-140. google scholar
  • “1962 Tarihli Kuveyt Anayasası.” Erişim 08 Mayıs 2023. https://constitutionnet.org/sites/default/files/constitution_of_kuwait_1962_-_arabic.pdf google scholar
  • ChatGPT “ChatGPT Modelleri,” Erişim 15 Mayıs 2023. https://platform.openai.com/docs/models/overview google scholar
  • ChatGPT “Sohbet.” Erişim 17 Haziran 2023. https://chat.openai.com/ google scholar

Citations

Copy and paste a formatted citation or use one of the options to export in your chosen format


EXPORT



APA

Yılmaz, S. (2023). The Efficiency of Neural Machine Translation Models in ArabicTurkish Translation Types: Example of ChatGPT. Journal of Oriental Studies, 0(43), 339-355. https://doi.org/10.26650/jos.1324416


AMA

Yılmaz S. The Efficiency of Neural Machine Translation Models in ArabicTurkish Translation Types: Example of ChatGPT. Journal of Oriental Studies. 2023;0(43):339-355. https://doi.org/10.26650/jos.1324416


ABNT

Yılmaz, S. The Efficiency of Neural Machine Translation Models in ArabicTurkish Translation Types: Example of ChatGPT. Journal of Oriental Studies, [Publisher Location], v. 0, n. 43, p. 339-355, 2023.


Chicago: Author-Date Style

Yılmaz, Sezer,. 2023. “The Efficiency of Neural Machine Translation Models in ArabicTurkish Translation Types: Example of ChatGPT.” Journal of Oriental Studies 0, no. 43: 339-355. https://doi.org/10.26650/jos.1324416


Chicago: Humanities Style

Yılmaz, Sezer,. The Efficiency of Neural Machine Translation Models in ArabicTurkish Translation Types: Example of ChatGPT.” Journal of Oriental Studies 0, no. 43 (May. 2024): 339-355. https://doi.org/10.26650/jos.1324416


Harvard: Australian Style

Yılmaz, S 2023, 'The Efficiency of Neural Machine Translation Models in ArabicTurkish Translation Types: Example of ChatGPT', Journal of Oriental Studies, vol. 0, no. 43, pp. 339-355, viewed 2 May. 2024, https://doi.org/10.26650/jos.1324416


Harvard: Author-Date Style

Yılmaz, S. (2023) ‘The Efficiency of Neural Machine Translation Models in ArabicTurkish Translation Types: Example of ChatGPT’, Journal of Oriental Studies, 0(43), pp. 339-355. https://doi.org/10.26650/jos.1324416 (2 May. 2024).


MLA

Yılmaz, Sezer,. The Efficiency of Neural Machine Translation Models in ArabicTurkish Translation Types: Example of ChatGPT.” Journal of Oriental Studies, vol. 0, no. 43, 2023, pp. 339-355. [Database Container], https://doi.org/10.26650/jos.1324416


Vancouver

Yılmaz S. The Efficiency of Neural Machine Translation Models in ArabicTurkish Translation Types: Example of ChatGPT. Journal of Oriental Studies [Internet]. 2 May. 2024 [cited 2 May. 2024];0(43):339-355. Available from: https://doi.org/10.26650/jos.1324416 doi: 10.26650/jos.1324416


ISNAD

Yılmaz, Sezer. The Efficiency of Neural Machine Translation Models in ArabicTurkish Translation Types: Example of ChatGPT”. Journal of Oriental Studies 0/43 (May. 2024): 339-355. https://doi.org/10.26650/jos.1324416



TIMELINE


Submitted07.07.2023
Accepted10.09.2023
Published Online24.10.2023

LICENCE


Attribution-NonCommercial (CC BY-NC)

This license lets others remix, tweak, and build upon your work non-commercially, and although their new works must also acknowledge you and be non-commercial, they don’t have to license their derivative works on the same terms.


SHARE




Istanbul University Press aims to contribute to the dissemination of ever growing scientific knowledge through publication of high quality scientific journals and books in accordance with the international publishing standards and ethics. Istanbul University Press follows an open access, non-commercial, scholarly publishing.