The Mirage of Fully Objectivity in Translation Evaluation: The Question of Reliability
نویسندگان :
Alireza Akbari ( University of Isfahan ) , Mohammadtaghi Shahnazari ( University of Isfahan )
چکیده
Over the past few years, researchers in the field of Translation Evaluation have incessantly manifested the necessity of empirical evidence in the evaluation of different translation tests (Eyckmans and Anckaert 2017). Notwithstanding the presence of ‘certifactions of translation skills’ and a great number of appeals regarding objectivity in translation evaluation reverberated in different states of the art, the issue of reliability lies under pivotal inquiry (Akbari et al. 2018). Before proceeding to nullify the term ‘fully objectivity’ in translation, this paper introduces a model of translation evaluation called ‘Logistic Calibrated Items’ (LCI hereafter). LCI method is signalized through three different yet consistent factors namely: (i) the application of Brat Visualization platform Stanford CoreNLP; (ii) the application of 1-parameter logistic model (1-PL); and (iii) the application of rit value (also known as corrected item-total correlation). In order to nullify fully objectivity in translation, we delve into the psychometric quality of two recent assessment methods: the LCI method and the PIE method (Kockaert & Segers 2017). The reliability of the PIE and LCI methods was empirically compared through scoring the same set of translations (n=125) based on procedures of each translation evaluation method. Although the PIE method was claimed to be a fully objective evaluation method, the results revealed that the PIE method would not be able to discriminate between the translation performances of the test-takers in a reliable fashion. However, the LCI method approved a difference between the translation performances of the test-takers reliably in terms of 1-PL and rit value.کليدواژه ها
Translation Evaluation, Reliability, Objectivity, PIE Method, LCI Methodکد مقاله / لینک ثابت به این مقاله
برای لینک دهی به این مقاله، می توانید از لینک زیر استفاده نمایید. این لینک همیشه ثابت است :نحوه استناد به مقاله
در صورتی که می خواهید در اثر پژوهشی خود به این مقاله ارجاع دهید، به سادگی می توانید از عبارت زیر در بخش منابع و مراجع استفاده نمایید:Alireza Akbari , 1398 , The Mirage of Fully Objectivity in Translation Evaluation: The Question of Reliability , اولين کنفرانس بين المللي مطالعات زبان انگليسي
دیگر مقالات این رویداد
© کلیه حقوق متعلق به دانشگاه اصفهان میباشد.