Building accurate translation-tailored large language models with language-aware instruction tuning
Regular Papers|Updated:2025-09-04
|
Building accurate translation-tailored large language models with language-aware instruction tuning
Enhanced Publication
构建基于语言感知指令微调的精准翻译定制大语言模型
“In the realm of natural language processing, a breakthrough has been made in enhancing the accuracy of large language models (LLMs) in machine translation tasks. Researchers have developed a two-stage fine-tuning algorithm that significantly reduces off-target translation issues, improving translation quality. This innovation effectively addresses the challenge of producing translations in the wrong language when instructions are not followed. The method involves fine-tuning LLMs on translation data and then introducing an extra unlikelihood loss to decrease the probability of incorrect translations. This advancement not only boosts translation accuracy but also preserves the model's performance on other tasks.”
Frontiers of Information Technology & Electronic EngineeringVol. 26, Issue 8, Pages: 1341-1355(2025)
Affiliations:
1.College of Control Science and Engineering, China University of Petroleum (East China), Qingdao 266580, China
2.School of Computer Science, University of Sydney, New South Wales 2006, Australia
3.JD Explore Academy, JD.com Inc., Beijing 100101, China
4.School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University, Shenzhen 518107, China
Changtong ZAN, Liang DING, Li SHEN, et al. Building accurate translation-tailored large language models with language-aware instruction tuning[J]. Frontiers of Information Technology & Electronic Engineering, 2025, 26(8): 1341-1355.
DOI:
Changtong ZAN, Liang DING, Li SHEN, et al. Building accurate translation-tailored large language models with language-aware instruction tuning[J]. Frontiers of Information Technology & Electronic Engineering, 2025, 26(8): 1341-1355. DOI: 10.1631/FITEE.2400458.
Building accurate translation-tailored large language models with language-aware instruction tuningEnhanced Publication