ZICQ
中 Log in / Sign up
Newsroom LLMs & Foundation Models #Speech Recognition #Tamil Language #Semantic Detection #Dataset #Model Release

arXiv Releases TamilEOT: Semantic End-of-Turn Detection Dataset and Model for Tamil Telephone Conversations

Avatar of Mr.Xu

By Mr.Xu Compiled & Reviewed by Editorial

Published: · 8 views

中文阅读 (Chinese) English Version
Co-reading Select any sentence in the article to highlight, annotate, or copy a quote card. Join discussion ↓

Summary:arXiv has released TamilEOT, a dataset and model for semantic end-of-turn detection in Tamil telephone conversations. The dataset includes 18,485 labeled turn boundaries extracted from 116 real Tamil phone calls, along with two audio-only detectors fine-tuned from Smart Turn v3. On a held-out split of 4,168 clips from 30 unseen calls, the models achieved an accuracy of 83.71% (8.7MB) and 86.13% (21MB), with ROC-AUC rising from 0.751 to 0.921. Both models run in under 150 milliseconds on a laptop


Background and Significance

Accurately determining when a user finishes speaking is crucial for voice assistant interactions. Existing open semantic end-of-turn detectors primarily focus on Western languages, while models for South Indian languages like Tamil are scarce. The release of TamilEOT fills this gap by providing the first dedicated dataset and model for semantic end-of-turn detection in Tamil telephone conversations.

Technical Highlights

  1. Dataset Construction: The dataset includes 18,485 labeled turn boundaries extracted from 116 real Tamil phone calls, ensuring data authenticity and diversity.
  2. Model Performance: The audio-only detectors fine-tuned from Smart Turn v3 demonstrated strong performance, with accuracy rising from 70.30% zero-shot to 83.71% (8.7MB model) and 86.13% (21MB model), and ROC-AUC increasing from 0.751 to 0.921.
  3. Efficient Runtime: Both models run in under 150 milliseconds on a laptop CPU, making them suitable for real-time applications.
  4. Annotation Costs and Training Analysis: The study provides a detailed analysis of annotation costs and key factors influencing training performance, such as the impact of encoder capacity on model accuracy.

Industry Impact

The release of TamilEOT provides essential resources for AI applications in South Indian languages, particularly in areas like voice assistants, customer service, and intelligent interaction systems. This research not only demonstrates the technical feasibility of non-mainstream languages but also offers a reference for the development of future multilingual AI models.

Developer Recommendations

  • Data Expansion: Developers can utilize the TamilEOT dataset for further expansion and optimization to adapt to more complex application scenarios.
  • Model Fine-Tuning: It is recommended to fine-tune existing models to enhance performance on specific tasks.
  • Multilingual Support: Consider applying TamilEOT technology to other South Indian languages to achieve broader multilingual support.

Source: ArXiv NLP/LLM (cs.CL) (2026-09-09)

— END —

Tags: #Speech Recognition #Tamil Language #Semantic Detection #Dataset #Model Release

Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.

What's your take on this story?
🚀 Explore & Submit Works

Community Comments

Loading live comments and annotations…