arXiv Releases TamilEOT: Semantic End-of-Turn Detection Dataset and Model for Tamil Telephone Conversations
Summary:arXiv has released TamilEOT, a dataset and model for semantic end-of-turn detection in Tamil telephone conversations. The dataset includes 18,485 labeled turn boundaries extracted from 116 real Tamil phone calls, along with two audio-only detectors fine-tuned from Smart Turn v3. On a held-out split of 4,168 clips from 30 unseen calls, the models achieved an accuracy of 83.71% (8.7MB) and 86.13% (21MB), with ROC-AUC rising from 0.751 to 0.921. Both models run in under 150 milliseconds on a laptop
Background and Significance
Accurately determining when a user finishes speaking is crucial for voice assistant interactions. Existing open semantic end-of-turn detectors primarily focus on Western languages, while models for South Indian languages like Tamil are scarce. The release of TamilEOT fills this gap by providing the first dedicated dataset and model for semantic end-of-turn detection in Tamil telephone conversations.
Technical Highlights
- Dataset Construction: The dataset includes 18,485 labeled turn boundaries extracted from 116 real Tamil phone calls, ensuring data authenticity and diversity.
- Model Performance: The audio-only detectors fine-tuned from Smart Turn v3 demonstrated strong performance, with accuracy rising from 70.30% zero-shot to 83.71% (8.7MB model) and 86.13% (21MB model), and ROC-AUC increasing from 0.751 to 0.921.
- Efficient Runtime: Both models run in under 150 milliseconds on a laptop CPU, making them suitable for real-time applications.
- Annotation Costs and Training Analysis: The study provides a detailed analysis of annotation costs and key factors influencing training performance, such as the impact of encoder capacity on model accuracy.
Industry Impact
The release of TamilEOT provides essential resources for AI applications in South Indian languages, particularly in areas like voice assistants, customer service, and intelligent interaction systems. This research not only demonstrates the technical feasibility of non-mainstream languages but also offers a reference for the development of future multilingual AI models.
Developer Recommendations
- Data Expansion: Developers can utilize the TamilEOT dataset for further expansion and optimization to adapt to more complex application scenarios.
- Model Fine-Tuning: It is recommended to fine-tune existing models to enhance performance on specific tasks.
- Multilingual Support: Consider applying TamilEOT technology to other South Indian languages to achieve broader multilingual support.
— END —Source: ArXiv NLP/LLM (cs.CL) (2026-09-09)
Tags: #Speech Recognition #Tamil Language #Semantic Detection #Dataset #Model Release
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments