Agentic Data Sampling Framework for Multilingual ASR via Linguistic-Aware Error-Driven Optimization 待解读

下载

新用户看这篇论文该怎么开始

  1. 先点「赞助解读」,AI 会把论文转成可直接执行的行动清单。
  2. 看完“可执行改进行动”后,可快速决定是否值得立项。
  3. 用上面的卡片内容直接发给团队,减少重复阅读。
先订阅关键词,后续不再手工筛论文

摘要

Multilingual automatic speech recognition (ASR) has achieved rapid progress with large-scale pretrained models and multilingual speech corpora. Previous studies have proved the pivotal role of data sampling in multilingual ASR performance. However, existing sampling strategies largely rely on time-consuming manual, heuristic-based designs. To address this, we propose a linguistic-aware agentic data sampling framework that introduces a data sampling LLM agent into the multilingual ASR training loop. The agent is driven by a linguistically grounded rubric that analyzes ASR errors from phonological, morphological, and syntactic perspectives, and uses the resulting feedback together with training statistics, budget constraints, and algorithm profiles to select domain-level, sample-level, and token-level sampling strategies. This design turns evaluation results into adaptive data-selection decisions rather than treating WER/CER as final endpoints only. We conduct experiments on twelve Common Voice languages using Whisper-medium as the ASR backbone. The results show that our method achieves performance better than full-data training while using less training data and lower computational resources, and substantially accelerates training convergence compared to conventional sampling strategies.

分析报告

暂无报告。点击“分析”开始生成。

个性化解读 与社区共享解读不同

用自己的话告诉 AI 你想要什么样的解读(比如"用大白话讲给非专业人士听"、"重点分析对我们团队 RAG 系统的可迁移性"),生成一份只属于你自己的版本;生成后也可以选择设为"愿意共享",被更多人看到、点赞。