OurXiv

AI驱动的学术论文智能分析平台

S3-S2ST: Semantically Supervised Streaming Speech-to-Speech Translation 待解读

下载

新用户看这篇论文该怎么开始

  1. 先点「赞助解读」，AI 会把论文转成可直接执行的行动清单。
  2. 看完“可执行改进行动”后，可快速决定是否值得立项。
  3. 用上面的卡片内容直接发给团队，减少重复阅读。
先订阅关键词，后续不再手工筛论文

摘要

Streaming speech-to-speech translation requires timely decisions about when partial input is sufficient for accurate translation. We present S3-S2ST, a model that learns to translate and speak from semantically aligned streaming supervision. By converting utterance-level speech pairs into incremental training examples, we teach a learned policy when to commit translations. Its adjustable threshold controls the quality--latency tradeoff on a fixed 640\,ms input grid. S3-S2ST delivers competitive English--Chinese translation on FLEURS and leads the evaluated streaming systems in translation quality on the internal 9-pair test set. On RealSI, adapting the threshold to buffered speech further improves quality over a low fixed threshold with little change in first-audio latency. We plan to release the model and code.

分析报告

暂无报告。点击“分析”开始生成。

个性化解读 与社区共享解读不同

用自己的话告诉 AI 你想要什么样的解读（比如"用大白话讲给非专业人士听"、"重点分析对我们团队 RAG 系统的可迁移性"），生成一份只属于你自己的版本；生成后也可以选择设为"愿意共享"，被更多人看到、点赞。