双子座-3.5-转录
Gemini-3.5-Transcribe

原始链接: https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-3-5-transcribe/

Google 推出了其最先进的语音转文字模型 **Gemini 3.5 Transcribe**,专为高精度、智能化的语音交互而设计。该模型能直接将原始音频转换为润色、格式化后的文本,擅长过滤口语杂词、处理语音停顿,并能识别超过 85 种语言的专业术语。 该模型现已通过两个 API 向开发者提供: * **实时流式传输 (`gemini-3.5-transcribe-live`):** 为交互式语音代理提供亚秒级的低延迟响应。 * **预录处理 (`gemini-3.5-transcribe`):** 提供说话人识别和词级时间戳,适用于数据分析和会议记录。 Gemini 3.5 Transcribe 具备行业领先的准确性,在非流式任务中的字错率低至 2.6%,专为复杂的真实环境而构建。它还支持高级功能,例如通过函数调用进行任务委派,以及适应专业词汇的能力。无论是支持实时字幕生成还是复杂的通话后分析,该模型都为旨在构建更自然、更强大的语音驱动应用的开发者提供了一种稳健且无缝的解决方案。

针对谷歌基于 Gemini 的新型转录工具,Hacker News 上的讨论呈现出褒贬不一的反应。 虽然一些用户称赞该模型的准确性、延迟表现和格式化能力,但其他人则表示了强烈不满。主要批评包括: * **简化问题:** 用户反映人工智能经常会“简化”语音,无意中删除了细微差别或整个从句,从而改变了原意。 * **性能与替代方案的对比:** 许多开发人员更倾向于运行 *Voxtral Mini 3b* 或 *Parakeet* 等本地模型,并指出这些模型更适合多语言对话和特定行业的术语。 * **可靠性:** 用户对幻觉和不稳定的句子格式化表示担忧。一些用户反映,即使在有噪音或静音的情况下,竞争模型(如 Whisper)的表现也可能难以预测,导致转录文本混乱,需要后续清理。 * **可用性:** 用户对该功能的推广感到困惑,因为它似乎与特定硬件(Pixel 10/11)和 Gboard 更新绑定,而非作为一种通用工具提供。 总的来说,尽管这项技术在听写质量上实现了飞跃,但与专业化、本地运行的替代方案或更完善的云端竞争对手相比,高级用户对其在精确业务任务中的可靠性仍持怀疑态度。
相关文章

原文

Today, we’re introducing Gemini 3.5 Transcribe, our most precise speech-to-text model yet, designed for intelligent voice interactions. Unlike conventional speech recognition models that struggle with background noise, complex jargon, and disfluency cleanup, Gemini 3.5 Transcribe converts raw audio directly into accurate, polished, formatted text.

Across our products like the Gemini app and on Android, we’ve seen consumers already benefiting from this transcription model with new voice capabilities like Rambler on Android and in the Gemini app on macOS. Now, developers can build similar capabilities with Gemini 3.5 Transcribe in the Gemini API in Google AI Studio and Gemini Enterprise Agent Platform.

We've built 3.5 Transcribe to plug seamlessly into your developer workflows, whether you’re building voice agents, real-time captioning tools, or post-call analytics pipelines. The model is available across two separate APIs:

  • Real-time streaming: Delivers continuous, bidirectional streaming with sub-second latency for interactive voice apps via the Live API using gemini-3.5-transcribe-live.
  • Pre-recorded audio processing: Transcribes recorded audio, meetings, call logs, and more with speaker attribution and word-level timestamps via the Interactions API using gemini-3.5-transcribe.

Gemini 3.5 Transcribe is designed to capture your natural speaking style to better understand your intent and recognize custom vocabulary, so you can execute tasks with your voice.

  • Smart transcription: Seamlessly handles self-corrections (like "let’s meet Tuesday—no, Wednesday"), removes filler words (“ums” and ‘“ahs"), auto-formats your text.
  • Function calling: The model can delegate complex tasks (such as image generation and file analysis) to other Gemini models via function calls. Currently available in the Gemini macOS app.
  • More precise transcription: As measured by Artificial Analysis, achieves an average Word Error Rate (WER) of 4.0% for streaming and 2.6% for non-streaming use-cases. It shows strong performance across noisy, real-world environments, accurately capturing alphanumeric entities like postal codes and order IDs.
  • Custom vocabulary: Recognizes specialized jargon and unique spellings by seamlessly adapting transcriptions to your provided custom vocabulary.
  • Global language support: Automatically detects and transcribes over 85 languages, seamlessly handling regional accents and diverse dialects.
  • Multi-speaker identification: Accurately attributes speech in pre-recorded audio with timestamps for up to three speakers (support for 3+ speakers is experimental).
联系我们 contact @ memedata.com