小于 500kb 的语音识别与语音合成
Speech Recognition and TTS in less than 500kb

原始链接: https://github.com/moonshine-ai/moonshine/tree/main/micro

Moonshine Voice 是一款开源 AI 工具包,专为构建实时语音应用而设计。其专门版本 **Moonshine Micro** 针对微控制器和 DSP 等资源受限的硬件进行了优化。 Moonshine Micro 以 80 美分的树莓派 RP2350 为参考平台,集成了语音活动检测 (VAD)、命令识别 (STT) 和神经语音合成 (TTS) 功能。整个流水线效率极高,仅需约 470 KB 内存即可在有限的计算资源下有效运行。通过利用共享内存池处理顺序任务,该系统可以轻松适应低成本嵌入式处理器的内存限制。 该工具包采用宽松的 MIT 许可证发布,非常适合商业部署。开发者可以利用由 TensorFlow Lite Micro 驱动的 VAD、STT 和 TTS 库进行独立开发。该项目包含一个完整的端到端示例,用于在 RP2350 上搭建支持 Wi-Fi 的语音智能体,为嵌入式系统添加语音交互功能提供了一种易于上手且高性价比的解决方案。

Hacker News | 最新 | 过往 | 评论 | 提问 | 展示 | 招聘 | 提交 | 登录 语音识别与语音合成(TTS)体积小于 500kb (github.com/moonshine-ai) 21 点,由 petewarden 发布于 1 小时前 | 隐藏 | 过往 | 收藏 | 4 条评论 | 帮助 sgt 1 小时前 | 下一条 [-] 演示视频快捷链接:https://www.youtube.com/watch?v=kMliOFYBiz4 回复 zarmin 6 分钟前 | 上一条 | 下一条 [-] 感谢分享。我很喜欢你在《抑制热情》(Curb Your Enthusiasm)里的工作。 回复 0xnyn 12 分钟前 | 上一条 | 下一条 [-] 说实话,看起来太棒了。 回复 sgt 1 小时前 | 上一条 [-] 干得漂亮! 回复 考虑申请 YC 2026 年秋季批次!申请开放至 7 月 27 日。 指南 | 常见问题 | 列表 | API | 安全 | 法律 | 申请 YC | 联系 搜索:
相关文章

原文

Moonshine Voice Logo

Moonshine Voice is an open source AI toolkit for developers building real-time voice agents and applications. Moonshine Micro is a version designed specifically for embedded system processors like microcontrollers and DSPs, and uses the Raspberry Pi RP2350, which retails for just 80 cents, as its reference platform. It includes voice-activity detection, command recognition, and neural speech synthesis and can run in as little as 470 KB of RAM.

You can see a full walkthrough in the video below:

Moonshine Micro demo video

The memory and compute requirements are designed to fit resource-constrained systems. Figures below are for the RP2350 demo; the detailed memory budget breaks each one down:

Component Flash SRAM (arena peak) Compute
VAD (Voice Activity Detection) ~89 KiB ~36 KiB ~0.8 MMAC/frame (~25 MMAC/s)
STT (SpellingCNN Speech-to-Text) ~1.3 MiB ~346 KiB ~36 MMAC/s
TTS (neural diphone synth @ 16 kHz) ~1.8 MiB voice pack ~340 KiB ~37 MMAC typical reply (~65 MMAC/s out)
TOTAL (Demo pipeline) ~3.6 MiB ~468 KiB provisioned* classify + speak ~0.7–1.0 s

Notes:

  • Flash is .text + .rodata measured with arm-none-eabi-size on the default moonshine_micro_echo firmware (includes the embedded neural voice pack); SRAM is .bss + heap + stacks.
  • *VAD, STT, and neural TTS run sequentially and time-share one ~384 KiB TFLM arena, so SRAM is not additive — ~468 KiB is the total RAM provisioned on the 520 KiB RP2350 (wifi_hardware ~491 KiB).
  • A MAC is one multiply-accumulate; MMAC/s = millions per second during the active (non-idle) stage.

The code is released under the permissive MIT License, suitable for commercial applications.

There's a complete end-to-end example showing how to set up a wifi connection on a microcontroller using voice on an RP2350 MCU.

The VAD, STT, and TTS libraries can be used independently of each other, relying on the included TensorFlow Lite Micro library for the neural computations.

This code, apart from the source in third-party/, is licensed under the MIT License — see LICENSE in this directory (also at the repository root).

The SpellingCNN and TinyVadCNN models in models/ are released under the MIT License.

The code in third-party/ is licensed according to the terms of the open source projects it originates from, with details in a LICENSE file in each subfolder.

联系我们 contact @ memedata.com