展示HN:离网 – 在手机上离线运行AI文本、图像生成和视觉功能
Show HN: Off Grid – Run AI text, image gen, vision offline on your phone

原始链接: https://github.com/alichherawalla/off-grid-mobile

## 离网:一套完整的离线人工智能工具包 离网是一款移动人工智能工具包,提供文本生成、图像创建、视觉人工智能、语音转录和文档分析等功能——所有功能**完全离线**,直接在您的设备上运行。与基础聊天应用程序不同,它支持强大的模型,如Qwen 3、Llama 3.2和Stable Diffusion。 主要功能包括:流式文本响应(旗舰设备上5-30个token/秒)、实时图像生成(骁龙处理器配合NPU加速下5-10秒)、使用相机进行视觉问答,以及通过Whisper进行私密、本地的语音转录。它还处理文档分析,并具有原生PDF文本提取功能。 离网优先考虑隐私——**无需云连接、订阅或数据收集**。它适用于Android和iOS,源代码可在GitHub上获取,用于构建和贡献。性能因设备和模型而异,但即使在入门级手机上也能实现实用的速度。

## 离线运行:在手机上本地运行人工智能 一款名为“Off Grid”的新开源应用允许用户在智能手机上完全*离线*运行人工智能模型——包括文本、图像生成、视觉和语音转录。该应用由ali_chherawalla开发,并在GitHub上提供,它利用了现代手机中强大的GPU,无需基于云的人工智能服务以及相关的隐私问题。 Off Grid利用了llama.cpp、Stable Diffusion和Whisper等技术,并在Android和iOS上加速运行。这使得即使没有互联网连接也能实现人工智能功能——非常适合旅行、审查地区或敏感数据。 该项目采用MIT许可,Android APK已可直接使用,并且可以通过源代码编译获得iOS版本。一位用户表示有兴趣将其构建到F-Droid应用商店。本质上,Off Grid旨在将人工智能的力量直接掌握在用户手中,优先考虑隐私和可访问性。
相关文章

原文

Not just another chat app

Most "local LLM" apps give you a text chatbot and call it a day. Off Grid is a complete offline AI suite — text generation, image generation, vision AI, voice transcription, and document analysis, all running natively on your phone's hardware.


Text Generation — Run Qwen 3, Llama 3.2, Gemma 3, Phi-4, and any GGUF model. Streaming responses, thinking mode, 15-30 tok/s on flagship devices. Bring your own .gguf files too.

Image Generation — On-device Stable Diffusion with real-time preview. NPU-accelerated on Snapdragon (5-10s per image), Core ML on iOS. 20+ models including Absolute Reality, DreamShaper, Anything V5.

Vision AI — Point your camera at anything and ask questions. SmolVLM, Qwen3-VL, Gemma 3n — analyze documents, describe scenes, read receipts. ~7s on flagship devices.

Voice Input — On-device Whisper speech-to-text. Hold to record, auto-transcribe. No audio ever leaves your phone.

Document Analysis — Attach PDFs, code files, CSVs, and more to your conversations. Native PDF text extraction on both platforms.

AI Prompt Enhancement — Simple prompt in, detailed Stable Diffusion prompt out. Your text model automatically enhances image generation prompts.


Task Flagship Mid-range
Text generation 15-30 tok/s 5-15 tok/s
Image gen (NPU) 5-10s
Image gen (CPU) ~15s ~30s
Vision inference ~7s ~15s
Voice transcription Real-time Real-time

Tested on Snapdragon 8 Gen 2/3, Apple A17 Pro. Results vary by model size and quantization.


Grab the latest APK from GitHub Releases, install, and start chatting in under 2 minutes.

git clone https://github.com/alichherawalla/offgrid-mobile.git
cd OffgridMobile
npm install

# Android
cd android && ./gradlew clean && cd ..
npm run android

# iOS
cd ios && pod install && cd ..
npm run ios

Requires Node.js 20+, JDK 17 / Android SDK 34 (Android), Xcode 15+ (iOS). See full build guide.



Contributions welcome! Fork, branch, PR. See development guidelines for code style and the codebase guide for patterns.


Built on the shoulders of giants: llama.cpp | whisper.cpp | llama.rn | whisper.rn | local-dream | ml-stable-diffusion | MNN | Hugging Face


Off Grid — Your AI, your device, your data.

No cloud. No subscription. No data harvesting. Just AI that works anywhere.

联系我们 contact @ memedata.com