Show HN:VoidAccess — 开源暗网 OSINT,从查询到图谱
Show HN: VoidAccess – open-source dark web OSINT, from query to a graph

原始链接: https://github.com/KatrielMoses/voidaccess

VoidAccess 是一个可自托管的 OSINT 平台,可将暗网研究查询转化为结构化威胁情报。专为授权研究人员和调查人员构建,可通过 CLI 或 Docker Compose 在本地运行,支持 SQLite/PostgreSQL。它并行采集来自 Tor 搜索引擎、粘贴站、代码托管平台、RSS 订阅源和 .onion 种子的内容;过滤噪声;丰富指标;递归发现链接;提取 IOC、钱包、凭据、句柄、漏洞、攻击者、恶意软件、人员和组织等实体;交叉引用数据集;构建关系图和基础设施集群;并导出 STIX、MISP、Sigma、YARA、Snort、Suricata、CSV、Markdown、JSON 和 IOC 包。它包括攻击者画像、时间线、笔记、向量缓存复用、内容安全闸门以及可选的 LLM/向量嵌入支持。丰富来源包括威胁情报源、被动 DNS、区块链、沙箱和声誉服务,API 密钥可选。命令包括 investigate、show、export、package、enrich、list、status、actors 和 configuration。采用 MIT 许可,仅用于授权安全研究。

一篇 Hacker News 帖子宣布了 VoidAccess,这是一个由 Katriel(coding-maniac)开发的开源暗网 OSINT 工具,可自动化暗网调查,从查询到图谱,并过滤噪声和 NSFW 内容。作者还提到 MailAccess,并表示引擎会运行至完成或达到设定的时间限制。评论包括关于合并逻辑和重复昵称的问题、称赞、一个勒索软件调查链接,以及怀疑项目、工具或公告可能是 AI 生成或 vibe-coded。作者为开发中使用 AI 辩护,强调自行架构,认为媒体被屏蔽且 NSFW 过滤是多层的,并表示 AI 是可选的。其他人区分了代理辅助开发与 vibe coding。总体而言,讨论围绕信任、自动化和 AI 在安全工具中的作用展开。
相关文章

原文

VoidAccess logo

License: MIT Python 3.10+ Docker Compose PyPI version PyPI downloads

Self-hostable OSINT for turning dark-web research queries into structured threat intelligence. Built for security researchers, threat-intelligence teams, and authorized investigators who need collection, enrichment, relationship mapping, and export in one workflow.

VoidAccess

pip install voidaccess
voidaccess investigate "LockBit ransomware" --no-llm --no-tor --depth shallow
voidaccess list
voidaccess actors
voidaccess status

VoidAccess investigation demo

  • Parallel collection - searches Tor indexes, paste sites, code forges, security feeds, and curated .onion seeds.
  • Entity extraction - finds IOCs, wallets, credentials, handles, vulnerabilities, actors, malware, people, and organizations.
  • Multi-source enrichment - adds reputation, breach, passive DNS, sandbox, blockchain, and threat-feed context.
  • Actor intelligence - persists aliases, infrastructure, notes, timelines, and cross-investigation relationships.
  • Relationship graphs - builds co-occurrence graphs, communities, paths, and infrastructure clusters.
  • Content safety - filters prohibited queries, URLs, content, and extracted entities at mandatory pipeline gates.
  • Structured exports - produces STIX 2.1, MISP, Sigma, YARA, Snort, Suricata, CSV, Markdown, JSON, and IOC packages.
  • CLI and web UI - runs locally with SQLite or as a Docker Compose stack with PostgreSQL and a browser interface.
Stage Action
1 Refine the investigation query with the selected LLM
2 Collect from Tor search, paste sites, code forges, RSS feeds, and curated seeds in parallel
3 Filter noisy or irrelevant pages
4 Enrich the query and early indicators from threat-intelligence sources
5 Discover additional .onion links recursively
6 Reuse recently processed pages from the vector cache
7 Fetch selected pages through Tor with response-size limits
8 Persist newly collected content
9 Merge collected and enriched intelligence
10 Extract entities with regex, NER, and optional LLM analysis
11 Cross-reference entities against historical and seed datasets
12 Build relationships, communities, and infrastructure clusters
13 Generate the final intelligence summary and export-ready result

Full pipeline behavior, timeouts, recovery, and data flow are documented in Architecture.

Category Examples
Cryptocurrency Bitcoin, Ethereum, Monero, Litecoin, Zcash, Solana, Tron, ENS
Network indicators IPv4, IPv6, domains, URLs, .onion addresses, MAC addresses, PGP keys
File indicators MD5, SHA-1, SHA-256, malware families
Credentials Cloud keys, tokens, JWTs, API keys, stealer logs, combo-list entries
Messaging Telegram, Discord, XMPP, Tox, Session, Matrix, Wire, ICQ, Wickr
Vulnerabilities CVEs, MITRE ATT&CK techniques and tactics, Exploit-DB IDs
Detection content YARA rules, Nuclei templates, Snort and Suricata indicators
Threat intelligence Actor handles, ransomware groups, paste links, people, organizations, locations

Collection and Enrichment

Layer Sources
Dark-web search 16+ Tor search engines and curated .onion seeds
Open-web collection Pastebin, dpaste, paste.ee, Rentry, GitHub, GitLab, and curated RSS feeds
Threat feeds AlienVault OTX, abuse.ch, MalwareBazaar, ThreatFox, URLhaus, ransomware.live, CISA KEV
IP and domain context Shodan InternetDB, GreyNoise, AbuseIPDB, Feodo Tracker, C2IntelFeeds, crt.sh, URLScan.io, Wayback Machine, CIRCL PDNS, RDAP
File and identity context VirusTotal, Hybrid Analysis, Have I Been Pwned, EmailRep
Blockchain BlockCypher and Etherscan

Sources that need API keys skip cleanly when their keys are absent. The complete key and configuration reference is in Architecture.

Optional vector embeddings

The default installation can run without PyTorch. When the embedding stack is unavailable, VoidAccess logs that it is using a deterministic SHA-256 fallback encoder. Install the optional NLP dependencies to enable full sentence-transformer vector embeddings:

pip install "voidaccess[nlp]"
Provider Typical models Notes
OpenRouter DeepSeek, Llama, Claude Default route; free models are available
Groq Llama Fast hosted inference with a free tier
OpenAI GPT models API key required
Anthropic Claude Claude Haiku is the tested default
Google Gemini Gemini Flash and Pro Google AI Studio key required
Ollama Any installed local model Local and suitable for air-gapped deployments
Command Description
voidaccess investigate "QUERY" Run an investigation
voidaccess show Open the interactive entity browser
voidaccess export INVESTIGATION_ID --format FORMAT Export as STIX, MISP, Sigma, YARA, Snort, Suricata, package, CSV, Markdown, or JSON
voidaccess package INVESTIGATION_ID Build an IOC package ZIP
voidaccess enrich INVESTIGATION_ID Re-enrich a saved investigation
voidaccess list List saved investigations
voidaccess status Show configuration, Tor, cache, engine, and seed status
voidaccess actors List persistent actor profiles
voidaccess actor HANDLE Show an actor profile
voidaccess actor HANDLE --timeline Show an actor activity timeline
voidaccess actor HANDLE --note "TEXT" Add an analyst note to an actor profile
voidaccess timeline HANDLE Open an actor timeline directly
voidaccess configure Run the setup wizard
voidaccess configure llm Configure the LLM provider, model, and key
voidaccess configure keys Configure enrichment API keys
voidaccess configure tor Override the Tor proxy host and port
voidaccess version Print the installed version

Optional clearnet requests can use ScrapingAnt with --use-scraping-api or --use-proxies; Tor, .onion, GitHub, and GitLab traffic are unaffected.

Run the full PostgreSQL, Tor, FastAPI, and Next.js stack with Docker Compose. The self-hosting guide covers guided setup, environment configuration, operations, and troubleshooting.

Self-hosting guide Docker Compose, environment setup, operations, and troubleshooting
Architecture Pipeline internals, modules, schema, API, enrichment, graph, and configuration reference
Contributing Development setup, standards, and pull requests
Security Supported versions and private vulnerability reporting
Usage policy Authorized-use requirements and prohibited activity
PyPI Published package and release files
GitHub Source, issues, and releases

MIT. Use VoidAccess only for authorized security research and threat-intelligence work; see the Usage Policy.

联系我们 contact @ memedata.com