Retrieval and Documents
Software that ingests, parses, searches, retrieves, and organizes documents or knowledge for AI applications; long-term conversational memory belongs under Agent Systems › Agent Memory, not here.
Subfields
Document and File Search
Local or hosted search tools that locate documents and files by text, content, metadata, or semantic meaning; it excludes source-code search tools and general web crawling.
2 projectsKnowledge Graphs
Graph construction and reasoning systems that represent entities, documents, code, or concepts for retrieval and inference; it excludes agent conversation memory and general-purpose graph databases.
1 projectsRAG Engines
Retrieval-augmented generation systems that retrieve external evidence and compose grounded model answers; it excludes ordinary search engines, static vector databases, and document converters without retrieval.
1 projectsWeb ingestion and crawling
Crawlers, scrapers, and web ingestion pipelines primarily collecting or extracting web content for downstream use. Includes browser-driven and AI-assisted collection. Excludes general interactive browser agents, standalone document-format conversion, and complete retrieval-and-answering applications.
1 projects| Project | What it does | Stars | Language | License | Latest release |
|---|---|---|---|---|---|
| graphify-labs/graphify | A tool that turns code, documents, SQL schemas, configs, and PDFs into a queryable knowledge graph. | ★ 128.1K | Python | Apache-2.0 | v0.9.92 |
| infiniflow/ragflow | RAGFlow is a RAG engine that extracts knowledge from unstructured documents and combines agentic retrieval with grounded answers. | ★ 92.4K | Go | Apache-2.0 | v1.0.0-rc2 |
| unclecode/crawl4ai | Crawls websites and converts their content into clean, LLM-ready Markdown for downstream AI use. | ★ 85.8K | Python | Apache-2.0 | v0.9.5 |
| arahim3/digup | Indexes photos, documents, recordings, videos, and code on-device for cross-format semantic search by content. | ★ 4.7K | Swift | MIT | v0.7.0-beta.2 |
| allenv0/scm | Searches photos and video frames locally with semantic, OCR, transcript, and local-LLM question answering. | ★ 488 | TypeScript | MIT | — |