We are officially open sourced! 🎉
CocoIndex is the world's first open-source engine that supports both custom transformation logic and incremental updates specialized for data indexing. We are now officially open sourced!
17 Posts
CocoIndex Changelog 2025-04-05
CocoIndex updates: Incremental processing with live update mode, evaluation utilities, support for date/time types, Google Drive, and assorted core/performance improvements
Continuous update derived data on source updates, automatically
CocoIndex continuously watches source changes and keeps derived data in sync, with low latency and minimal performance overhead.
Incremental Processing with CocoIndex
CocoIndex helps to keep index up to date with source changes, super efficient and low latency - with the support of incremental processing.
Structured Extraction from Patient Intake Form with LLM
Extract structured data from patient intake forms in PDF/Word with LLM by CocoIndex.
Build text embeddings from Google Drive for RAG
Tutorial to create text embeddings from docs on Google Drive, save in vector stores for semantics search / RAG, using CocoIndex.
CocoIndex Changelog 2025-03-20
First release of CocoIndex Changelog: LLM support, codebase indexing, custom functions, and assorted core/performance improvements
Index codebase for RAG
Tutorial on indexing codebase for RAG with CocoIndex and Tree-sitter: chunking, embedding, semantic search, and build vector index for efficient retrieval.
On-premise structured extraction with LLM using Ollama
Learn to use CocoIndex extracting structured data from PDF/Markdown with Ollama's local LLM models. All running on premise without sending data to external APIs.
Customizable Data Indexing Pipelines
Explain what customizable data indexing pipelines are through comparisons and examples.
What Makes Indexing Pipelines Different?
Understanding the unique characteristics of indexing pipelines compared to other data processing systems. Learn why indexing requires special handling for incremental updates and persistence.
Handling System Updates and CocoIndex Automatic Schema Inference
Explore how CocoIndex handles system updates in indexing flows and our approach to automatic schema inference. Learn about the challenges of managing data and logic evolution, infrastructure setup, and how CocoIndex simplifies these processes through smart automation.
Processing Large Files in Data Indexing Systems
Learn best practices for handling large files in data indexing systems. Understand processing granularity, fan-in/fan-out scenarios, and strategies for efficient processing of large datasets like patent XML files. Discover how CocoIndex helps manage memory pressure and ensures reliable processing.
Data Consistency in Indexing Pipelines
Explore the challenges and solutions for maintaining data consistency in indexing pipelines. Learn about concurrent updates, data exposure risks, and best practices for ensuring reliable, up-to-date indexes using CocoIndex's data-driven approach.
Data Indexing and Common Challenges
Explore the fundamentals of data indexing pipelines for RAG applications. Learn about key characteristics of effective indexing systems, common challenges in production, and how CocoIndex solves them. Discover best practices for building maintainable, cost-effective, and scalable data indexing infrastructure.
CocoIndex - A Data Indexing Platform for AI Applications
Discover how CocoIndex simplifies data indexing for AI applications. Learn about our comprehensive platform that handles data ingestion, processing, and management for RAG, semantic search, and other AI use cases.
Welcome to CocoIndex
Welcome to the official CocoIndex blog! We're excited to share our journey in building high-performance indexing infrastructure for AI applications.