# CocoIndex

> Ultra performant data transformation framework for AI, with core engine written in Rust. Support incremental processing and data lineage out-of-box.


## docs-v1

CocoIndex is an ultra-performant compute framework for AI workloads, with incremental processing.

- [Welcome to CocoIndex](/docs-v1/): CocoIndex is an ultra-performant compute framework for AI workloads, with incremental processing.

### about

- [Community](/docs-v1/about/community): Join the CocoIndex community

### advanced_topics

- [Custom Target Connector](/docs-v1/advanced_topics/custom_target_connector): Learn how to create custom target connectors to integrate CocoIndex with external systems.
- [Function Memoization Keys](/docs-v1/advanced_topics/memoization_keys): CocoIndex memoizes (caches) results using a stable, deterministic key derived from CocoIndex function call’s inputs.

### cli

CocoIndex CLI

- [CocoIndex CLI](/docs-v1/cli): CocoIndex CLI

### cli_commands

Subcommands reference

- [cli_commands](/docs-v1/cli_commands): Subcommands reference

### connectors

- [LanceDB](/docs-v1/connectors/lancedb): CocoIndex connector for writing to LanceDB tables.
- [Local File System](/docs-v1/connectors/localfs): CocoIndex connector for reading from and writing to the local file system.
- [Postgres](/docs-v1/connectors/postgres): CocoIndex connector for reading from and writing to PostgreSQL databases.
- [Qdrant](/docs-v1/connectors/qdrant): CocoIndex connector for reading from and writing to Qdrant vector databases.
- [SQLite](/docs-v1/connectors/sqlite): CocoIndex connector for writing to SQLite databases with optional vector support via sqlite-vec.

### contributing

- [Contributing Guide](/docs-v1/contributing/guide): How to contribute to CocoIndex
- [Setup Development Environment](/docs-v1/contributing/setup_dev_environment): Learn how to setup your development environment to develop CocoIndex

### getting_started

- [Installation](/docs-v1/getting_started/installation): Setup the CocoIndex environment in 0-3 min
- [Quickstart](/docs-v1/getting_started/quickstart): Get started with CocoIndex in 5 minutes

### programming_guide

- [App](/docs-v1/programming_guide/app): Understanding Apps as the top-level runnable unit, including creation, running, and environment lifecycle.
- [Context](/docs-v1/programming_guide/context): Sharing resources across your pipeline using ContextKey, builder.provide(), and use_context().
- [Core Concepts](/docs-v1/programming_guide/core_concepts): Briefly introduces the core concepts of CocoIndex, covering state-driven sync, Target States, Apps, Processing Components, and incremental execution across data and code changes.
- [Function](/docs-v1/programming_guide/function): Understanding the @coco.function decorator, its capabilities like memoization and change tracking.
- [Processing Component](/docs-v1/programming_guide/processing_component): Understanding processing components as the sync boundaries for target states, including mounting APIs.
- [SDK Overview](/docs-v1/programming_guide/sdk_overview): Overview of the CocoIndex Python SDK package organization, common types like StableKey, sync vs async APIs, and how to mix sync/async across processing components.
- [Target State](/docs-v1/programming_guide/target_state): Understanding target states as what you want to exist in external systems and how to declare them.

### resource_types

Common data types for files shared across CocoIndex connectors and utilities.

- [Resource Types](/docs-v1/resource_types): Common data types for files shared across CocoIndex connectors and utilities.

### search

Official documentation for CocoIndex - Learn how to use CocoIndex to build robust data indexing pipelines for AI applications. Comprehensive guides, API references, and best practices for implementing efficient data processing workflows.

- [Search the documentation](/docs-v1/search): Official documentation for CocoIndex - Learn how to use CocoIndex to build robust data indexing pipelines for AI applications. Comprehensive guides, API references, and best practices for implementing efficient data processing workflows.

### utilities

CocoIndex provides extra utilities in the cocoindex.ops package for common data processing tasks.

- [Extra Utilities](/docs-v1/utilities): CocoIndex provides extra utilities in the cocoindex.ops package for common data processing tasks.
- [Sentence Transformers Integration](/docs-v1/utilities/sentence_transformers): The cocoindex.ops.sentence_transformers module provides integration with the sentence-transformers library for text embeddings.
- [Text Processing Utilities](/docs-v1/utilities/text): The cocoindex.ops.text module provides utilities for text processing, including:

## Optional
- [GitHub Repository](https://github.com/cocoindex-io/cocoindex): Source code, issues, and contributions
- [Discord Community](https://discord.com/invite/zpA9S2DR7s): Community support and discussions
- [CocoIndex Homepage](https://cocoindex.io): Main website with examples and blogs