embedcache

Use case

Local development & CI

Give every developer and CI job the same fast, offline embedder so tests are deterministic and do not burn API budget.

The problem

Wiring a hosted embedding API into local dev and CI means distributing keys, hitting rate limits in parallel test runs, and getting non-deterministic vectors.

How embedcache helps

  1. 1

    Run embedcache locally or as a CI service container — no API keys to inject.

  2. 2

    Pinned model weights make embeddings reproducible across machines and runs.

  3. 3

    Cache hits keep test suites fast; a warm cache.db means most inputs never re-embed.

  4. 4

    Use the crate directly in Rust integration tests to skip the network entirely.

Features involved