Chroma Server in Production#

Chroma has quickly become the leading retrieval system for developers building with AI. From the first week of our launch back in 2023, we've seen a steady stream of developers deploying Chroma in production.

Retrieval workloads for AI applications are continuously evolving, and we are committed to ensuring that Chroma is performant and reliable for your use-cases. Recently we've invested in characterizing Chroma's performance for common workloads, and have revamped our deployment guides to make it easier than ever to deploy Chroma in production.

We're also investing even more in directly supporting our production users. You can get direct support for your production deployments of Chroma server by filling out this form, and we will add you to a dedicated Slack workspace for supporting production users. We would love to help you think through the design of your system, or if you would be a good fit for our upcoming distributed cloud service.

Performance#

We recently conducted a series of representative stress tests and performance experiments to characterize Chroma's capabilities for your workloads, across a variety of hardware configurations.

We found that Chroma is cost-effective and performant across a variety of common use-cases and requirements. You can find the full report here.

There is always room to improve. Along with our extensive work on Chroma's first of its kind distributed data plane, we will be releasing a series of performance improvements over the coming months, so Chroma can scale with you.

Deployment#

To make it even easier to get started, we've revamped the Deployment section in our docs. There, you'll find updated guides for deploying Chroma on AWS, with GCP and Azure coming soon, as well as best practices for securing and monitoring your Chroma servers.

Our deployment scripts have also been updated and simplified.

We Want to Hear from You#

If you are building in production, fill out this form, and we will add you to a dedicated Slack workspace for supporting Chroma production users. We would love to help you think through the design of your system, or if you would be a good fit for our upcoming distributed cloud service.

Chroma Cloud#

If you'd prefer not to manage your own Chroma deployment, we're giving select individuals and organizations early access Chroma's fully-managed serverless cloud. If your workload is a good fit for Chroma, we'd love to hear from you. Please reach out to us at hello@trychroma.com.