Up to 70% increase in data throughput

Update to Chroma’s Python 1.0.13 and JavaScript 3.0.5 clients to see up to 70% increased throughput on collection.add, .update, and .upsert calls.

The clients communicate with Chroma via JSON over HTTP, so by changing the serialization format to encode vectors into base64, we were able to see payload sizes decrease by 45%. This, along with faster JSON deserialization, deliver up to 70% more throughput when inserting embeddings to Chroma Cloud.

The server supports both formats, and automatically detects the type by inspecting JSON fields, meaning previous clients continue to work and do not have to upgrade.

These changes are available now on Chroma Cloud. To take advantage on single-node Chroma, upgrade the server to 1.0.13 or newer.