Vector index matrix sweep

84 benchmark runs, one per (engine × corpus size × cache budget), each in its own process so its memory numbers are its own. Generated 2026-08-18 01:50.

Vectors (X axis)500, 1,000, 10,000, 50,000, 100,000, 500,000, 1,000,000
Cache budgets10 MB, 100 MB, 500 MB, 2000 MB
EnginesMemory, IVS, HNSW
Dimensions1536
Vector distribution200 cluster centers, noise 1
State save every5,000 vectors
IVS accuracy0.25 of clusters probed per search
HNSW dialsm 16, efConstruction 128, efSearch 64
Search phasesmeasured

Summary

Engine Indexing
▲ more is more stars
Memory use
▼ less is more stars
Search
▲ more is more stars
Memory ★★★★★56.75k inserts/s ★★☆☆☆164.4 MB ★★★☆☆266.3 queries/s
IVS ★★★★★32.23k inserts/s ★★★★★6.56 MB ★★★☆☆202.9 queries/s
HNSW ★★★★☆10.37k inserts/s ★★☆☆☆174.7 MB ★★★★★2.27k queries/s

More stars is better in every column: five stars goes to the best engine in it — the fastest, or the one holding the least memory — and every factor of ten behind that costs two stars, down to one. The number beside the stars is the geometric mean over that engine's runs (indexing: vectors indexed per second, including the state save; memory use: managed heap held after the load, so fewer MB earns more stars; search: Top10 queries per second), which is the average that suits values differing by factors. A verdict this compact hides the trade the charts below show: read them together.

Engines

EngineWhat it is
Memoryall vectors on the managed heap, every search an exact SIMD scan (Relatude.DB.DataStoreLocal)
IVSdisk segments, IVF clusters, cached blocks; searches the nearest clusters only (Relatude.DB.VectorIndex)
HNSWthe HNSW graph resident in flat int8 arenas, floats mirrored or read only to re-score (Relatude.DB.VectorIndex)

How to read the charts

One chart per measurement. The X axis is the number of vectors indexed, the Y axis the measurement's own unit. Each line is one engine at one cache budget: colour is the engine, dash pattern is the cache budget — the tightest dashes are the smallest budget, a solid line the largest. Hover any point for its exact value.

engineMemoryIVSHNSW
cache10 MB100 MB500 MB2000 MB

Every chart says under its title whether higher or lower is better, and the Y axes are logarithmic except for the percentages — the engines sit orders of magnitude apart, so on these axes an equal distance is an equal factor. A missing point is a failed or unsupported run, never a zero. The in-memory index has no cache budget to spend, so its dashed variants lie on top of each other by design: it is the reference the others are read against.

Writes

Index

inserts/s · ▲ higher is better · log scale

1k 10k 100k 1M 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 34.51k inserts/sMemory, 10 MB cache @ 1,000 vectors: 37.88k inserts/sMemory, 10 MB cache @ 10,000 vectors: 45k inserts/sMemory, 10 MB cache @ 50,000 vectors: 61.75k inserts/sMemory, 10 MB cache @ 100,000 vectors: 73.6k inserts/sMemory, 10 MB cache @ 500,000 vectors: 81.23k inserts/sMemory, 10 MB cache @ 1,000,000 vectors: 80.6k inserts/s Memory, 100 MB cache @ 500 vectors: 34.92k inserts/sMemory, 100 MB cache @ 1,000 vectors: 39.92k inserts/sMemory, 100 MB cache @ 10,000 vectors: 45.34k inserts/sMemory, 100 MB cache @ 50,000 vectors: 62.24k inserts/sMemory, 100 MB cache @ 100,000 vectors: 73.92k inserts/sMemory, 100 MB cache @ 500,000 vectors: 80.96k inserts/sMemory, 100 MB cache @ 1,000,000 vectors: 80.41k inserts/s Memory, 500 MB cache @ 500 vectors: 36.03k inserts/sMemory, 500 MB cache @ 1,000 vectors: 39.83k inserts/sMemory, 500 MB cache @ 10,000 vectors: 47.68k inserts/sMemory, 500 MB cache @ 50,000 vectors: 62.01k inserts/sMemory, 500 MB cache @ 100,000 vectors: 73.59k inserts/sMemory, 500 MB cache @ 500,000 vectors: 80.78k inserts/sMemory, 500 MB cache @ 1,000,000 vectors: 80.07k inserts/s Memory, 2000 MB cache @ 500 vectors: 34.71k inserts/sMemory, 2000 MB cache @ 1,000 vectors: 38.27k inserts/sMemory, 2000 MB cache @ 10,000 vectors: 47.97k inserts/sMemory, 2000 MB cache @ 50,000 vectors: 61.67k inserts/sMemory, 2000 MB cache @ 100,000 vectors: 74.92k inserts/sMemory, 2000 MB cache @ 500,000 vectors: 81.09k inserts/sMemory, 2000 MB cache @ 1,000,000 vectors: 80.77k inserts/s IVS, 10 MB cache @ 500 vectors: 27.72k inserts/sIVS, 10 MB cache @ 1,000 vectors: 42.89k inserts/sIVS, 10 MB cache @ 10,000 vectors: 136.08k inserts/sIVS, 10 MB cache @ 50,000 vectors: 27.01k inserts/sIVS, 10 MB cache @ 100,000 vectors: 28.89k inserts/sIVS, 10 MB cache @ 500,000 vectors: 24.08k inserts/sIVS, 10 MB cache @ 1,000,000 vectors: 13.55k inserts/s IVS, 100 MB cache @ 500 vectors: 23.94k inserts/sIVS, 100 MB cache @ 1,000 vectors: 39.37k inserts/sIVS, 100 MB cache @ 10,000 vectors: 131.14k inserts/sIVS, 100 MB cache @ 50,000 vectors: 27.99k inserts/sIVS, 100 MB cache @ 100,000 vectors: 19.45k inserts/sIVS, 100 MB cache @ 500,000 vectors: 24.31k inserts/sIVS, 100 MB cache @ 1,000,000 vectors: 15.29k inserts/s IVS, 500 MB cache @ 500 vectors: 23.86k inserts/sIVS, 500 MB cache @ 1,000 vectors: 44.66k inserts/sIVS, 500 MB cache @ 10,000 vectors: 117.49k inserts/sIVS, 500 MB cache @ 50,000 vectors: 30.87k inserts/sIVS, 500 MB cache @ 100,000 vectors: 29.29k inserts/sIVS, 500 MB cache @ 500,000 vectors: 24.44k inserts/sIVS, 500 MB cache @ 1,000,000 vectors: 15.67k inserts/s IVS, 2000 MB cache @ 500 vectors: 25.68k inserts/sIVS, 2000 MB cache @ 1,000 vectors: 45.41k inserts/sIVS, 2000 MB cache @ 10,000 vectors: 119.07k inserts/sIVS, 2000 MB cache @ 50,000 vectors: 33.43k inserts/sIVS, 2000 MB cache @ 100,000 vectors: 29.06k inserts/sIVS, 2000 MB cache @ 500,000 vectors: 24.68k inserts/sIVS, 2000 MB cache @ 1,000,000 vectors: 11.46k inserts/s HNSW, 10 MB cache @ 500 vectors: 7.36k inserts/sHNSW, 10 MB cache @ 1,000 vectors: 7.95k inserts/sHNSW, 10 MB cache @ 10,000 vectors: 7.81k inserts/sHNSW, 10 MB cache @ 50,000 vectors: 12.25k inserts/sHNSW, 10 MB cache @ 100,000 vectors: 12.52k inserts/sHNSW, 10 MB cache @ 500,000 vectors: 9.42k inserts/sHNSW, 10 MB cache @ 1,000,000 vectors: 8.1k inserts/s HNSW, 100 MB cache @ 500 vectors: 7.04k inserts/sHNSW, 100 MB cache @ 1,000 vectors: 8.76k inserts/sHNSW, 100 MB cache @ 10,000 vectors: 11.03k inserts/sHNSW, 100 MB cache @ 50,000 vectors: 14.42k inserts/sHNSW, 100 MB cache @ 100,000 vectors: 15.36k inserts/sHNSW, 100 MB cache @ 500,000 vectors: 11.08k inserts/sHNSW, 100 MB cache @ 1,000,000 vectors: 9.5k inserts/s HNSW, 500 MB cache @ 500 vectors: 7.26k inserts/sHNSW, 500 MB cache @ 1,000 vectors: 9.52k inserts/sHNSW, 500 MB cache @ 10,000 vectors: 10.13k inserts/sHNSW, 500 MB cache @ 50,000 vectors: 15.87k inserts/sHNSW, 500 MB cache @ 100,000 vectors: 15.49k inserts/sHNSW, 500 MB cache @ 500,000 vectors: 11.35k inserts/sHNSW, 500 MB cache @ 1,000,000 vectors: 9.65k inserts/s HNSW, 2000 MB cache @ 500 vectors: 7.29k inserts/sHNSW, 2000 MB cache @ 1,000 vectors: 9.53k inserts/sHNSW, 2000 MB cache @ 10,000 vectors: 9.51k inserts/sHNSW, 2000 MB cache @ 50,000 vectors: 15.5k inserts/sHNSW, 2000 MB cache @ 100,000 vectors: 15.63k inserts/sHNSW, 2000 MB cache @ 500,000 vectors: 11.37k inserts/sHNSW, 2000 MB cache @ 1,000,000 vectors: 9.54k inserts/s

Update

updates/s · ▲ higher is better · log scale

1k 10k 100k 1M 10M 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 1.42M updates/sMemory, 10 MB cache @ 1,000 vectors: 1.39M updates/sMemory, 10 MB cache @ 10,000 vectors: 1.4M updates/sMemory, 10 MB cache @ 50,000 vectors: 915.16k updates/sMemory, 10 MB cache @ 100,000 vectors: 904.08k updates/sMemory, 10 MB cache @ 500,000 vectors: 1.14M updates/sMemory, 10 MB cache @ 1,000,000 vectors: 1.1M updates/s Memory, 100 MB cache @ 500 vectors: 1.47M updates/sMemory, 100 MB cache @ 1,000 vectors: 1.46M updates/sMemory, 100 MB cache @ 10,000 vectors: 1.44M updates/sMemory, 100 MB cache @ 50,000 vectors: 812.71k updates/sMemory, 100 MB cache @ 100,000 vectors: 901.92k updates/sMemory, 100 MB cache @ 500,000 vectors: 1.29M updates/sMemory, 100 MB cache @ 1,000,000 vectors: 1.1M updates/s Memory, 500 MB cache @ 500 vectors: 1.39M updates/sMemory, 500 MB cache @ 1,000 vectors: 1.51M updates/sMemory, 500 MB cache @ 10,000 vectors: 1.4M updates/sMemory, 500 MB cache @ 50,000 vectors: 873.32k updates/sMemory, 500 MB cache @ 100,000 vectors: 1.14M updates/sMemory, 500 MB cache @ 500,000 vectors: 1.35M updates/sMemory, 500 MB cache @ 1,000,000 vectors: 1.18M updates/s Memory, 2000 MB cache @ 500 vectors: 1.49M updates/sMemory, 2000 MB cache @ 1,000 vectors: 1.33M updates/sMemory, 2000 MB cache @ 10,000 vectors: 1.39M updates/sMemory, 2000 MB cache @ 50,000 vectors: 907.65k updates/sMemory, 2000 MB cache @ 100,000 vectors: 1.38M updates/sMemory, 2000 MB cache @ 500,000 vectors: 1.1M updates/sMemory, 2000 MB cache @ 1,000,000 vectors: 1.1M updates/s IVS, 10 MB cache @ 500 vectors: 1.28M updates/sIVS, 10 MB cache @ 1,000 vectors: 914.49k updates/sIVS, 10 MB cache @ 10,000 vectors: 481.15k updates/sIVS, 10 MB cache @ 50,000 vectors: 1M updates/sIVS, 10 MB cache @ 100,000 vectors: 1.02M updates/sIVS, 10 MB cache @ 500,000 vectors: 1.35M updates/sIVS, 10 MB cache @ 1,000,000 vectors: 882.18k updates/s IVS, 100 MB cache @ 500 vectors: 973.14k updates/sIVS, 100 MB cache @ 1,000 vectors: 1.04M updates/sIVS, 100 MB cache @ 10,000 vectors: 1.31M updates/sIVS, 100 MB cache @ 50,000 vectors: 875.47k updates/sIVS, 100 MB cache @ 100,000 vectors: 952.11k updates/sIVS, 100 MB cache @ 500,000 vectors: 1.1M updates/sIVS, 100 MB cache @ 1,000,000 vectors: 1.22M updates/s IVS, 500 MB cache @ 500 vectors: 1.32M updates/sIVS, 500 MB cache @ 1,000 vectors: 1.28M updates/sIVS, 500 MB cache @ 10,000 vectors: 1.23M updates/sIVS, 500 MB cache @ 50,000 vectors: 1.36M updates/sIVS, 500 MB cache @ 100,000 vectors: 1.25M updates/sIVS, 500 MB cache @ 500,000 vectors: 1.29M updates/sIVS, 500 MB cache @ 1,000,000 vectors: 1M updates/s IVS, 2000 MB cache @ 500 vectors: 1.37M updates/sIVS, 2000 MB cache @ 1,000 vectors: 1.21M updates/sIVS, 2000 MB cache @ 10,000 vectors: 1.39M updates/sIVS, 2000 MB cache @ 50,000 vectors: 1.28M updates/sIVS, 2000 MB cache @ 100,000 vectors: 1.41M updates/sIVS, 2000 MB cache @ 500,000 vectors: 1.3M updates/sIVS, 2000 MB cache @ 1,000,000 vectors: 810.67k updates/s HNSW, 10 MB cache @ 500 vectors: 1.82k updates/sHNSW, 10 MB cache @ 1,000 vectors: 2.13k updates/sHNSW, 10 MB cache @ 10,000 vectors: 2.86k updates/sHNSW, 10 MB cache @ 50,000 vectors: 2.24k updates/sHNSW, 10 MB cache @ 100,000 vectors: 1.89k updates/sHNSW, 10 MB cache @ 500,000 vectors: 1.2k updates/sHNSW, 10 MB cache @ 1,000,000 vectors: 1.12k updates/s HNSW, 100 MB cache @ 500 vectors: 1.91k updates/sHNSW, 100 MB cache @ 1,000 vectors: 2.18k updates/sHNSW, 100 MB cache @ 10,000 vectors: 2.96k updates/sHNSW, 100 MB cache @ 50,000 vectors: 2.4k updates/sHNSW, 100 MB cache @ 100,000 vectors: 1.89k updates/sHNSW, 100 MB cache @ 500,000 vectors: 1.2k updates/sHNSW, 100 MB cache @ 1,000,000 vectors: 1.13k updates/s HNSW, 500 MB cache @ 500 vectors: 1.87k updates/sHNSW, 500 MB cache @ 1,000 vectors: 2.17k updates/sHNSW, 500 MB cache @ 10,000 vectors: 2.96k updates/sHNSW, 500 MB cache @ 50,000 vectors: 2.41k updates/sHNSW, 500 MB cache @ 100,000 vectors: 1.9k updates/sHNSW, 500 MB cache @ 500,000 vectors: 1.21k updates/sHNSW, 500 MB cache @ 1,000,000 vectors: 1.13k updates/s HNSW, 2000 MB cache @ 500 vectors: 1.88k updates/sHNSW, 2000 MB cache @ 1,000 vectors: 2.12k updates/sHNSW, 2000 MB cache @ 10,000 vectors: 2.94k updates/sHNSW, 2000 MB cache @ 50,000 vectors: 2.4k updates/sHNSW, 2000 MB cache @ 100,000 vectors: 1.91k updates/sHNSW, 2000 MB cache @ 500,000 vectors: 1.21k updates/sHNSW, 2000 MB cache @ 1,000,000 vectors: 1.08k updates/s

Remove

removes/s · ▲ higher is better · log scale

1M 10M 100M 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 26.46M removes/sMemory, 10 MB cache @ 1,000 vectors: 32.47M removes/sMemory, 10 MB cache @ 10,000 vectors: 45.25M removes/sMemory, 10 MB cache @ 50,000 vectors: 18.76M removes/sMemory, 10 MB cache @ 100,000 vectors: 14.98M removes/sMemory, 10 MB cache @ 500,000 vectors: 15.75M removes/sMemory, 10 MB cache @ 1,000,000 vectors: 14.37M removes/s Memory, 100 MB cache @ 500 vectors: 33.78M removes/sMemory, 100 MB cache @ 1,000 vectors: 33.56M removes/sMemory, 100 MB cache @ 10,000 vectors: 45.35M removes/sMemory, 100 MB cache @ 50,000 vectors: 18.08M removes/sMemory, 100 MB cache @ 100,000 vectors: 14.81M removes/sMemory, 100 MB cache @ 500,000 vectors: 15.38M removes/sMemory, 100 MB cache @ 1,000,000 vectors: 14.27M removes/s Memory, 500 MB cache @ 500 vectors: 30.3M removes/sMemory, 500 MB cache @ 1,000 vectors: 31.85M removes/sMemory, 500 MB cache @ 10,000 vectors: 44.64M removes/sMemory, 500 MB cache @ 50,000 vectors: 18.99M removes/sMemory, 500 MB cache @ 100,000 vectors: 18.83M removes/sMemory, 500 MB cache @ 500,000 vectors: 15.07M removes/sMemory, 500 MB cache @ 1,000,000 vectors: 14.15M removes/s Memory, 2000 MB cache @ 500 vectors: 34.01M removes/sMemory, 2000 MB cache @ 1,000 vectors: 31.75M removes/sMemory, 2000 MB cache @ 10,000 vectors: 47.51M removes/sMemory, 2000 MB cache @ 50,000 vectors: 18.62M removes/sMemory, 2000 MB cache @ 100,000 vectors: 18.05M removes/sMemory, 2000 MB cache @ 500,000 vectors: 14.99M removes/sMemory, 2000 MB cache @ 1,000,000 vectors: 14.62M removes/s IVS, 10 MB cache @ 500 vectors: 9.31M removes/sIVS, 10 MB cache @ 1,000 vectors: 15.22M removes/sIVS, 10 MB cache @ 10,000 vectors: 15M removes/sIVS, 10 MB cache @ 50,000 vectors: 13.09M removes/sIVS, 10 MB cache @ 100,000 vectors: 8.52M removes/sIVS, 10 MB cache @ 500,000 vectors: 7.97M removes/sIVS, 10 MB cache @ 1,000,000 vectors: 7.42M removes/s IVS, 100 MB cache @ 500 vectors: 13.12M removes/sIVS, 100 MB cache @ 1,000 vectors: 16.37M removes/sIVS, 100 MB cache @ 10,000 vectors: 17.29M removes/sIVS, 100 MB cache @ 50,000 vectors: 9.53M removes/sIVS, 100 MB cache @ 100,000 vectors: 10.19M removes/sIVS, 100 MB cache @ 500,000 vectors: 7.83M removes/sIVS, 100 MB cache @ 1,000,000 vectors: 7.74M removes/s IVS, 500 MB cache @ 500 vectors: 12.47M removes/sIVS, 500 MB cache @ 1,000 vectors: 16.21M removes/sIVS, 500 MB cache @ 10,000 vectors: 16.86M removes/sIVS, 500 MB cache @ 50,000 vectors: 13.41M removes/sIVS, 500 MB cache @ 100,000 vectors: 11.22M removes/sIVS, 500 MB cache @ 500,000 vectors: 7.38M removes/sIVS, 500 MB cache @ 1,000,000 vectors: 6.39M removes/s IVS, 2000 MB cache @ 500 vectors: 12.79M removes/sIVS, 2000 MB cache @ 1,000 vectors: 16.26M removes/sIVS, 2000 MB cache @ 10,000 vectors: 18.25M removes/sIVS, 2000 MB cache @ 50,000 vectors: 12.43M removes/sIVS, 2000 MB cache @ 100,000 vectors: 11.76M removes/sIVS, 2000 MB cache @ 500,000 vectors: 7.95M removes/sIVS, 2000 MB cache @ 1,000,000 vectors: 6.92M removes/s HNSW, 10 MB cache @ 500 vectors: 7.75M removes/sHNSW, 10 MB cache @ 1,000 vectors: 5.74M removes/sHNSW, 10 MB cache @ 10,000 vectors: 2.94M removes/sHNSW, 10 MB cache @ 50,000 vectors: 5.84M removes/sHNSW, 10 MB cache @ 100,000 vectors: 4.95M removes/sHNSW, 10 MB cache @ 500,000 vectors: 3.23M removes/sHNSW, 10 MB cache @ 1,000,000 vectors: 3.84M removes/s HNSW, 100 MB cache @ 500 vectors: 21.1M removes/sHNSW, 100 MB cache @ 1,000 vectors: 7.75M removes/sHNSW, 100 MB cache @ 10,000 vectors: 2.75M removes/sHNSW, 100 MB cache @ 50,000 vectors: 4.92M removes/sHNSW, 100 MB cache @ 100,000 vectors: 4.88M removes/sHNSW, 100 MB cache @ 500,000 vectors: 4.21M removes/sHNSW, 100 MB cache @ 1,000,000 vectors: 3.65M removes/s HNSW, 500 MB cache @ 500 vectors: 20.33M removes/sHNSW, 500 MB cache @ 1,000 vectors: 7.67M removes/sHNSW, 500 MB cache @ 10,000 vectors: 3.16M removes/sHNSW, 500 MB cache @ 50,000 vectors: 5.57M removes/sHNSW, 500 MB cache @ 100,000 vectors: 4.92M removes/sHNSW, 500 MB cache @ 500,000 vectors: 3.44M removes/sHNSW, 500 MB cache @ 1,000,000 vectors: 3.81M removes/s HNSW, 2000 MB cache @ 500 vectors: 19.92M removes/sHNSW, 2000 MB cache @ 1,000 vectors: 10.02M removes/sHNSW, 2000 MB cache @ 10,000 vectors: 2.66M removes/sHNSW, 2000 MB cache @ 50,000 vectors: 5.72M removes/sHNSW, 2000 MB cache @ 100,000 vectors: 5.06M removes/sHNSW, 2000 MB cache @ 500,000 vectors: 3.85M removes/sHNSW, 2000 MB cache @ 1,000,000 vectors: 4M removes/s

Mixed

ops/s · ▲ higher is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 16.14k ops/sMemory, 10 MB cache @ 1,000 vectors: 13.56k ops/sMemory, 10 MB cache @ 10,000 vectors: 2.15k ops/sMemory, 10 MB cache @ 50,000 vectors: 361.3 ops/sMemory, 10 MB cache @ 100,000 vectors: 184.2 ops/sMemory, 10 MB cache @ 500,000 vectors: 37.4 ops/sMemory, 10 MB cache @ 1,000,000 vectors: 19 ops/s Memory, 100 MB cache @ 500 vectors: 16.17k ops/sMemory, 100 MB cache @ 1,000 vectors: 13.61k ops/sMemory, 100 MB cache @ 10,000 vectors: 2.17k ops/sMemory, 100 MB cache @ 50,000 vectors: 359.8 ops/sMemory, 100 MB cache @ 100,000 vectors: 183.9 ops/sMemory, 100 MB cache @ 500,000 vectors: 37.9 ops/sMemory, 100 MB cache @ 1,000,000 vectors: 19.3 ops/s Memory, 500 MB cache @ 500 vectors: 16.38k ops/sMemory, 500 MB cache @ 1,000 vectors: 13.44k ops/sMemory, 500 MB cache @ 10,000 vectors: 2.17k ops/sMemory, 500 MB cache @ 50,000 vectors: 362.3 ops/sMemory, 500 MB cache @ 100,000 vectors: 185.5 ops/sMemory, 500 MB cache @ 500,000 vectors: 37.5 ops/sMemory, 500 MB cache @ 1,000,000 vectors: 19.3 ops/s Memory, 2000 MB cache @ 500 vectors: 16.18k ops/sMemory, 2000 MB cache @ 1,000 vectors: 13.19k ops/sMemory, 2000 MB cache @ 10,000 vectors: 2.15k ops/sMemory, 2000 MB cache @ 50,000 vectors: 361.5 ops/sMemory, 2000 MB cache @ 100,000 vectors: 186.6 ops/sMemory, 2000 MB cache @ 500,000 vectors: 37.9 ops/sMemory, 2000 MB cache @ 1,000,000 vectors: 19.3 ops/s IVS, 10 MB cache @ 500 vectors: 11.76k ops/sIVS, 10 MB cache @ 1,000 vectors: 7.47k ops/sIVS, 10 MB cache @ 10,000 vectors: 124 ops/sIVS, 10 MB cache @ 50,000 vectors: 104.3 ops/sIVS, 10 MB cache @ 100,000 vectors: 57.2 ops/sIVS, 10 MB cache @ 500,000 vectors: 11.6 ops/sIVS, 10 MB cache @ 1,000,000 vectors: 5.27 ops/s IVS, 100 MB cache @ 500 vectors: 11.78k ops/sIVS, 100 MB cache @ 1,000 vectors: 8.02k ops/sIVS, 100 MB cache @ 10,000 vectors: 904.7 ops/sIVS, 100 MB cache @ 50,000 vectors: 145 ops/sIVS, 100 MB cache @ 100,000 vectors: 66.2 ops/sIVS, 100 MB cache @ 500,000 vectors: 11.7 ops/sIVS, 100 MB cache @ 1,000,000 vectors: 5.74 ops/s IVS, 500 MB cache @ 500 vectors: 11.35k ops/sIVS, 500 MB cache @ 1,000 vectors: 7.72k ops/sIVS, 500 MB cache @ 10,000 vectors: 908.9 ops/sIVS, 500 MB cache @ 50,000 vectors: 862.7 ops/sIVS, 500 MB cache @ 100,000 vectors: 231.3 ops/sIVS, 500 MB cache @ 500,000 vectors: 13.3 ops/sIVS, 500 MB cache @ 1,000,000 vectors: 6.08 ops/s IVS, 2000 MB cache @ 500 vectors: 12.04k ops/sIVS, 2000 MB cache @ 1,000 vectors: 8.09k ops/sIVS, 2000 MB cache @ 10,000 vectors: 895.3 ops/sIVS, 2000 MB cache @ 50,000 vectors: 861.3 ops/sIVS, 2000 MB cache @ 100,000 vectors: 552.9 ops/sIVS, 2000 MB cache @ 500,000 vectors: 29.7 ops/sIVS, 2000 MB cache @ 1,000,000 vectors: 7.79 ops/s HNSW, 10 MB cache @ 500 vectors: 1.18k ops/sHNSW, 10 MB cache @ 1,000 vectors: 690.7 ops/sHNSW, 10 MB cache @ 10,000 vectors: 1.63k ops/sHNSW, 10 MB cache @ 50,000 vectors: 1.57k ops/sHNSW, 10 MB cache @ 100,000 vectors: 1.45k ops/sHNSW, 10 MB cache @ 500,000 vectors: 1.08k ops/sHNSW, 10 MB cache @ 1,000,000 vectors: 993.8 ops/s HNSW, 100 MB cache @ 500 vectors: 4.71k ops/sHNSW, 100 MB cache @ 1,000 vectors: 6.18k ops/sHNSW, 100 MB cache @ 10,000 vectors: 1.75k ops/sHNSW, 100 MB cache @ 50,000 vectors: 1.6k ops/sHNSW, 100 MB cache @ 100,000 vectors: 1.44k ops/sHNSW, 100 MB cache @ 500,000 vectors: 1.08k ops/sHNSW, 100 MB cache @ 1,000,000 vectors: 981.9 ops/s HNSW, 500 MB cache @ 500 vectors: 4.72k ops/sHNSW, 500 MB cache @ 1,000 vectors: 6.09k ops/sHNSW, 500 MB cache @ 10,000 vectors: 5.75k ops/sHNSW, 500 MB cache @ 50,000 vectors: 5.22k ops/sHNSW, 500 MB cache @ 100,000 vectors: 1.48k ops/sHNSW, 500 MB cache @ 500,000 vectors: 1.08k ops/sHNSW, 500 MB cache @ 1,000,000 vectors: 981.2 ops/s HNSW, 2000 MB cache @ 500 vectors: 4.63k ops/sHNSW, 2000 MB cache @ 1,000 vectors: 5.98k ops/sHNSW, 2000 MB cache @ 10,000 vectors: 5.63k ops/sHNSW, 2000 MB cache @ 50,000 vectors: 5.21k ops/sHNSW, 2000 MB cache @ 100,000 vectors: 3.99k ops/sHNSW, 2000 MB cache @ 500,000 vectors: 1.07k ops/sHNSW, 2000 MB cache @ 1,000,000 vectors: 969 ops/s

Searches

Top10

queries/s · ▲ higher is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 4.68k queries/sMemory, 10 MB cache @ 1,000 vectors: 1.69k queries/sMemory, 10 MB cache @ 10,000 vectors: 1.27k queries/sMemory, 10 MB cache @ 50,000 vectors: 220.3 queries/sMemory, 10 MB cache @ 100,000 vectors: 111.1 queries/sMemory, 10 MB cache @ 500,000 vectors: 22.6 queries/sMemory, 10 MB cache @ 1,000,000 vectors: 11.4 queries/s Memory, 100 MB cache @ 500 vectors: 2.38k queries/sMemory, 100 MB cache @ 1,000 vectors: 4.09k queries/sMemory, 100 MB cache @ 10,000 vectors: 1.23k queries/sMemory, 100 MB cache @ 50,000 vectors: 221.9 queries/sMemory, 100 MB cache @ 100,000 vectors: 111.7 queries/sMemory, 100 MB cache @ 500,000 vectors: 23 queries/sMemory, 100 MB cache @ 1,000,000 vectors: 10.9 queries/s Memory, 500 MB cache @ 500 vectors: 9.68k queries/sMemory, 500 MB cache @ 1,000 vectors: 3.17k queries/sMemory, 500 MB cache @ 10,000 vectors: 1.17k queries/sMemory, 500 MB cache @ 50,000 vectors: 221.7 queries/sMemory, 500 MB cache @ 100,000 vectors: 112.8 queries/sMemory, 500 MB cache @ 500,000 vectors: 22.9 queries/sMemory, 500 MB cache @ 1,000,000 vectors: 11.4 queries/s Memory, 2000 MB cache @ 500 vectors: 2.22k queries/sMemory, 2000 MB cache @ 1,000 vectors: 4.21k queries/sMemory, 2000 MB cache @ 10,000 vectors: 1.2k queries/sMemory, 2000 MB cache @ 50,000 vectors: 219.3 queries/sMemory, 2000 MB cache @ 100,000 vectors: 113.3 queries/sMemory, 2000 MB cache @ 500,000 vectors: 23 queries/sMemory, 2000 MB cache @ 1,000,000 vectors: 11.4 queries/s IVS, 10 MB cache @ 500 vectors: 8.21k queries/sIVS, 10 MB cache @ 1,000 vectors: 5.13k queries/sIVS, 10 MB cache @ 10,000 vectors: 75.9 queries/sIVS, 10 MB cache @ 50,000 vectors: 64.2 queries/sIVS, 10 MB cache @ 100,000 vectors: 34.8 queries/sIVS, 10 MB cache @ 500,000 vectors: 7.03 queries/sIVS, 10 MB cache @ 1,000,000 vectors: 3.4 queries/s IVS, 100 MB cache @ 500 vectors: 8.71k queries/sIVS, 100 MB cache @ 1,000 vectors: 5.48k queries/sIVS, 100 MB cache @ 10,000 vectors: 698.7 queries/sIVS, 100 MB cache @ 50,000 vectors: 91.8 queries/sIVS, 100 MB cache @ 100,000 vectors: 40.4 queries/sIVS, 100 MB cache @ 500,000 vectors: 7.07 queries/sIVS, 100 MB cache @ 1,000,000 vectors: 3.51 queries/s IVS, 500 MB cache @ 500 vectors: 8.42k queries/sIVS, 500 MB cache @ 1,000 vectors: 5.7k queries/sIVS, 500 MB cache @ 10,000 vectors: 699.4 queries/sIVS, 500 MB cache @ 50,000 vectors: 715.3 queries/sIVS, 500 MB cache @ 100,000 vectors: 157.3 queries/sIVS, 500 MB cache @ 500,000 vectors: 7.6 queries/sIVS, 500 MB cache @ 1,000,000 vectors: 3.56 queries/s IVS, 2000 MB cache @ 500 vectors: 8.16k queries/sIVS, 2000 MB cache @ 1,000 vectors: 5.31k queries/sIVS, 2000 MB cache @ 10,000 vectors: 768.4 queries/sIVS, 2000 MB cache @ 50,000 vectors: 693.6 queries/sIVS, 2000 MB cache @ 100,000 vectors: 414.4 queries/sIVS, 2000 MB cache @ 500,000 vectors: 17.4 queries/sIVS, 2000 MB cache @ 1,000,000 vectors: 4.55 queries/s HNSW, 10 MB cache @ 500 vectors: 1.66k queries/sHNSW, 10 MB cache @ 1,000 vectors: 1.15k queries/sHNSW, 10 MB cache @ 10,000 vectors: 1.1k queries/sHNSW, 10 MB cache @ 50,000 vectors: 1.17k queries/sHNSW, 10 MB cache @ 100,000 vectors: 1.09k queries/sHNSW, 10 MB cache @ 500,000 vectors: 904.5 queries/sHNSW, 10 MB cache @ 1,000,000 vectors: 786 queries/s HNSW, 100 MB cache @ 500 vectors: 11.41k queries/sHNSW, 100 MB cache @ 1,000 vectors: 6.01k queries/sHNSW, 100 MB cache @ 10,000 vectors: 5.97k queries/sHNSW, 100 MB cache @ 50,000 vectors: 1.17k queries/sHNSW, 100 MB cache @ 100,000 vectors: 1.1k queries/sHNSW, 100 MB cache @ 500,000 vectors: 893.4 queries/sHNSW, 100 MB cache @ 1,000,000 vectors: 806.7 queries/s HNSW, 500 MB cache @ 500 vectors: 4.88k queries/sHNSW, 500 MB cache @ 1,000 vectors: 8.18k queries/sHNSW, 500 MB cache @ 10,000 vectors: 6.07k queries/sHNSW, 500 MB cache @ 50,000 vectors: 6.8k queries/sHNSW, 500 MB cache @ 100,000 vectors: 1.12k queries/sHNSW, 500 MB cache @ 500,000 vectors: 884.1 queries/sHNSW, 500 MB cache @ 1,000,000 vectors: 809.1 queries/s HNSW, 2000 MB cache @ 500 vectors: 11.71k queries/sHNSW, 2000 MB cache @ 1,000 vectors: 5.21k queries/sHNSW, 2000 MB cache @ 10,000 vectors: 6.18k queries/sHNSW, 2000 MB cache @ 50,000 vectors: 6.22k queries/sHNSW, 2000 MB cache @ 100,000 vectors: 6.05k queries/sHNSW, 2000 MB cache @ 500,000 vectors: 880.6 queries/sHNSW, 2000 MB cache @ 1,000,000 vectors: 779.5 queries/s

Top100

queries/s · ▲ higher is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 3.93k queries/sMemory, 10 MB cache @ 1,000 vectors: 7.15k queries/sMemory, 10 MB cache @ 10,000 vectors: 1.4k queries/sMemory, 10 MB cache @ 50,000 vectors: 220.8 queries/sMemory, 10 MB cache @ 100,000 vectors: 110.9 queries/sMemory, 10 MB cache @ 500,000 vectors: 22.6 queries/sMemory, 10 MB cache @ 1,000,000 vectors: 11.3 queries/s Memory, 100 MB cache @ 500 vectors: 8.51k queries/sMemory, 100 MB cache @ 1,000 vectors: 4.01k queries/sMemory, 100 MB cache @ 10,000 vectors: 1.4k queries/sMemory, 100 MB cache @ 50,000 vectors: 218.2 queries/sMemory, 100 MB cache @ 100,000 vectors: 111.2 queries/sMemory, 100 MB cache @ 500,000 vectors: 23 queries/sMemory, 100 MB cache @ 1,000,000 vectors: 11.3 queries/s Memory, 500 MB cache @ 500 vectors: 8.49k queries/sMemory, 500 MB cache @ 1,000 vectors: 4.74k queries/sMemory, 500 MB cache @ 10,000 vectors: 1.37k queries/sMemory, 500 MB cache @ 50,000 vectors: 217.2 queries/sMemory, 500 MB cache @ 100,000 vectors: 111.9 queries/sMemory, 500 MB cache @ 500,000 vectors: 23 queries/sMemory, 500 MB cache @ 1,000,000 vectors: 11.4 queries/s Memory, 2000 MB cache @ 500 vectors: 4.14k queries/sMemory, 2000 MB cache @ 1,000 vectors: 4.05k queries/sMemory, 2000 MB cache @ 10,000 vectors: 1.4k queries/sMemory, 2000 MB cache @ 50,000 vectors: 220.3 queries/sMemory, 2000 MB cache @ 100,000 vectors: 112.6 queries/sMemory, 2000 MB cache @ 500,000 vectors: 23 queries/sMemory, 2000 MB cache @ 1,000,000 vectors: 11.5 queries/s IVS, 10 MB cache @ 500 vectors: 9.25k queries/sIVS, 10 MB cache @ 1,000 vectors: 5.49k queries/sIVS, 10 MB cache @ 10,000 vectors: 76 queries/sIVS, 10 MB cache @ 50,000 vectors: 65.2 queries/sIVS, 10 MB cache @ 100,000 vectors: 34.8 queries/sIVS, 10 MB cache @ 500,000 vectors: 7.03 queries/sIVS, 10 MB cache @ 1,000,000 vectors: 3.33 queries/s IVS, 100 MB cache @ 500 vectors: 10.11k queries/sIVS, 100 MB cache @ 1,000 vectors: 4.94k queries/sIVS, 100 MB cache @ 10,000 vectors: 784.2 queries/sIVS, 100 MB cache @ 50,000 vectors: 88.1 queries/sIVS, 100 MB cache @ 100,000 vectors: 39.8 queries/sIVS, 100 MB cache @ 500,000 vectors: 7.05 queries/sIVS, 100 MB cache @ 1,000,000 vectors: 3.49 queries/s IVS, 500 MB cache @ 500 vectors: 8.93k queries/sIVS, 500 MB cache @ 1,000 vectors: 5.66k queries/sIVS, 500 MB cache @ 10,000 vectors: 814.3 queries/sIVS, 500 MB cache @ 50,000 vectors: 796.7 queries/sIVS, 500 MB cache @ 100,000 vectors: 157.1 queries/sIVS, 500 MB cache @ 500,000 vectors: 7.8 queries/sIVS, 500 MB cache @ 1,000,000 vectors: 3.56 queries/s IVS, 2000 MB cache @ 500 vectors: 10.2k queries/sIVS, 2000 MB cache @ 1,000 vectors: 5.57k queries/sIVS, 2000 MB cache @ 10,000 vectors: 786.6 queries/sIVS, 2000 MB cache @ 50,000 vectors: 792.5 queries/sIVS, 2000 MB cache @ 100,000 vectors: 412 queries/sIVS, 2000 MB cache @ 500,000 vectors: 17.5 queries/sIVS, 2000 MB cache @ 1,000,000 vectors: 4.58 queries/s HNSW, 10 MB cache @ 500 vectors: 2.05k queries/sHNSW, 10 MB cache @ 1,000 vectors: 1.16k queries/sHNSW, 10 MB cache @ 10,000 vectors: 102.3 queries/sHNSW, 10 MB cache @ 50,000 vectors: 122.5 queries/sHNSW, 10 MB cache @ 100,000 vectors: 127.2 queries/sHNSW, 10 MB cache @ 500,000 vectors: 124.8 queries/sHNSW, 10 MB cache @ 1,000,000 vectors: 115.7 queries/s HNSW, 100 MB cache @ 500 vectors: 12.27k queries/sHNSW, 100 MB cache @ 1,000 vectors: 11.72k queries/sHNSW, 100 MB cache @ 10,000 vectors: 1.6k queries/sHNSW, 100 MB cache @ 50,000 vectors: 123.4 queries/sHNSW, 100 MB cache @ 100,000 vectors: 128 queries/sHNSW, 100 MB cache @ 500,000 vectors: 126 queries/sHNSW, 100 MB cache @ 1,000,000 vectors: 110.7 queries/s HNSW, 500 MB cache @ 500 vectors: 11.02k queries/sHNSW, 500 MB cache @ 1,000 vectors: 10.22k queries/sHNSW, 500 MB cache @ 10,000 vectors: 1.66k queries/sHNSW, 500 MB cache @ 50,000 vectors: 696.6 queries/sHNSW, 500 MB cache @ 100,000 vectors: 126.8 queries/sHNSW, 500 MB cache @ 500,000 vectors: 124.7 queries/sHNSW, 500 MB cache @ 1,000,000 vectors: 114.8 queries/s HNSW, 2000 MB cache @ 500 vectors: 10.48k queries/sHNSW, 2000 MB cache @ 1,000 vectors: 11.66k queries/sHNSW, 2000 MB cache @ 10,000 vectors: 1.62k queries/sHNSW, 2000 MB cache @ 50,000 vectors: 693.3 queries/sHNSW, 2000 MB cache @ 100,000 vectors: 771.7 queries/sHNSW, 2000 MB cache @ 500,000 vectors: 125.6 queries/sHNSW, 2000 MB cache @ 1,000,000 vectors: 109.4 queries/s

NoFloor

queries/s · ▲ higher is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 13.16k queries/sMemory, 10 MB cache @ 1,000 vectors: 9.23k queries/sMemory, 10 MB cache @ 10,000 vectors: 1.27k queries/sMemory, 10 MB cache @ 50,000 vectors: 217.2 queries/sMemory, 10 MB cache @ 100,000 vectors: 109.6 queries/sMemory, 10 MB cache @ 500,000 vectors: 22.4 queries/sMemory, 10 MB cache @ 1,000,000 vectors: 11.2 queries/s Memory, 100 MB cache @ 500 vectors: 13.03k queries/sMemory, 100 MB cache @ 1,000 vectors: 9.14k queries/sMemory, 100 MB cache @ 10,000 vectors: 1.27k queries/sMemory, 100 MB cache @ 50,000 vectors: 213.7 queries/sMemory, 100 MB cache @ 100,000 vectors: 109.5 queries/sMemory, 100 MB cache @ 500,000 vectors: 22.7 queries/sMemory, 100 MB cache @ 1,000,000 vectors: 11.5 queries/s Memory, 500 MB cache @ 500 vectors: 12.06k queries/sMemory, 500 MB cache @ 1,000 vectors: 9.16k queries/sMemory, 500 MB cache @ 10,000 vectors: 1.27k queries/sMemory, 500 MB cache @ 50,000 vectors: 216.3 queries/sMemory, 500 MB cache @ 100,000 vectors: 112 queries/sMemory, 500 MB cache @ 500,000 vectors: 22.7 queries/sMemory, 500 MB cache @ 1,000,000 vectors: 11.5 queries/s Memory, 2000 MB cache @ 500 vectors: 10.26k queries/sMemory, 2000 MB cache @ 1,000 vectors: 6.4k queries/sMemory, 2000 MB cache @ 10,000 vectors: 1.23k queries/sMemory, 2000 MB cache @ 50,000 vectors: 215.1 queries/sMemory, 2000 MB cache @ 100,000 vectors: 111.5 queries/sMemory, 2000 MB cache @ 500,000 vectors: 22.7 queries/sMemory, 2000 MB cache @ 1,000,000 vectors: 11.2 queries/s IVS, 10 MB cache @ 500 vectors: 11.27k queries/sIVS, 10 MB cache @ 1,000 vectors: 6.83k queries/sIVS, 10 MB cache @ 10,000 vectors: 75 queries/sIVS, 10 MB cache @ 50,000 vectors: 63.1 queries/sIVS, 10 MB cache @ 100,000 vectors: 34.6 queries/sIVS, 10 MB cache @ 500,000 vectors: 6.98 queries/sIVS, 10 MB cache @ 1,000,000 vectors: 3.39 queries/s IVS, 100 MB cache @ 500 vectors: 11.03k queries/sIVS, 100 MB cache @ 1,000 vectors: 6.53k queries/sIVS, 100 MB cache @ 10,000 vectors: 770.4 queries/sIVS, 100 MB cache @ 50,000 vectors: 89.2 queries/sIVS, 100 MB cache @ 100,000 vectors: 40.1 queries/sIVS, 100 MB cache @ 500,000 vectors: 7.06 queries/sIVS, 100 MB cache @ 1,000,000 vectors: 3.47 queries/s IVS, 500 MB cache @ 500 vectors: 10.86k queries/sIVS, 500 MB cache @ 1,000 vectors: 6.75k queries/sIVS, 500 MB cache @ 10,000 vectors: 808.8 queries/sIVS, 500 MB cache @ 50,000 vectors: 755.7 queries/sIVS, 500 MB cache @ 100,000 vectors: 156.1 queries/sIVS, 500 MB cache @ 500,000 vectors: 7.82 queries/sIVS, 500 MB cache @ 1,000,000 vectors: 3.56 queries/s IVS, 2000 MB cache @ 500 vectors: 9.53k queries/sIVS, 2000 MB cache @ 1,000 vectors: 5.98k queries/sIVS, 2000 MB cache @ 10,000 vectors: 809.6 queries/sIVS, 2000 MB cache @ 50,000 vectors: 750.9 queries/sIVS, 2000 MB cache @ 100,000 vectors: 396.6 queries/sIVS, 2000 MB cache @ 500,000 vectors: 17.5 queries/sIVS, 2000 MB cache @ 1,000,000 vectors: 4.62 queries/s HNSW, 10 MB cache @ 500 vectors: 2.06k queries/sHNSW, 10 MB cache @ 1,000 vectors: 1.19k queries/sHNSW, 10 MB cache @ 10,000 vectors: 1.12k queries/sHNSW, 10 MB cache @ 50,000 vectors: 1.13k queries/sHNSW, 10 MB cache @ 100,000 vectors: 1.12k queries/sHNSW, 10 MB cache @ 500,000 vectors: 894.6 queries/sHNSW, 10 MB cache @ 1,000,000 vectors: 825.2 queries/s HNSW, 100 MB cache @ 500 vectors: 12.84k queries/sHNSW, 100 MB cache @ 1,000 vectors: 9.51k queries/sHNSW, 100 MB cache @ 10,000 vectors: 7.19k queries/sHNSW, 100 MB cache @ 50,000 vectors: 1.14k queries/sHNSW, 100 MB cache @ 100,000 vectors: 1.11k queries/sHNSW, 100 MB cache @ 500,000 vectors: 887.1 queries/sHNSW, 100 MB cache @ 1,000,000 vectors: 814.3 queries/s HNSW, 500 MB cache @ 500 vectors: 13.36k queries/sHNSW, 500 MB cache @ 1,000 vectors: 10.07k queries/sHNSW, 500 MB cache @ 10,000 vectors: 7.43k queries/sHNSW, 500 MB cache @ 50,000 vectors: 7.67k queries/sHNSW, 500 MB cache @ 100,000 vectors: 1.11k queries/sHNSW, 500 MB cache @ 500,000 vectors: 896.5 queries/sHNSW, 500 MB cache @ 1,000,000 vectors: 810.3 queries/s HNSW, 2000 MB cache @ 500 vectors: 12.62k queries/sHNSW, 2000 MB cache @ 1,000 vectors: 10.42k queries/sHNSW, 2000 MB cache @ 10,000 vectors: 7.15k queries/sHNSW, 2000 MB cache @ 50,000 vectors: 6.85k queries/sHNSW, 2000 MB cache @ 100,000 vectors: 5.81k queries/sHNSW, 2000 MB cache @ 500,000 vectors: 897.2 queries/sHNSW, 2000 MB cache @ 1,000,000 vectors: 778.6 queries/s

Filter

queries/s · ▲ higher is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 10.98k queries/sMemory, 10 MB cache @ 1,000 vectors: 9.04k queries/sMemory, 10 MB cache @ 10,000 vectors: 1.48k queries/sMemory, 10 MB cache @ 50,000 vectors: 219.9 queries/sMemory, 10 MB cache @ 100,000 vectors: 111.8 queries/sMemory, 10 MB cache @ 500,000 vectors: 22.2 queries/sMemory, 10 MB cache @ 1,000,000 vectors: 11.2 queries/s Memory, 100 MB cache @ 500 vectors: 11.09k queries/sMemory, 100 MB cache @ 1,000 vectors: 9.27k queries/sMemory, 100 MB cache @ 10,000 vectors: 1.32k queries/sMemory, 100 MB cache @ 50,000 vectors: 220.3 queries/sMemory, 100 MB cache @ 100,000 vectors: 111.7 queries/sMemory, 100 MB cache @ 500,000 vectors: 23 queries/sMemory, 100 MB cache @ 1,000,000 vectors: 11.6 queries/s Memory, 500 MB cache @ 500 vectors: 11.21k queries/sMemory, 500 MB cache @ 1,000 vectors: 9.18k queries/sMemory, 500 MB cache @ 10,000 vectors: 1.38k queries/sMemory, 500 MB cache @ 50,000 vectors: 219.8 queries/sMemory, 500 MB cache @ 100,000 vectors: 103.4 queries/sMemory, 500 MB cache @ 500,000 vectors: 23 queries/sMemory, 500 MB cache @ 1,000,000 vectors: 11.5 queries/s Memory, 2000 MB cache @ 500 vectors: 11.07k queries/sMemory, 2000 MB cache @ 1,000 vectors: 8.59k queries/sMemory, 2000 MB cache @ 10,000 vectors: 1.38k queries/sMemory, 2000 MB cache @ 50,000 vectors: 222.2 queries/sMemory, 2000 MB cache @ 100,000 vectors: 113.5 queries/sMemory, 2000 MB cache @ 500,000 vectors: 23 queries/sMemory, 2000 MB cache @ 1,000,000 vectors: 11.5 queries/s IVS, 10 MB cache @ 500 vectors: 11.24k queries/sIVS, 10 MB cache @ 1,000 vectors: 6.83k queries/sIVS, 10 MB cache @ 10,000 vectors: 75.4 queries/sIVS, 10 MB cache @ 50,000 vectors: 62.5 queries/sIVS, 10 MB cache @ 100,000 vectors: 34.6 queries/sIVS, 10 MB cache @ 500,000 vectors: 6.88 queries/sIVS, 10 MB cache @ 1,000,000 vectors: 3.24 queries/s IVS, 100 MB cache @ 500 vectors: 12.52k queries/sIVS, 100 MB cache @ 1,000 vectors: 6.81k queries/sIVS, 100 MB cache @ 10,000 vectors: 835.2 queries/sIVS, 100 MB cache @ 50,000 vectors: 91 queries/sIVS, 100 MB cache @ 100,000 vectors: 40.5 queries/sIVS, 100 MB cache @ 500,000 vectors: 7.01 queries/sIVS, 100 MB cache @ 1,000,000 vectors: 3.48 queries/s IVS, 500 MB cache @ 500 vectors: 10.82k queries/sIVS, 500 MB cache @ 1,000 vectors: 6.68k queries/sIVS, 500 MB cache @ 10,000 vectors: 811.9 queries/sIVS, 500 MB cache @ 50,000 vectors: 777.2 queries/sIVS, 500 MB cache @ 100,000 vectors: 158 queries/sIVS, 500 MB cache @ 500,000 vectors: 7.98 queries/sIVS, 500 MB cache @ 1,000,000 vectors: 3.61 queries/s IVS, 2000 MB cache @ 500 vectors: 12.57k queries/sIVS, 2000 MB cache @ 1,000 vectors: 6.11k queries/sIVS, 2000 MB cache @ 10,000 vectors: 816.6 queries/sIVS, 2000 MB cache @ 50,000 vectors: 830.7 queries/sIVS, 2000 MB cache @ 100,000 vectors: 421.6 queries/sIVS, 2000 MB cache @ 500,000 vectors: 17.4 queries/sIVS, 2000 MB cache @ 1,000,000 vectors: 4.72 queries/s HNSW, 10 MB cache @ 500 vectors: 2.15k queries/sHNSW, 10 MB cache @ 1,000 vectors: 1.25k queries/sHNSW, 10 MB cache @ 10,000 vectors: 95.4 queries/sHNSW, 10 MB cache @ 50,000 vectors: 41.2 queries/sHNSW, 10 MB cache @ 100,000 vectors: 20.6 queries/sHNSW, 10 MB cache @ 500,000 vectors: 69.4 queries/sHNSW, 10 MB cache @ 1,000,000 vectors: 47 queries/s HNSW, 100 MB cache @ 500 vectors: 20.63k queries/sHNSW, 100 MB cache @ 1,000 vectors: 17.63k queries/sHNSW, 100 MB cache @ 10,000 vectors: 796.8 queries/sHNSW, 100 MB cache @ 50,000 vectors: 42.3 queries/sHNSW, 100 MB cache @ 100,000 vectors: 20.1 queries/sHNSW, 100 MB cache @ 500,000 vectors: 70 queries/sHNSW, 100 MB cache @ 1,000,000 vectors: 44.4 queries/s HNSW, 500 MB cache @ 500 vectors: 19.68k queries/sHNSW, 500 MB cache @ 1,000 vectors: 16.14k queries/sHNSW, 500 MB cache @ 10,000 vectors: 808.2 queries/sHNSW, 500 MB cache @ 50,000 vectors: 301.9 queries/sHNSW, 500 MB cache @ 100,000 vectors: 20 queries/sHNSW, 500 MB cache @ 500,000 vectors: 70.4 queries/sHNSW, 500 MB cache @ 1,000,000 vectors: 46.2 queries/s HNSW, 2000 MB cache @ 500 vectors: 20.11k queries/sHNSW, 2000 MB cache @ 1,000 vectors: 16.74k queries/sHNSW, 2000 MB cache @ 10,000 vectors: 857.1 queries/sHNSW, 2000 MB cache @ 50,000 vectors: 301.3 queries/sHNSW, 2000 MB cache @ 100,000 vectors: 188.2 queries/sHNSW, 2000 MB cache @ 500,000 vectors: 69.6 queries/sHNSW, 2000 MB cache @ 1,000,000 vectors: 44.9 queries/s

Accuracy

Recall

% · ▲ higher is better

0 25 50 75 100 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 100 %Memory, 10 MB cache @ 1,000 vectors: 100 %Memory, 10 MB cache @ 10,000 vectors: 100 %Memory, 10 MB cache @ 50,000 vectors: 100 %Memory, 10 MB cache @ 100,000 vectors: 100 %Memory, 10 MB cache @ 500,000 vectors: 100 %Memory, 10 MB cache @ 1,000,000 vectors: 100 % Memory, 100 MB cache @ 500 vectors: 100 %Memory, 100 MB cache @ 1,000 vectors: 100 %Memory, 100 MB cache @ 10,000 vectors: 100 %Memory, 100 MB cache @ 50,000 vectors: 100 %Memory, 100 MB cache @ 100,000 vectors: 100 %Memory, 100 MB cache @ 500,000 vectors: 100 %Memory, 100 MB cache @ 1,000,000 vectors: 100 % Memory, 500 MB cache @ 500 vectors: 100 %Memory, 500 MB cache @ 1,000 vectors: 100 %Memory, 500 MB cache @ 10,000 vectors: 100 %Memory, 500 MB cache @ 50,000 vectors: 100 %Memory, 500 MB cache @ 100,000 vectors: 100 %Memory, 500 MB cache @ 500,000 vectors: 100 %Memory, 500 MB cache @ 1,000,000 vectors: 100 % Memory, 2000 MB cache @ 500 vectors: 100 %Memory, 2000 MB cache @ 1,000 vectors: 100 %Memory, 2000 MB cache @ 10,000 vectors: 100 %Memory, 2000 MB cache @ 50,000 vectors: 100 %Memory, 2000 MB cache @ 100,000 vectors: 100 %Memory, 2000 MB cache @ 500,000 vectors: 100 %Memory, 2000 MB cache @ 1,000,000 vectors: 100 % IVS, 10 MB cache @ 500 vectors: 100 %IVS, 10 MB cache @ 1,000 vectors: 100 %IVS, 10 MB cache @ 10,000 vectors: 100 %IVS, 10 MB cache @ 50,000 vectors: 100 %IVS, 10 MB cache @ 100,000 vectors: 100 %IVS, 10 MB cache @ 500,000 vectors: 100 %IVS, 10 MB cache @ 1,000,000 vectors: 100 % IVS, 100 MB cache @ 500 vectors: 100 %IVS, 100 MB cache @ 1,000 vectors: 100 %IVS, 100 MB cache @ 10,000 vectors: 100 %IVS, 100 MB cache @ 50,000 vectors: 100 %IVS, 100 MB cache @ 100,000 vectors: 100 %IVS, 100 MB cache @ 500,000 vectors: 100 %IVS, 100 MB cache @ 1,000,000 vectors: 100 % IVS, 500 MB cache @ 500 vectors: 100 %IVS, 500 MB cache @ 1,000 vectors: 100 %IVS, 500 MB cache @ 10,000 vectors: 100 %IVS, 500 MB cache @ 50,000 vectors: 100 %IVS, 500 MB cache @ 100,000 vectors: 100 %IVS, 500 MB cache @ 500,000 vectors: 100 %IVS, 500 MB cache @ 1,000,000 vectors: 100 % IVS, 2000 MB cache @ 500 vectors: 100 %IVS, 2000 MB cache @ 1,000 vectors: 100 %IVS, 2000 MB cache @ 10,000 vectors: 100 %IVS, 2000 MB cache @ 50,000 vectors: 100 %IVS, 2000 MB cache @ 100,000 vectors: 100 %IVS, 2000 MB cache @ 500,000 vectors: 100 %IVS, 2000 MB cache @ 1,000,000 vectors: 100 % HNSW, 10 MB cache @ 500 vectors: 100 %HNSW, 10 MB cache @ 1,000 vectors: 100 %HNSW, 10 MB cache @ 10,000 vectors: 99.4 %HNSW, 10 MB cache @ 50,000 vectors: 99 %HNSW, 10 MB cache @ 100,000 vectors: 100 %HNSW, 10 MB cache @ 500,000 vectors: 84.6 %HNSW, 10 MB cache @ 1,000,000 vectors: 74.8 % HNSW, 100 MB cache @ 500 vectors: 100 %HNSW, 100 MB cache @ 1,000 vectors: 100 %HNSW, 100 MB cache @ 10,000 vectors: 100 %HNSW, 100 MB cache @ 50,000 vectors: 99.6 %HNSW, 100 MB cache @ 100,000 vectors: 100 %HNSW, 100 MB cache @ 500,000 vectors: 80.8 %HNSW, 100 MB cache @ 1,000,000 vectors: 74.6 % HNSW, 500 MB cache @ 500 vectors: 100 %HNSW, 500 MB cache @ 1,000 vectors: 100 %HNSW, 500 MB cache @ 10,000 vectors: 100 %HNSW, 500 MB cache @ 50,000 vectors: 100 %HNSW, 500 MB cache @ 100,000 vectors: 100 %HNSW, 500 MB cache @ 500,000 vectors: 86.8 %HNSW, 500 MB cache @ 1,000,000 vectors: 77.2 % HNSW, 2000 MB cache @ 500 vectors: 100 %HNSW, 2000 MB cache @ 1,000 vectors: 100 %HNSW, 2000 MB cache @ 10,000 vectors: 99.6 %HNSW, 2000 MB cache @ 50,000 vectors: 99.8 %HNSW, 2000 MB cache @ 100,000 vectors: 100 %HNSW, 2000 MB cache @ 500,000 vectors: 84.4 %HNSW, 2000 MB cache @ 1,000,000 vectors: 77.2 %

Filter recall

% · ▲ higher is better

0 25 50 75 100 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 100 %Memory, 10 MB cache @ 1,000 vectors: 100 %Memory, 10 MB cache @ 10,000 vectors: 100 %Memory, 10 MB cache @ 50,000 vectors: 100 %Memory, 10 MB cache @ 100,000 vectors: 100 %Memory, 10 MB cache @ 500,000 vectors: 100 %Memory, 10 MB cache @ 1,000,000 vectors: 100 % Memory, 100 MB cache @ 500 vectors: 100 %Memory, 100 MB cache @ 1,000 vectors: 100 %Memory, 100 MB cache @ 10,000 vectors: 100 %Memory, 100 MB cache @ 50,000 vectors: 100 %Memory, 100 MB cache @ 100,000 vectors: 100 %Memory, 100 MB cache @ 500,000 vectors: 100 %Memory, 100 MB cache @ 1,000,000 vectors: 100 % Memory, 500 MB cache @ 500 vectors: 100 %Memory, 500 MB cache @ 1,000 vectors: 100 %Memory, 500 MB cache @ 10,000 vectors: 100 %Memory, 500 MB cache @ 50,000 vectors: 100 %Memory, 500 MB cache @ 100,000 vectors: 100 %Memory, 500 MB cache @ 500,000 vectors: 100 %Memory, 500 MB cache @ 1,000,000 vectors: 100 % Memory, 2000 MB cache @ 500 vectors: 100 %Memory, 2000 MB cache @ 1,000 vectors: 100 %Memory, 2000 MB cache @ 10,000 vectors: 100 %Memory, 2000 MB cache @ 50,000 vectors: 100 %Memory, 2000 MB cache @ 100,000 vectors: 100 %Memory, 2000 MB cache @ 500,000 vectors: 100 %Memory, 2000 MB cache @ 1,000,000 vectors: 100 % IVS, 10 MB cache @ 500 vectors: 100 %IVS, 10 MB cache @ 1,000 vectors: 100 %IVS, 10 MB cache @ 10,000 vectors: 100 %IVS, 10 MB cache @ 50,000 vectors: 94.8 %IVS, 10 MB cache @ 100,000 vectors: 100 %IVS, 10 MB cache @ 500,000 vectors: 100 %IVS, 10 MB cache @ 1,000,000 vectors: 100 % IVS, 100 MB cache @ 500 vectors: 100 %IVS, 100 MB cache @ 1,000 vectors: 100 %IVS, 100 MB cache @ 10,000 vectors: 100 %IVS, 100 MB cache @ 50,000 vectors: 94.8 %IVS, 100 MB cache @ 100,000 vectors: 100 %IVS, 100 MB cache @ 500,000 vectors: 100 %IVS, 100 MB cache @ 1,000,000 vectors: 100 % IVS, 500 MB cache @ 500 vectors: 100 %IVS, 500 MB cache @ 1,000 vectors: 100 %IVS, 500 MB cache @ 10,000 vectors: 100 %IVS, 500 MB cache @ 50,000 vectors: 94.8 %IVS, 500 MB cache @ 100,000 vectors: 100 %IVS, 500 MB cache @ 500,000 vectors: 100 %IVS, 500 MB cache @ 1,000,000 vectors: 100 % IVS, 2000 MB cache @ 500 vectors: 100 %IVS, 2000 MB cache @ 1,000 vectors: 100 %IVS, 2000 MB cache @ 10,000 vectors: 100 %IVS, 2000 MB cache @ 50,000 vectors: 94.8 %IVS, 2000 MB cache @ 100,000 vectors: 100 %IVS, 2000 MB cache @ 500,000 vectors: 100 %IVS, 2000 MB cache @ 1,000,000 vectors: 100 % HNSW, 10 MB cache @ 500 vectors: 100 %HNSW, 10 MB cache @ 1,000 vectors: 100 %HNSW, 10 MB cache @ 10,000 vectors: 100 %HNSW, 10 MB cache @ 50,000 vectors: 99.4 %HNSW, 10 MB cache @ 100,000 vectors: 97.9 %HNSW, 10 MB cache @ 500,000 vectors: 89.1 %HNSW, 10 MB cache @ 1,000,000 vectors: 87.7 % HNSW, 100 MB cache @ 500 vectors: 100 %HNSW, 100 MB cache @ 1,000 vectors: 100 %HNSW, 100 MB cache @ 10,000 vectors: 100 %HNSW, 100 MB cache @ 50,000 vectors: 99.4 %HNSW, 100 MB cache @ 100,000 vectors: 99.9 %HNSW, 100 MB cache @ 500,000 vectors: 87.1 %HNSW, 100 MB cache @ 1,000,000 vectors: 87.7 % HNSW, 500 MB cache @ 500 vectors: 100 %HNSW, 500 MB cache @ 1,000 vectors: 100 %HNSW, 500 MB cache @ 10,000 vectors: 100 %HNSW, 500 MB cache @ 50,000 vectors: 99.3 %HNSW, 500 MB cache @ 100,000 vectors: 99.9 %HNSW, 500 MB cache @ 500,000 vectors: 87.2 %HNSW, 500 MB cache @ 1,000,000 vectors: 89.6 % HNSW, 2000 MB cache @ 500 vectors: 100 %HNSW, 2000 MB cache @ 1,000 vectors: 100 %HNSW, 2000 MB cache @ 10,000 vectors: 100 %HNSW, 2000 MB cache @ 50,000 vectors: 99.4 %HNSW, 2000 MB cache @ 100,000 vectors: 99.9 %HNSW, 2000 MB cache @ 500,000 vectors: 87.1 %HNSW, 2000 MB cache @ 1,000,000 vectors: 89.6 %

Durability and restart

Save

ms · ▼ lower is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 13.5 msMemory, 10 MB cache @ 1,000 vectors: 19.6 msMemory, 10 MB cache @ 10,000 vectors: 142.9 msMemory, 10 MB cache @ 50,000 vectors: 522.2 msMemory, 10 MB cache @ 100,000 vectors: 1.05k msMemory, 10 MB cache @ 500,000 vectors: 5.16k msMemory, 10 MB cache @ 1,000,000 vectors: 10.64k ms Memory, 100 MB cache @ 500 vectors: 13.9 msMemory, 100 MB cache @ 1,000 vectors: 19.6 msMemory, 100 MB cache @ 10,000 vectors: 147.9 msMemory, 100 MB cache @ 50,000 vectors: 520.1 msMemory, 100 MB cache @ 100,000 vectors: 1.07k msMemory, 100 MB cache @ 500,000 vectors: 5.09k msMemory, 100 MB cache @ 1,000,000 vectors: 10.17k ms Memory, 500 MB cache @ 500 vectors: 13.3 msMemory, 500 MB cache @ 1,000 vectors: 20.1 msMemory, 500 MB cache @ 10,000 vectors: 145.5 msMemory, 500 MB cache @ 50,000 vectors: 537.6 msMemory, 500 MB cache @ 100,000 vectors: 1.03k msMemory, 500 MB cache @ 500,000 vectors: 5.07k msMemory, 500 MB cache @ 1,000,000 vectors: 10.15k ms Memory, 2000 MB cache @ 500 vectors: 12.8 msMemory, 2000 MB cache @ 1,000 vectors: 19.6 msMemory, 2000 MB cache @ 10,000 vectors: 129.2 msMemory, 2000 MB cache @ 50,000 vectors: 518.1 msMemory, 2000 MB cache @ 100,000 vectors: 1.05k msMemory, 2000 MB cache @ 500,000 vectors: 5.03k msMemory, 2000 MB cache @ 1,000,000 vectors: 10.25k ms IVS, 10 MB cache @ 500 vectors: 8.93 msIVS, 10 MB cache @ 1,000 vectors: 7.48 msIVS, 10 MB cache @ 10,000 vectors: 8.32 msIVS, 10 MB cache @ 50,000 vectors: 26.9 msIVS, 10 MB cache @ 100,000 vectors: 268.2 msIVS, 10 MB cache @ 500,000 vectors: 30.4 msIVS, 10 MB cache @ 1,000,000 vectors: 39.3 ms IVS, 100 MB cache @ 500 vectors: 8.39 msIVS, 100 MB cache @ 1,000 vectors: 7.71 msIVS, 100 MB cache @ 10,000 vectors: 10.4 msIVS, 100 MB cache @ 50,000 vectors: 26.4 msIVS, 100 MB cache @ 100,000 vectors: 404.6 msIVS, 100 MB cache @ 500,000 vectors: 30.7 msIVS, 100 MB cache @ 1,000,000 vectors: 162.8 ms IVS, 500 MB cache @ 500 vectors: 8.72 msIVS, 500 MB cache @ 1,000 vectors: 8.78 msIVS, 500 MB cache @ 10,000 vectors: 8.59 msIVS, 500 MB cache @ 50,000 vectors: 32.8 msIVS, 500 MB cache @ 100,000 vectors: 363.1 msIVS, 500 MB cache @ 500,000 vectors: 44.7 msIVS, 500 MB cache @ 1,000,000 vectors: 37.7 ms IVS, 2000 MB cache @ 500 vectors: 11.2 msIVS, 2000 MB cache @ 1,000 vectors: 8.65 msIVS, 2000 MB cache @ 10,000 vectors: 9.48 msIVS, 2000 MB cache @ 50,000 vectors: 29.3 msIVS, 2000 MB cache @ 100,000 vectors: 365.9 msIVS, 2000 MB cache @ 500,000 vectors: 47.4 msIVS, 2000 MB cache @ 1,000,000 vectors: 27.7 ms HNSW, 10 MB cache @ 500 vectors: 5.78 msHNSW, 10 MB cache @ 1,000 vectors: 5.75 msHNSW, 10 MB cache @ 10,000 vectors: 25.3 msHNSW, 10 MB cache @ 50,000 vectors: 103.8 msHNSW, 10 MB cache @ 100,000 vectors: 197.1 msHNSW, 10 MB cache @ 500,000 vectors: 295.6 msHNSW, 10 MB cache @ 1,000,000 vectors: 240.4 ms HNSW, 100 MB cache @ 500 vectors: 6.47 msHNSW, 100 MB cache @ 1,000 vectors: 6.9 msHNSW, 100 MB cache @ 10,000 vectors: 24.4 msHNSW, 100 MB cache @ 50,000 vectors: 104.4 msHNSW, 100 MB cache @ 100,000 vectors: 218.5 msHNSW, 100 MB cache @ 500,000 vectors: 302.7 msHNSW, 100 MB cache @ 1,000,000 vectors: 293.1 ms HNSW, 500 MB cache @ 500 vectors: 6.01 msHNSW, 500 MB cache @ 1,000 vectors: 6.67 msHNSW, 500 MB cache @ 10,000 vectors: 25.1 msHNSW, 500 MB cache @ 50,000 vectors: 107.1 msHNSW, 500 MB cache @ 100,000 vectors: 201.3 msHNSW, 500 MB cache @ 500,000 vectors: 272.6 msHNSW, 500 MB cache @ 1,000,000 vectors: 263 ms HNSW, 2000 MB cache @ 500 vectors: 5.46 msHNSW, 2000 MB cache @ 1,000 vectors: 6.24 msHNSW, 2000 MB cache @ 10,000 vectors: 25.3 msHNSW, 2000 MB cache @ 50,000 vectors: 104.8 msHNSW, 2000 MB cache @ 100,000 vectors: 197.2 msHNSW, 2000 MB cache @ 500,000 vectors: 302.8 msHNSW, 2000 MB cache @ 1,000,000 vectors: 292.7 ms

Flush

ms · ▼ lower is better · log scale

1 10 100 1k 10k 5001k10k50k100k500k1Mvectors IVS, 10 MB cache @ 500 vectors: 25.7 msIVS, 10 MB cache @ 1,000 vectors: 18 msIVS, 10 MB cache @ 10,000 vectors: 16.3 msIVS, 10 MB cache @ 50,000 vectors: 54.2 msIVS, 10 MB cache @ 100,000 vectors: 840.7 msIVS, 10 MB cache @ 500,000 vectors: 62.4 msIVS, 10 MB cache @ 1,000,000 vectors: 98.3 ms IVS, 100 MB cache @ 500 vectors: 15.6 msIVS, 100 MB cache @ 1,000 vectors: 15.1 msIVS, 100 MB cache @ 10,000 vectors: 15.6 msIVS, 100 MB cache @ 50,000 vectors: 54.3 msIVS, 100 MB cache @ 100,000 vectors: 1.08k msIVS, 100 MB cache @ 500,000 vectors: 60.7 msIVS, 100 MB cache @ 1,000,000 vectors: 194.8 ms IVS, 500 MB cache @ 500 vectors: 16.2 msIVS, 500 MB cache @ 1,000 vectors: 15.8 msIVS, 500 MB cache @ 10,000 vectors: 16 msIVS, 500 MB cache @ 50,000 vectors: 35.6 msIVS, 500 MB cache @ 100,000 vectors: 1.08k msIVS, 500 MB cache @ 500,000 vectors: 78.8 msIVS, 500 MB cache @ 1,000,000 vectors: 86.9 ms IVS, 2000 MB cache @ 500 vectors: 20.5 msIVS, 2000 MB cache @ 1,000 vectors: 19.1 msIVS, 2000 MB cache @ 10,000 vectors: 16.1 msIVS, 2000 MB cache @ 50,000 vectors: 36.2 msIVS, 2000 MB cache @ 100,000 vectors: 1.07k msIVS, 2000 MB cache @ 500,000 vectors: 73.6 msIVS, 2000 MB cache @ 1,000,000 vectors: 93 ms HNSW, 10 MB cache @ 500 vectors: 4.76 msHNSW, 10 MB cache @ 1,000 vectors: 3.31 msHNSW, 10 MB cache @ 10,000 vectors: 4.08 msHNSW, 10 MB cache @ 50,000 vectors: 6.28 msHNSW, 10 MB cache @ 100,000 vectors: 8.45 msHNSW, 10 MB cache @ 500,000 vectors: 36.3 msHNSW, 10 MB cache @ 1,000,000 vectors: 6.32 ms HNSW, 100 MB cache @ 500 vectors: 4.49 msHNSW, 100 MB cache @ 1,000 vectors: 5.46 msHNSW, 100 MB cache @ 10,000 vectors: 5.21 msHNSW, 100 MB cache @ 50,000 vectors: 9.73 msHNSW, 100 MB cache @ 100,000 vectors: 11.5 msHNSW, 100 MB cache @ 500,000 vectors: 44.3 msHNSW, 100 MB cache @ 1,000,000 vectors: 50.8 ms HNSW, 500 MB cache @ 500 vectors: 4.82 msHNSW, 500 MB cache @ 1,000 vectors: 4.59 msHNSW, 500 MB cache @ 10,000 vectors: 5.71 msHNSW, 500 MB cache @ 50,000 vectors: 9.68 msHNSW, 500 MB cache @ 100,000 vectors: 15.1 msHNSW, 500 MB cache @ 500,000 vectors: 17.8 msHNSW, 500 MB cache @ 1,000,000 vectors: 46 ms HNSW, 2000 MB cache @ 500 vectors: 4.96 msHNSW, 2000 MB cache @ 1,000 vectors: 5.06 msHNSW, 2000 MB cache @ 10,000 vectors: 6.17 msHNSW, 2000 MB cache @ 50,000 vectors: 9.66 msHNSW, 2000 MB cache @ 100,000 vectors: 14.9 msHNSW, 2000 MB cache @ 500,000 vectors: 50.3 msHNSW, 2000 MB cache @ 1,000,000 vectors: 51.1 ms

Open

ms · ▼ lower is better · log scale

0.1 1 10 100 1k 10k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 10.7 msMemory, 10 MB cache @ 1,000 vectors: 10.5 msMemory, 10 MB cache @ 10,000 vectors: 63 msMemory, 10 MB cache @ 50,000 vectors: 386.4 msMemory, 10 MB cache @ 100,000 vectors: 642.6 msMemory, 10 MB cache @ 500,000 vectors: 2.48k msMemory, 10 MB cache @ 1,000,000 vectors: 5.61k ms Memory, 100 MB cache @ 500 vectors: 10.7 msMemory, 100 MB cache @ 1,000 vectors: 14.9 msMemory, 100 MB cache @ 10,000 vectors: 64.3 msMemory, 100 MB cache @ 50,000 vectors: 411.1 msMemory, 100 MB cache @ 100,000 vectors: 629.5 msMemory, 100 MB cache @ 500,000 vectors: 2.53k msMemory, 100 MB cache @ 1,000,000 vectors: 7.15k ms Memory, 500 MB cache @ 500 vectors: 12 msMemory, 500 MB cache @ 1,000 vectors: 11.9 msMemory, 500 MB cache @ 10,000 vectors: 62.6 msMemory, 500 MB cache @ 50,000 vectors: 382.5 msMemory, 500 MB cache @ 100,000 vectors: 700.9 msMemory, 500 MB cache @ 500,000 vectors: 2.57k msMemory, 500 MB cache @ 1,000,000 vectors: 6.08k ms Memory, 2000 MB cache @ 500 vectors: 9.65 msMemory, 2000 MB cache @ 1,000 vectors: 11.5 msMemory, 2000 MB cache @ 10,000 vectors: 63.3 msMemory, 2000 MB cache @ 50,000 vectors: 379 msMemory, 2000 MB cache @ 100,000 vectors: 710 msMemory, 2000 MB cache @ 500,000 vectors: 2.56k msMemory, 2000 MB cache @ 1,000,000 vectors: 6.45k ms IVS, 10 MB cache @ 500 vectors: 0.86 msIVS, 10 MB cache @ 1,000 vectors: 0.79 msIVS, 10 MB cache @ 10,000 vectors: 1.41 msIVS, 10 MB cache @ 50,000 vectors: 2.93 msIVS, 10 MB cache @ 100,000 vectors: 8.22 msIVS, 10 MB cache @ 500,000 vectors: 45.7 msIVS, 10 MB cache @ 1,000,000 vectors: 75.5 ms IVS, 100 MB cache @ 500 vectors: 0.81 msIVS, 100 MB cache @ 1,000 vectors: 0.82 msIVS, 100 MB cache @ 10,000 vectors: 1.07 msIVS, 100 MB cache @ 50,000 vectors: 3.01 msIVS, 100 MB cache @ 100,000 vectors: 9.32 msIVS, 100 MB cache @ 500,000 vectors: 44.7 msIVS, 100 MB cache @ 1,000,000 vectors: 68.3 ms IVS, 500 MB cache @ 500 vectors: 0.8 msIVS, 500 MB cache @ 1,000 vectors: 0.78 msIVS, 500 MB cache @ 10,000 vectors: 1.07 msIVS, 500 MB cache @ 50,000 vectors: 2.99 msIVS, 500 MB cache @ 100,000 vectors: 8.2 msIVS, 500 MB cache @ 500,000 vectors: 45.2 msIVS, 500 MB cache @ 1,000,000 vectors: 73.1 ms IVS, 2000 MB cache @ 500 vectors: 0.79 msIVS, 2000 MB cache @ 1,000 vectors: 0.77 msIVS, 2000 MB cache @ 10,000 vectors: 1.24 msIVS, 2000 MB cache @ 50,000 vectors: 3.22 msIVS, 2000 MB cache @ 100,000 vectors: 7.88 msIVS, 2000 MB cache @ 500,000 vectors: 45.5 msIVS, 2000 MB cache @ 1,000,000 vectors: 70.7 ms HNSW, 10 MB cache @ 500 vectors: 8.4 msHNSW, 10 MB cache @ 1,000 vectors: 6.65 msHNSW, 10 MB cache @ 10,000 vectors: 10.1 msHNSW, 10 MB cache @ 50,000 vectors: 23.1 msHNSW, 10 MB cache @ 100,000 vectors: 50 msHNSW, 10 MB cache @ 500,000 vectors: 171.9 msHNSW, 10 MB cache @ 1,000,000 vectors: 330 ms HNSW, 100 MB cache @ 500 vectors: 10.4 msHNSW, 100 MB cache @ 1,000 vectors: 10.2 msHNSW, 100 MB cache @ 10,000 vectors: 17 msHNSW, 100 MB cache @ 50,000 vectors: 32 msHNSW, 100 MB cache @ 100,000 vectors: 49.4 msHNSW, 100 MB cache @ 500,000 vectors: 176.1 msHNSW, 100 MB cache @ 1,000,000 vectors: 326.1 ms HNSW, 500 MB cache @ 500 vectors: 9.52 msHNSW, 500 MB cache @ 1,000 vectors: 14.9 msHNSW, 500 MB cache @ 10,000 vectors: 20.7 msHNSW, 500 MB cache @ 50,000 vectors: 85.2 msHNSW, 500 MB cache @ 100,000 vectors: 46 msHNSW, 500 MB cache @ 500,000 vectors: 182.8 msHNSW, 500 MB cache @ 1,000,000 vectors: 327.4 ms HNSW, 2000 MB cache @ 500 vectors: 12.2 msHNSW, 2000 MB cache @ 1,000 vectors: 9.02 msHNSW, 2000 MB cache @ 10,000 vectors: 20.4 msHNSW, 2000 MB cache @ 50,000 vectors: 81.3 msHNSW, 2000 MB cache @ 100,000 vectors: 153.6 msHNSW, 2000 MB cache @ 500,000 vectors: 179.7 msHNSW, 2000 MB cache @ 1,000,000 vectors: 320.3 ms

Footprint

Memory

MB · ▼ lower is better · log scale

0.1 1 10 100 1k 10k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 2.99 MBMemory, 10 MB cache @ 1,000 vectors: 5.97 MBMemory, 10 MB cache @ 10,000 vectors: 59.3 MBMemory, 10 MB cache @ 50,000 vectors: 296.1 MBMemory, 10 MB cache @ 100,000 vectors: 592.4 MBMemory, 10 MB cache @ 500,000 vectors: 2.96k MBMemory, 10 MB cache @ 1,000,000 vectors: 5.92k MB Memory, 100 MB cache @ 500 vectors: 2.99 MBMemory, 100 MB cache @ 1,000 vectors: 5.97 MBMemory, 100 MB cache @ 10,000 vectors: 59.3 MBMemory, 100 MB cache @ 50,000 vectors: 296.1 MBMemory, 100 MB cache @ 100,000 vectors: 592.4 MBMemory, 100 MB cache @ 500,000 vectors: 2.96k MBMemory, 100 MB cache @ 1,000,000 vectors: 5.92k MB Memory, 500 MB cache @ 500 vectors: 2.99 MBMemory, 500 MB cache @ 1,000 vectors: 5.97 MBMemory, 500 MB cache @ 10,000 vectors: 59.3 MBMemory, 500 MB cache @ 50,000 vectors: 296.1 MBMemory, 500 MB cache @ 100,000 vectors: 592.4 MBMemory, 500 MB cache @ 500,000 vectors: 2.96k MBMemory, 500 MB cache @ 1,000,000 vectors: 5.92k MB Memory, 2000 MB cache @ 500 vectors: 2.99 MBMemory, 2000 MB cache @ 1,000 vectors: 5.97 MBMemory, 2000 MB cache @ 10,000 vectors: 59.3 MBMemory, 2000 MB cache @ 50,000 vectors: 296.1 MBMemory, 2000 MB cache @ 100,000 vectors: 592.4 MBMemory, 2000 MB cache @ 500,000 vectors: 2.96k MBMemory, 2000 MB cache @ 1,000,000 vectors: 5.92k MB IVS, 10 MB cache @ 500 vectors: 3.01 MBIVS, 10 MB cache @ 1,000 vectors: 6.02 MBIVS, 10 MB cache @ 10,000 vectors: 0.99 MBIVS, 10 MB cache @ 50,000 vectors: 3.27 MBIVS, 10 MB cache @ 100,000 vectors: 6.29 MBIVS, 10 MB cache @ 500,000 vectors: 26.4 MBIVS, 10 MB cache @ 1,000,000 vectors: 53.5 MB IVS, 100 MB cache @ 500 vectors: 3.01 MBIVS, 100 MB cache @ 1,000 vectors: 6.02 MBIVS, 100 MB cache @ 10,000 vectors: 0.99 MBIVS, 100 MB cache @ 50,000 vectors: 3.27 MBIVS, 100 MB cache @ 100,000 vectors: 6.29 MBIVS, 100 MB cache @ 500,000 vectors: 26.4 MBIVS, 100 MB cache @ 1,000,000 vectors: 53.5 MB IVS, 500 MB cache @ 500 vectors: 3.01 MBIVS, 500 MB cache @ 1,000 vectors: 6.02 MBIVS, 500 MB cache @ 10,000 vectors: 0.99 MBIVS, 500 MB cache @ 50,000 vectors: 3.27 MBIVS, 500 MB cache @ 100,000 vectors: 6.29 MBIVS, 500 MB cache @ 500,000 vectors: 26.4 MBIVS, 500 MB cache @ 1,000,000 vectors: 53.5 MB IVS, 2000 MB cache @ 500 vectors: 3.01 MBIVS, 2000 MB cache @ 1,000 vectors: 6.02 MBIVS, 2000 MB cache @ 10,000 vectors: 0.99 MBIVS, 2000 MB cache @ 50,000 vectors: 3.27 MBIVS, 2000 MB cache @ 100,000 vectors: 6.29 MBIVS, 2000 MB cache @ 500,000 vectors: 26.4 MBIVS, 2000 MB cache @ 1,000,000 vectors: 53.5 MB HNSW, 10 MB cache @ 500 vectors: 10.4 MBHNSW, 10 MB cache @ 1,000 vectors: 13.6 MBHNSW, 10 MB cache @ 10,000 vectors: 24.4 MBHNSW, 10 MB cache @ 50,000 vectors: 97.4 MBHNSW, 10 MB cache @ 100,000 vectors: 185.3 MBHNSW, 10 MB cache @ 500,000 vectors: 904.2 MBHNSW, 10 MB cache @ 1,000,000 vectors: 1.8k MB HNSW, 100 MB cache @ 500 vectors: 34.3 MBHNSW, 100 MB cache @ 1,000 vectors: 37.3 MBHNSW, 100 MB cache @ 10,000 vectors: 98.4 MBHNSW, 100 MB cache @ 50,000 vectors: 104 MBHNSW, 100 MB cache @ 100,000 vectors: 200.1 MBHNSW, 100 MB cache @ 500,000 vectors: 917.7 MBHNSW, 100 MB cache @ 1,000,000 vectors: 1.81k MB HNSW, 500 MB cache @ 500 vectors: 34.3 MBHNSW, 500 MB cache @ 1,000 vectors: 37.3 MBHNSW, 500 MB cache @ 10,000 vectors: 94.4 MBHNSW, 500 MB cache @ 50,000 vectors: 424.5 MBHNSW, 500 MB cache @ 100,000 vectors: 216.9 MBHNSW, 500 MB cache @ 500,000 vectors: 935.7 MBHNSW, 500 MB cache @ 1,000,000 vectors: 1.83k MB HNSW, 2000 MB cache @ 500 vectors: 34.4 MBHNSW, 2000 MB cache @ 1,000 vectors: 37.3 MBHNSW, 2000 MB cache @ 10,000 vectors: 94.4 MBHNSW, 2000 MB cache @ 50,000 vectors: 424.5 MBHNSW, 2000 MB cache @ 100,000 vectors: 816.6 MBHNSW, 2000 MB cache @ 500,000 vectors: 935.8 MBHNSW, 2000 MB cache @ 1,000,000 vectors: 1.83k MB

Warm memory

MB · ▼ lower is better · log scale

1 10 100 1k 10k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 3.66 MBMemory, 10 MB cache @ 1,000 vectors: 6.65 MBMemory, 10 MB cache @ 10,000 vectors: 60 MBMemory, 10 MB cache @ 50,000 vectors: 299.2 MBMemory, 10 MB cache @ 100,000 vectors: 598.5 MBMemory, 10 MB cache @ 500,000 vectors: 2.97k MBMemory, 10 MB cache @ 1,000,000 vectors: 5.93k MB Memory, 100 MB cache @ 500 vectors: 3.67 MBMemory, 100 MB cache @ 1,000 vectors: 6.64 MBMemory, 100 MB cache @ 10,000 vectors: 60 MBMemory, 100 MB cache @ 50,000 vectors: 299.2 MBMemory, 100 MB cache @ 100,000 vectors: 598.5 MBMemory, 100 MB cache @ 500,000 vectors: 2.97k MBMemory, 100 MB cache @ 1,000,000 vectors: 5.93k MB Memory, 500 MB cache @ 500 vectors: 3.66 MBMemory, 500 MB cache @ 1,000 vectors: 6.64 MBMemory, 500 MB cache @ 10,000 vectors: 60 MBMemory, 500 MB cache @ 50,000 vectors: 299.2 MBMemory, 500 MB cache @ 100,000 vectors: 598.5 MBMemory, 500 MB cache @ 500,000 vectors: 2.97k MBMemory, 500 MB cache @ 1,000,000 vectors: 5.93k MB Memory, 2000 MB cache @ 500 vectors: 3.67 MBMemory, 2000 MB cache @ 1,000 vectors: 6.63 MBMemory, 2000 MB cache @ 10,000 vectors: 60 MBMemory, 2000 MB cache @ 50,000 vectors: 299.2 MBMemory, 2000 MB cache @ 100,000 vectors: 598.4 MBMemory, 2000 MB cache @ 500,000 vectors: 2.97k MBMemory, 2000 MB cache @ 1,000,000 vectors: 5.93k MB IVS, 10 MB cache @ 500 vectors: 7.16 MBIVS, 10 MB cache @ 1,000 vectors: 13.1 MBIVS, 10 MB cache @ 10,000 vectors: 2.18 MBIVS, 10 MB cache @ 50,000 vectors: 7.86 MBIVS, 10 MB cache @ 100,000 vectors: 15.1 MBIVS, 10 MB cache @ 500,000 vectors: 33.8 MBIVS, 10 MB cache @ 1,000,000 vectors: 59.8 MB IVS, 100 MB cache @ 500 vectors: 7.16 MBIVS, 100 MB cache @ 1,000 vectors: 13.1 MBIVS, 100 MB cache @ 10,000 vectors: 60.9 MBIVS, 100 MB cache @ 50,000 vectors: 98.6 MBIVS, 100 MB cache @ 100,000 vectors: 106.2 MBIVS, 100 MB cache @ 500,000 vectors: 124.3 MBIVS, 100 MB cache @ 1,000,000 vectors: 148.4 MB IVS, 500 MB cache @ 500 vectors: 7.16 MBIVS, 500 MB cache @ 1,000 vectors: 13.1 MBIVS, 500 MB cache @ 10,000 vectors: 60.9 MBIVS, 500 MB cache @ 50,000 vectors: 302.5 MBIVS, 500 MB cache @ 100,000 vectors: 502 MBIVS, 500 MB cache @ 500,000 vectors: 519.3 MBIVS, 500 MB cache @ 1,000,000 vectors: 550.6 MB IVS, 2000 MB cache @ 500 vectors: 7.16 MBIVS, 2000 MB cache @ 1,000 vectors: 13.1 MBIVS, 2000 MB cache @ 10,000 vectors: 60.9 MBIVS, 2000 MB cache @ 50,000 vectors: 302.5 MBIVS, 2000 MB cache @ 100,000 vectors: 604.3 MBIVS, 2000 MB cache @ 500,000 vectors: 2.02k MBIVS, 2000 MB cache @ 1,000,000 vectors: 2.05k MB HNSW, 10 MB cache @ 500 vectors: 20.8 MBHNSW, 10 MB cache @ 1,000 vectors: 27 MBHNSW, 10 MB cache @ 10,000 vectors: 48.6 MBHNSW, 10 MB cache @ 50,000 vectors: 121.6 MBHNSW, 10 MB cache @ 100,000 vectors: 210.6 MBHNSW, 10 MB cache @ 500,000 vectors: 905.1 MBHNSW, 10 MB cache @ 1,000,000 vectors: 1.8k MB HNSW, 100 MB cache @ 500 vectors: 42.7 MBHNSW, 100 MB cache @ 1,000 vectors: 49 MBHNSW, 100 MB cache @ 10,000 vectors: 122.6 MBHNSW, 100 MB cache @ 50,000 vectors: 129.2 MBHNSW, 100 MB cache @ 100,000 vectors: 225.4 MBHNSW, 100 MB cache @ 500,000 vectors: 918.6 MBHNSW, 100 MB cache @ 1,000,000 vectors: 1.81k MB HNSW, 500 MB cache @ 500 vectors: 43.7 MBHNSW, 500 MB cache @ 1,000 vectors: 48 MBHNSW, 500 MB cache @ 10,000 vectors: 119.6 MBHNSW, 500 MB cache @ 50,000 vectors: 450.7 MBHNSW, 500 MB cache @ 100,000 vectors: 242.1 MBHNSW, 500 MB cache @ 500,000 vectors: 936.6 MBHNSW, 500 MB cache @ 1,000,000 vectors: 1.83k MB HNSW, 2000 MB cache @ 500 vectors: 43.7 MBHNSW, 2000 MB cache @ 1,000 vectors: 48 MBHNSW, 2000 MB cache @ 10,000 vectors: 119.6 MBHNSW, 2000 MB cache @ 50,000 vectors: 449.7 MBHNSW, 2000 MB cache @ 100,000 vectors: 841.9 MBHNSW, 2000 MB cache @ 500,000 vectors: 936.6 MBHNSW, 2000 MB cache @ 1,000,000 vectors: 1.83k MB

Working set

MB · ▼ lower is better · log scale

10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 14.2 MBMemory, 10 MB cache @ 1,000 vectors: 20.4 MBMemory, 10 MB cache @ 10,000 vectors: 327.1 MBMemory, 10 MB cache @ 50,000 vectors: 1.39k MBMemory, 10 MB cache @ 100,000 vectors: 2.89k MBMemory, 10 MB cache @ 500,000 vectors: 5.55k MBMemory, 10 MB cache @ 1,000,000 vectors: 8.22k MB Memory, 100 MB cache @ 500 vectors: 13.8 MBMemory, 100 MB cache @ 1,000 vectors: 19.2 MBMemory, 100 MB cache @ 10,000 vectors: 357.3 MBMemory, 100 MB cache @ 50,000 vectors: 1.39k MBMemory, 100 MB cache @ 100,000 vectors: 2.89k MBMemory, 100 MB cache @ 500,000 vectors: 5.56k MBMemory, 100 MB cache @ 1,000,000 vectors: 10.78k MB Memory, 500 MB cache @ 500 vectors: 13.9 MBMemory, 500 MB cache @ 1,000 vectors: 19.3 MBMemory, 500 MB cache @ 10,000 vectors: 358.2 MBMemory, 500 MB cache @ 50,000 vectors: 1.39k MBMemory, 500 MB cache @ 100,000 vectors: 2.89k MBMemory, 500 MB cache @ 500,000 vectors: 5.55k MBMemory, 500 MB cache @ 1,000,000 vectors: 11k MB Memory, 2000 MB cache @ 500 vectors: 13.3 MBMemory, 2000 MB cache @ 1,000 vectors: 19.9 MBMemory, 2000 MB cache @ 10,000 vectors: 357.3 MBMemory, 2000 MB cache @ 50,000 vectors: 1.39k MBMemory, 2000 MB cache @ 100,000 vectors: 2.89k MBMemory, 2000 MB cache @ 500,000 vectors: 5.56k MBMemory, 2000 MB cache @ 1,000,000 vectors: 11.33k MB IVS, 10 MB cache @ 500 vectors: 22.5 MBIVS, 10 MB cache @ 1,000 vectors: 27.7 MBIVS, 10 MB cache @ 10,000 vectors: 231.4 MBIVS, 10 MB cache @ 50,000 vectors: 1.51k MBIVS, 10 MB cache @ 100,000 vectors: 2.48k MBIVS, 10 MB cache @ 500,000 vectors: 9.07k MBIVS, 10 MB cache @ 1,000,000 vectors: 8.48k MB IVS, 100 MB cache @ 500 vectors: 19.5 MBIVS, 100 MB cache @ 1,000 vectors: 27.8 MBIVS, 100 MB cache @ 10,000 vectors: 73.5 MBIVS, 100 MB cache @ 50,000 vectors: 1.72k MBIVS, 100 MB cache @ 100,000 vectors: 3.23k MBIVS, 100 MB cache @ 500,000 vectors: 9.28k MBIVS, 100 MB cache @ 1,000,000 vectors: 8.27k MB IVS, 500 MB cache @ 500 vectors: 22.6 MBIVS, 500 MB cache @ 1,000 vectors: 27.8 MBIVS, 500 MB cache @ 10,000 vectors: 73.3 MBIVS, 500 MB cache @ 50,000 vectors: 765.4 MBIVS, 500 MB cache @ 100,000 vectors: 1.24k MBIVS, 500 MB cache @ 500,000 vectors: 9.75k MBIVS, 500 MB cache @ 1,000,000 vectors: 8.34k MB IVS, 2000 MB cache @ 500 vectors: 19.5 MBIVS, 2000 MB cache @ 1,000 vectors: 27.8 MBIVS, 2000 MB cache @ 10,000 vectors: 72.6 MBIVS, 2000 MB cache @ 50,000 vectors: 762.5 MBIVS, 2000 MB cache @ 100,000 vectors: 1.41k MBIVS, 2000 MB cache @ 500,000 vectors: 4.64k MBIVS, 2000 MB cache @ 1,000,000 vectors: 7.11k MB HNSW, 10 MB cache @ 500 vectors: 27.6 MBHNSW, 10 MB cache @ 1,000 vectors: 41.4 MBHNSW, 10 MB cache @ 10,000 vectors: 64.1 MBHNSW, 10 MB cache @ 50,000 vectors: 133.2 MBHNSW, 10 MB cache @ 100,000 vectors: 230.3 MBHNSW, 10 MB cache @ 500,000 vectors: 924.1 MBHNSW, 10 MB cache @ 1,000,000 vectors: 1.84k MB HNSW, 100 MB cache @ 500 vectors: 18.5 MBHNSW, 100 MB cache @ 1,000 vectors: 33.9 MBHNSW, 100 MB cache @ 10,000 vectors: 96.2 MBHNSW, 100 MB cache @ 50,000 vectors: 141.4 MBHNSW, 100 MB cache @ 100,000 vectors: 242 MBHNSW, 100 MB cache @ 500,000 vectors: 942.8 MBHNSW, 100 MB cache @ 1,000,000 vectors: 1.83k MB HNSW, 500 MB cache @ 500 vectors: 18.6 MBHNSW, 500 MB cache @ 1,000 vectors: 32.3 MBHNSW, 500 MB cache @ 10,000 vectors: 91.1 MBHNSW, 500 MB cache @ 50,000 vectors: 421.1 MBHNSW, 500 MB cache @ 100,000 vectors: 270 MBHNSW, 500 MB cache @ 500,000 vectors: 949.7 MBHNSW, 500 MB cache @ 1,000,000 vectors: 1.86k MB HNSW, 2000 MB cache @ 500 vectors: 18.8 MBHNSW, 2000 MB cache @ 1,000 vectors: 33.2 MBHNSW, 2000 MB cache @ 10,000 vectors: 93.3 MBHNSW, 2000 MB cache @ 50,000 vectors: 421 MBHNSW, 2000 MB cache @ 100,000 vectors: 827.2 MBHNSW, 2000 MB cache @ 500,000 vectors: 1.03k MBHNSW, 2000 MB cache @ 1,000,000 vectors: 1.86k MB

Disk

MB · ▼ lower is better · log scale

1 10 100 1k 10k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 2.94 MBMemory, 10 MB cache @ 1,000 vectors: 5.87 MBMemory, 10 MB cache @ 10,000 vectors: 58.7 MBMemory, 10 MB cache @ 50,000 vectors: 293.5 MBMemory, 10 MB cache @ 100,000 vectors: 587.1 MBMemory, 10 MB cache @ 500,000 vectors: 2.94k MBMemory, 10 MB cache @ 1,000,000 vectors: 5.87k MB Memory, 100 MB cache @ 500 vectors: 2.94 MBMemory, 100 MB cache @ 1,000 vectors: 5.87 MBMemory, 100 MB cache @ 10,000 vectors: 58.7 MBMemory, 100 MB cache @ 50,000 vectors: 293.5 MBMemory, 100 MB cache @ 100,000 vectors: 587.1 MBMemory, 100 MB cache @ 500,000 vectors: 2.94k MBMemory, 100 MB cache @ 1,000,000 vectors: 5.87k MB Memory, 500 MB cache @ 500 vectors: 2.94 MBMemory, 500 MB cache @ 1,000 vectors: 5.87 MBMemory, 500 MB cache @ 10,000 vectors: 58.7 MBMemory, 500 MB cache @ 50,000 vectors: 293.5 MBMemory, 500 MB cache @ 100,000 vectors: 587.1 MBMemory, 500 MB cache @ 500,000 vectors: 2.94k MBMemory, 500 MB cache @ 1,000,000 vectors: 5.87k MB Memory, 2000 MB cache @ 500 vectors: 2.94 MBMemory, 2000 MB cache @ 1,000 vectors: 5.87 MBMemory, 2000 MB cache @ 10,000 vectors: 58.7 MBMemory, 2000 MB cache @ 50,000 vectors: 293.5 MBMemory, 2000 MB cache @ 100,000 vectors: 587.1 MBMemory, 2000 MB cache @ 500,000 vectors: 2.94k MBMemory, 2000 MB cache @ 1,000,000 vectors: 5.87k MB IVS, 10 MB cache @ 500 vectors: 2.93 MBIVS, 10 MB cache @ 1,000 vectors: 5.86 MBIVS, 10 MB cache @ 10,000 vectors: 58.6 MBIVS, 10 MB cache @ 50,000 vectors: 293.7 MBIVS, 10 MB cache @ 100,000 vectors: 587.5 MBIVS, 10 MB cache @ 500,000 vectors: 2.94k MBIVS, 10 MB cache @ 1,000,000 vectors: 5.87k MB IVS, 100 MB cache @ 500 vectors: 2.93 MBIVS, 100 MB cache @ 1,000 vectors: 5.86 MBIVS, 100 MB cache @ 10,000 vectors: 58.6 MBIVS, 100 MB cache @ 50,000 vectors: 293.7 MBIVS, 100 MB cache @ 100,000 vectors: 587.5 MBIVS, 100 MB cache @ 500,000 vectors: 2.94k MBIVS, 100 MB cache @ 1,000,000 vectors: 5.87k MB IVS, 500 MB cache @ 500 vectors: 2.93 MBIVS, 500 MB cache @ 1,000 vectors: 5.86 MBIVS, 500 MB cache @ 10,000 vectors: 58.6 MBIVS, 500 MB cache @ 50,000 vectors: 293.7 MBIVS, 500 MB cache @ 100,000 vectors: 587.5 MBIVS, 500 MB cache @ 500,000 vectors: 2.94k MBIVS, 500 MB cache @ 1,000,000 vectors: 5.87k MB IVS, 2000 MB cache @ 500 vectors: 2.93 MBIVS, 2000 MB cache @ 1,000 vectors: 5.86 MBIVS, 2000 MB cache @ 10,000 vectors: 58.6 MBIVS, 2000 MB cache @ 50,000 vectors: 293.7 MBIVS, 2000 MB cache @ 100,000 vectors: 587.5 MBIVS, 2000 MB cache @ 500,000 vectors: 2.94k MBIVS, 2000 MB cache @ 1,000,000 vectors: 5.87k MB HNSW, 10 MB cache @ 500 vectors: 3.8 MBHNSW, 10 MB cache @ 1,000 vectors: 7.6 MBHNSW, 10 MB cache @ 10,000 vectors: 76 MBHNSW, 10 MB cache @ 50,000 vectors: 379.8 MBHNSW, 10 MB cache @ 100,000 vectors: 759.6 MBHNSW, 10 MB cache @ 500,000 vectors: 3.8k MBHNSW, 10 MB cache @ 1,000,000 vectors: 7.6k MB HNSW, 100 MB cache @ 500 vectors: 3.8 MBHNSW, 100 MB cache @ 1,000 vectors: 7.6 MBHNSW, 100 MB cache @ 10,000 vectors: 76 MBHNSW, 100 MB cache @ 50,000 vectors: 379.8 MBHNSW, 100 MB cache @ 100,000 vectors: 759.6 MBHNSW, 100 MB cache @ 500,000 vectors: 3.8k MBHNSW, 100 MB cache @ 1,000,000 vectors: 7.6k MB HNSW, 500 MB cache @ 500 vectors: 3.8 MBHNSW, 500 MB cache @ 1,000 vectors: 7.6 MBHNSW, 500 MB cache @ 10,000 vectors: 76 MBHNSW, 500 MB cache @ 50,000 vectors: 379.8 MBHNSW, 500 MB cache @ 100,000 vectors: 759.6 MBHNSW, 500 MB cache @ 500,000 vectors: 3.8k MBHNSW, 500 MB cache @ 1,000,000 vectors: 7.6k MB HNSW, 2000 MB cache @ 500 vectors: 3.8 MBHNSW, 2000 MB cache @ 1,000 vectors: 7.6 MBHNSW, 2000 MB cache @ 10,000 vectors: 76 MBHNSW, 2000 MB cache @ 50,000 vectors: 379.8 MBHNSW, 2000 MB cache @ 100,000 vectors: 759.6 MBHNSW, 2000 MB cache @ 500,000 vectors: 3.8k MBHNSW, 2000 MB cache @ 1,000,000 vectors: 7.6k MB

Raw numbers

EngineVectorsCache MBIndex
inserts/s
Update
updates/s
Remove
removes/s
Mixed
ops/s
Top10
queries/s
Top100
queries/s
NoFloor
queries/s
Filter
queries/s
Recall
%
Filter recall
%
Save
ms
Flush
ms
Open
ms
Cold search
ms
Memory
MB
Warm memory
MB
Working set
MB
Disk
MB
Memory5001034.51k1.42M26.46M16.14k4.68k3.93k13.16k10.98k10010013.510.70.212.993.6614.22.94
IVS5001027.72k1.28M9.31M11.76k8.21k9.25k11.27k11.24k1001008.9325.70.861.573.017.1622.52.93
HNSW500107.36k1.82k7.75M1.18k1.66k2.05k2.06k2.15k1001005.784.768.42.4410.420.827.63.8
Memory50010034.92k1.47M33.78M16.17k2.38k8.51k13.03k11.09k10010013.910.70.242.993.6713.82.94
IVS50010023.94k973.14k13.12M11.78k8.71k10.11k11.03k12.52k1001008.3915.60.811.633.017.1619.52.93
HNSW5001007.04k1.91k21.1M4.71k11.41k12.27k12.84k20.63k1001006.474.4910.40.2334.342.718.53.8
Memory50050036.03k1.39M30.3M16.38k9.68k8.49k12.06k11.21k10010013.3120.242.993.6613.92.94
IVS50050023.86k1.32M12.47M11.35k8.42k8.93k10.86k10.82k1001008.7216.20.81.493.017.1622.62.93
HNSW5005007.26k1.87k20.33M4.72k4.88k11.02k13.36k19.68k1001006.014.829.520.234.343.718.63.8
Memory500200034.71k1.49M34.01M16.18k2.22k4.14k10.26k11.07k10010012.89.650.22.993.6713.32.94
IVS500200025.68k1.37M12.79M12.04k8.16k10.2k9.53k12.57k10010011.220.50.791.723.017.1619.52.93
HNSW50020007.29k1.88k19.92M4.63k11.71k10.48k12.62k20.11k1001005.464.9612.20.234.443.718.83.8
Memory1,0001037.88k1.39M32.47M13.56k1.69k7.15k9.23k9.04k10010019.610.50.35.976.6520.45.87
IVS1,0001042.89k914.49k15.22M7.47k5.13k5.49k6.83k6.83k1001007.48180.791.536.0213.127.75.86
HNSW1,000107.95k2.13k5.74M690.71.15k1.16k1.19k1.25k1001005.753.316.653.4313.62741.47.6
Memory1,00010039.92k1.46M33.56M13.61k4.09k4.01k9.14k9.27k10010019.614.90.185.976.6419.25.87
IVS1,00010039.37k1.04M16.37M8.02k5.48k4.94k6.53k6.81k1001007.7115.10.821.66.0213.127.85.86
HNSW1,0001008.76k2.18k7.75M6.18k6.01k11.72k9.51k17.63k1001006.95.4610.20.237.34933.97.6
Memory1,00050039.83k1.51M31.85M13.44k3.17k4.74k9.16k9.18k10010020.111.90.225.976.6419.35.87
IVS1,00050044.66k1.28M16.21M7.72k5.7k5.66k6.75k6.68k1001008.7815.80.781.526.0213.127.85.86
HNSW1,0005009.52k2.17k7.67M6.09k8.18k10.22k10.07k16.14k1001006.674.5914.90.1937.34832.37.6
Memory1,000200038.27k1.33M31.75M13.19k4.21k4.05k6.4k8.59k10010019.611.50.215.976.6319.95.87
IVS1,000200045.41k1.21M16.26M8.09k5.31k5.57k5.98k6.11k1001008.6519.10.771.466.0213.127.85.86
HNSW1,00020009.53k2.12k10.02M5.98k5.21k11.66k10.42k16.74k1001006.245.069.020.237.34833.27.6
Memory10,0001045k1.4M45.25M2.15k1.27k1.4k1.27k1.48k100100142.9632.1659.360327.158.7
IVS10,00010136.08k481.15k15M12475.9767575.41001008.3216.31.4113.30.992.18231.458.6
HNSW10,000107.81k2.86k2.94M1.63k1.1k102.31.12k95.499.410025.34.0810.11.5524.448.664.176
Memory10,00010045.34k1.44M45.35M2.17k1.23k1.4k1.27k1.32k100100147.964.31.8559.360357.358.7
IVS10,000100131.14k1.31M17.29M904.7698.7784.2770.4835.210010010.415.61.0712.90.9960.973.558.6
HNSW10,00010011.03k2.96k2.75M1.75k5.97k1.6k7.19k796.810010024.45.21170.2698.4122.696.276
Memory10,00050047.68k1.4M44.64M2.17k1.17k1.37k1.27k1.38k100100145.562.61.459.360358.258.7
IVS10,000500117.49k1.23M16.86M908.9699.4814.3808.8811.91001008.59161.0713.50.9960.973.358.6
HNSW10,00050010.13k2.96k3.16M5.75k6.07k1.66k7.43k808.210010025.15.7120.70.2694.4119.691.176
Memory10,000200047.97k1.39M47.51M2.15k1.2k1.4k1.23k1.38k100100129.263.31.1159.360357.358.7
IVS10,0002000119.07k1.39M18.25M895.3768.4786.6809.6816.61001009.4816.11.2413.80.9960.972.658.6
HNSW10,00020009.51k2.94k2.66M5.63k6.18k1.62k7.15k857.199.610025.36.1720.40.2694.4119.693.376
Memory50,0001061.75k915.16k18.76M361.3220.3220.8217.2219.9100100522.2386.45.88296.1299.21.39k293.5
IVS50,0001027.01k1M13.09M104.364.265.263.162.510094.826.954.22.9315.93.277.861.51k293.7
HNSW50,0001012.25k2.24k5.84M1.57k1.17k122.51.13k41.29999.4103.86.2823.11.0597.4121.6133.2379.8
Memory50,00010062.24k812.71k18.08M359.8221.9218.2213.7220.3100100520.1411.15.33296.1299.21.39k293.5
IVS50,00010027.99k875.47k9.53M14591.888.189.29110094.826.454.33.0115.53.2798.61.72k293.7
HNSW50,00010014.42k2.4k4.92M1.6k1.17k123.41.14k42.399.699.4104.49.73321.07104129.2141.4379.8
Memory50,00050062.01k873.32k18.99M362.3221.7217.2216.3219.8100100537.6382.55.21296.1299.21.39k293.5
IVS50,00050030.87k1.36M13.41M862.7715.3796.7755.7777.210094.832.835.62.9917.93.27302.5765.4293.7
HNSW50,00050015.87k2.41k5.57M5.22k6.8k696.67.67k301.910099.3107.19.6885.20.21424.5450.7421.1379.8
Memory50,000200061.67k907.65k18.62M361.5219.3220.3215.1222.2100100518.13795.45296.1299.21.39k293.5
IVS50,000200033.43k1.28M12.43M861.3693.6792.5750.9830.710094.829.336.23.2216.33.27302.5762.5293.7
HNSW50,000200015.5k2.4k5.72M5.21k6.22k693.36.85k301.399.899.4104.89.6681.30.23424.5449.7421379.8
Memory100,0001073.6k904.08k14.98M184.2111.1110.9109.6111.81001001.05k642.610.3592.4598.52.89k587.1
IVS100,0001028.89k1.02M8.52M57.234.834.834.634.6100100268.2840.78.2229.26.2915.12.48k587.5
HNSW100,0001012.52k1.89k4.95M1.45k1.09k127.21.12k20.610097.9197.18.45501.34185.3210.6230.3759.6
Memory100,00010073.92k901.92k14.81M183.9111.7111.2109.5111.71001001.07k629.512.2592.4598.52.89k587.1
IVS100,00010019.45k952.11k10.19M66.240.439.840.140.5100100404.61.08k9.3229.46.29106.23.23k587.5
HNSW100,00010015.36k1.89k4.88M1.44k1.1k1281.11k20.110099.9218.511.549.41.25200.1225.4242759.6
Memory100,00050073.59k1.14M18.83M185.5112.8111.9112103.41001001.03k700.913.6592.4598.52.89k587.1
IVS100,00050029.29k1.25M11.22M231.3157.3157.1156.1158100100363.11.08k8.230.46.295021.24k587.5
HNSW100,00050015.49k1.9k4.92M1.48k1.12k126.81.11k2010099.9201.315.1461.19216.9242.1270759.6
Memory100,000200074.92k1.38M18.05M186.6113.3112.6111.5113.51001001.05k71012.2592.4598.42.89k587.1
IVS100,000200029.06k1.41M11.76M552.9414.4412396.6421.6100100365.91.07k7.8827.16.29604.31.41k587.5
HNSW100,000200015.63k1.91k5.06M3.99k6.05k771.75.81k188.210099.9197.214.9153.60.3816.6841.9827.2759.6
Memory500,0001081.23k1.14M15.75M37.422.622.622.422.21001005.16k2.48k44.42.96k2.97k5.55k2.94k
IVS500,0001024.08k1.35M7.97M11.67.037.036.986.8810010030.462.445.7128.226.433.89.07k2.94k
HNSW500,000109.42k1.2k3.23M1.08k904.5124.8894.669.484.689.1295.636.3171.91.87904.2905.1924.13.8k
Memory500,00010080.96k1.29M15.38M37.9232322.7231001005.09k2.53k45.42.96k2.97k5.56k2.94k
IVS500,00010024.31k1.1M7.83M11.77.077.057.067.0110010030.760.744.7130.626.4124.39.28k2.94k
HNSW500,00010011.08k1.2k4.21M1.08k893.4126887.17080.887.1302.744.3176.11.46917.7918.6942.83.8k
Memory500,00050080.78k1.35M15.07M37.522.92322.7231001005.07k2.57k44.32.96k2.97k5.55k2.94k
IVS500,00050024.44k1.29M7.38M13.37.67.87.827.9810010044.778.845.2128.526.4519.39.75k2.94k
HNSW500,00050011.35k1.21k3.44M1.08k884.1124.7896.570.486.887.2272.617.8182.81.47935.7936.6949.73.8k
Memory500,000200081.09k1.1M14.99M37.9232322.7231001005.03k2.56k472.96k2.97k5.56k2.94k
IVS500,000200024.68k1.3M7.95M29.717.417.517.517.410010047.473.645.5125.726.42.02k4.64k2.94k
HNSW500,000200011.37k1.21k3.85M1.07k880.6125.6897.269.684.487.1302.850.3179.71.73935.8936.61.03k3.8k
Memory1,000,0001080.6k1.1M14.37M1911.411.311.211.210010010.64k5.61k87.65.92k5.93k8.22k5.87k
IVS1,000,0001013.55k882.18k7.42M5.273.43.333.393.2410010039.398.375.5355.153.559.88.48k5.87k
HNSW1,000,000108.1k1.12k3.84M993.8786115.7825.24774.887.7240.46.323301.661.8k1.8k1.84k7.6k
Memory1,000,00010080.41k1.1M14.27M19.310.911.311.511.610010010.17k7.15k93.75.92k5.93k10.78k5.87k
IVS1,000,00010015.29k1.22M7.74M5.743.513.493.473.48100100162.8194.868.3281.253.5148.48.27k5.87k
HNSW1,000,0001009.5k1.13k3.65M981.9806.7110.7814.344.474.687.7293.150.8326.11.921.81k1.81k1.83k7.6k
Memory1,000,00050080.07k1.18M14.15M19.311.411.411.511.510010010.15k6.08k90.95.92k5.93k11k5.87k
IVS1,000,00050015.67k1M6.39M6.083.563.563.563.6110010037.786.973.128753.5550.68.34k5.87k
HNSW1,000,0005009.65k1.13k3.81M981.2809.1114.8810.346.277.289.626346327.41.671.83k1.83k1.86k7.6k
Memory1,000,000200080.77k1.1M14.62M19.311.411.511.211.510010010.25k6.45k114.75.92k5.93k11.33k5.87k
IVS1,000,000200011.46k810.67k6.92M7.794.554.584.624.7210010027.79370.7289.953.52.05k7.11k5.87k
HNSW1,000,00020009.54k1.08k4M969779.5109.4778.644.977.289.6292.751.1320.32.061.83k1.83k1.86k7.6k