Vector index matrix sweep

84 benchmark runs, one per (engine × corpus size × cache budget), each in its own process so its memory numbers are its own. Generated 2026-08-17 08:44.

Vectors (X axis)500, 1,000, 10,000, 50,000, 100,000, 500,000, 1,000,000
Cache budgets10 MB, 100 MB, 500 MB, 2000 MB
EnginesMemory, IVS, HNSW
Dimensions1536
Vector distribution200 cluster centers, noise 1
State save every5,000 vectors
IVS accuracy0.25 of clusters probed per search
HNSW dialsm 16, efConstruction 128, efSearch 64
Search phasesmeasured

Summary

Engine Indexing
▲ more is more stars
Memory use
▼ less is more stars
Search
▲ more is more stars
Memory ★★★★★58.79k inserts/s ★★164.4 MB ★★★268.6 queries/s
IVS ★★★★33.09k inserts/s ★★★★★6.56 MB ★★★203.9 queries/s
HNSW ★★4.12k inserts/s ★★112.4 MB ★★★★★1.63k queries/s

More stars is better in every column: five stars goes to the best engine in it — the fastest, or the one holding the least memory — and every factor of ten behind that costs two stars, down to one. The number beside the stars is the geometric mean over that engine's runs (indexing: vectors indexed per second, including the state save; memory use: managed heap held after the load, so fewer MB earns more stars; search: Top10 queries per second), which is the average that suits values differing by factors. A verdict this compact hides the trade the charts below show: read them together.

Engines

EngineWhat it is
Memoryall vectors on the managed heap, every search an exact SIMD scan (Relatude.DB.DataStoreLocal)
IVSdisk segments, IVF clusters, cached blocks; searches the nearest clusters only (Relatude.DB.VectorIndex)
HNSWthe HNSW graph resident in flat int8 arenas, floats mirrored or read only to re-score (Relatude.DB.VectorIndex)

How to read the charts

One chart per measurement. The X axis is the number of vectors indexed, the Y axis the measurement's own unit. Each line is one engine at one cache budget: colour is the engine, dash pattern is the cache budget — the tightest dashes are the smallest budget, a solid line the largest. Hover any point for its exact value.

engineMemoryIVSHNSW
cache10 MB100 MB500 MB2000 MB

Every chart says under its title whether higher or lower is better, and the Y axes are logarithmic except for the percentages — the engines sit orders of magnitude apart, so on these axes an equal distance is an equal factor. A missing point is a failed or unsupported run, never a zero. The in-memory index has no cache budget to spend, so its dashed variants lie on top of each other by design: it is the reference the others are read against.

Writes

Index

inserts/s · ▲ higher is better · log scale

10 100 1k 10k 100k 1M 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 34.23k inserts/sMemory, 10 MB cache @ 1,000 vectors: 40.31k inserts/sMemory, 10 MB cache @ 10,000 vectors: 53.11k inserts/sMemory, 10 MB cache @ 50,000 vectors: 65.76k inserts/sMemory, 10 MB cache @ 100,000 vectors: 77.96k inserts/sMemory, 10 MB cache @ 500,000 vectors: 83.38k inserts/sMemory, 10 MB cache @ 1,000,000 vectors: 83.37k inserts/s Memory, 100 MB cache @ 500 vectors: 35.85k inserts/sMemory, 100 MB cache @ 1,000 vectors: 36.19k inserts/sMemory, 100 MB cache @ 10,000 vectors: 53.9k inserts/sMemory, 100 MB cache @ 50,000 vectors: 64.98k inserts/sMemory, 100 MB cache @ 100,000 vectors: 78.8k inserts/sMemory, 100 MB cache @ 500,000 vectors: 81.63k inserts/sMemory, 100 MB cache @ 1,000,000 vectors: 74.07k inserts/s Memory, 500 MB cache @ 500 vectors: 34.32k inserts/sMemory, 500 MB cache @ 1,000 vectors: 37.83k inserts/sMemory, 500 MB cache @ 10,000 vectors: 52.18k inserts/sMemory, 500 MB cache @ 50,000 vectors: 62.13k inserts/sMemory, 500 MB cache @ 100,000 vectors: 78.83k inserts/sMemory, 500 MB cache @ 500,000 vectors: 81.75k inserts/sMemory, 500 MB cache @ 1,000,000 vectors: 77.97k inserts/s Memory, 2000 MB cache @ 500 vectors: 36.15k inserts/sMemory, 2000 MB cache @ 1,000 vectors: 38.46k inserts/sMemory, 2000 MB cache @ 10,000 vectors: 54.04k inserts/sMemory, 2000 MB cache @ 50,000 vectors: 75.34k inserts/sMemory, 2000 MB cache @ 100,000 vectors: 76.42k inserts/sMemory, 2000 MB cache @ 500,000 vectors: 83.43k inserts/sMemory, 2000 MB cache @ 1,000,000 vectors: 80.34k inserts/s IVS, 10 MB cache @ 500 vectors: 24.53k inserts/sIVS, 10 MB cache @ 1,000 vectors: 43.8k inserts/sIVS, 10 MB cache @ 10,000 vectors: 112.91k inserts/sIVS, 10 MB cache @ 50,000 vectors: 30.33k inserts/sIVS, 10 MB cache @ 100,000 vectors: 27.87k inserts/sIVS, 10 MB cache @ 500,000 vectors: 23.52k inserts/sIVS, 10 MB cache @ 1,000,000 vectors: 15.29k inserts/s IVS, 100 MB cache @ 500 vectors: 23.26k inserts/sIVS, 100 MB cache @ 1,000 vectors: 45.34k inserts/sIVS, 100 MB cache @ 10,000 vectors: 135.59k inserts/sIVS, 100 MB cache @ 50,000 vectors: 28.38k inserts/sIVS, 100 MB cache @ 100,000 vectors: 29.02k inserts/sIVS, 100 MB cache @ 500,000 vectors: 25.47k inserts/sIVS, 100 MB cache @ 1,000,000 vectors: 13.25k inserts/s IVS, 500 MB cache @ 500 vectors: 26.22k inserts/sIVS, 500 MB cache @ 1,000 vectors: 45.13k inserts/sIVS, 500 MB cache @ 10,000 vectors: 137.53k inserts/sIVS, 500 MB cache @ 50,000 vectors: 29.33k inserts/sIVS, 500 MB cache @ 100,000 vectors: 29.37k inserts/sIVS, 500 MB cache @ 500,000 vectors: 24.16k inserts/sIVS, 500 MB cache @ 1,000,000 vectors: 14.94k inserts/s IVS, 2000 MB cache @ 500 vectors: 24.76k inserts/sIVS, 2000 MB cache @ 1,000 vectors: 46.74k inserts/sIVS, 2000 MB cache @ 10,000 vectors: 113.14k inserts/sIVS, 2000 MB cache @ 50,000 vectors: 33.49k inserts/sIVS, 2000 MB cache @ 100,000 vectors: 28.57k inserts/sIVS, 2000 MB cache @ 500,000 vectors: 25.25k inserts/sIVS, 2000 MB cache @ 1,000,000 vectors: 15.16k inserts/s HNSW, 10 MB cache @ 500 vectors: 1.5k inserts/sHNSW, 10 MB cache @ 1,000 vectors: 1.34k inserts/sHNSW, 10 MB cache @ 10,000 vectors: 271.5 inserts/sHNSW, 10 MB cache @ 50,000 vectors: 159 inserts/sHNSW, 10 MB cache @ 100,000 vectors: 144.4 inserts/sHNSW, 10 MB cache @ 500,000 vectors: 70.1 inserts/sHNSW, 10 MB cache @ 1,000,000 vectors: 51.3 inserts/s HNSW, 100 MB cache @ 500 vectors: 6.92k inserts/sHNSW, 100 MB cache @ 1,000 vectors: 9.21k inserts/sHNSW, 100 MB cache @ 10,000 vectors: 9.58k inserts/sHNSW, 100 MB cache @ 50,000 vectors: 14.46k inserts/sHNSW, 100 MB cache @ 100,000 vectors: 14.81k inserts/sHNSW, 100 MB cache @ 500,000 vectors: 11.07k inserts/sHNSW, 100 MB cache @ 1,000,000 vectors: 9.16k inserts/s HNSW, 500 MB cache @ 500 vectors: 6.8k inserts/sHNSW, 500 MB cache @ 1,000 vectors: 9.14k inserts/sHNSW, 500 MB cache @ 10,000 vectors: 10.32k inserts/sHNSW, 500 MB cache @ 50,000 vectors: 15.92k inserts/sHNSW, 500 MB cache @ 100,000 vectors: 15.49k inserts/sHNSW, 500 MB cache @ 500,000 vectors: 11.33k inserts/sHNSW, 500 MB cache @ 1,000,000 vectors: 9.44k inserts/s HNSW, 2000 MB cache @ 500 vectors: 6.87k inserts/sHNSW, 2000 MB cache @ 1,000 vectors: 9.05k inserts/sHNSW, 2000 MB cache @ 10,000 vectors: 10.14k inserts/sHNSW, 2000 MB cache @ 50,000 vectors: 15.53k inserts/sHNSW, 2000 MB cache @ 100,000 vectors: 15.62k inserts/sHNSW, 2000 MB cache @ 500,000 vectors: 11.28k inserts/sHNSW, 2000 MB cache @ 1,000,000 vectors: 9.37k inserts/s

Update

updates/s · ▲ higher is better · log scale

10 100 1k 10k 100k 1M 10M 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 1.25M updates/sMemory, 10 MB cache @ 1,000 vectors: 1.59M updates/sMemory, 10 MB cache @ 10,000 vectors: 1.46M updates/sMemory, 10 MB cache @ 50,000 vectors: 888.81k updates/sMemory, 10 MB cache @ 100,000 vectors: 1.41M updates/sMemory, 10 MB cache @ 500,000 vectors: 1.35M updates/sMemory, 10 MB cache @ 1,000,000 vectors: 1.33M updates/s Memory, 100 MB cache @ 500 vectors: 1.52M updates/sMemory, 100 MB cache @ 1,000 vectors: 1.52M updates/sMemory, 100 MB cache @ 10,000 vectors: 1.24M updates/sMemory, 100 MB cache @ 50,000 vectors: 1.37M updates/sMemory, 100 MB cache @ 100,000 vectors: 1.42M updates/sMemory, 100 MB cache @ 500,000 vectors: 1.44M updates/sMemory, 100 MB cache @ 1,000,000 vectors: 1.33M updates/s Memory, 500 MB cache @ 500 vectors: 1.38M updates/sMemory, 500 MB cache @ 1,000 vectors: 1.47M updates/sMemory, 500 MB cache @ 10,000 vectors: 1.28M updates/sMemory, 500 MB cache @ 50,000 vectors: 1.34M updates/sMemory, 500 MB cache @ 100,000 vectors: 1.37M updates/sMemory, 500 MB cache @ 500,000 vectors: 1.35M updates/sMemory, 500 MB cache @ 1,000,000 vectors: 881.21k updates/s Memory, 2000 MB cache @ 500 vectors: 1.42M updates/sMemory, 2000 MB cache @ 1,000 vectors: 1.58M updates/sMemory, 2000 MB cache @ 10,000 vectors: 1.41M updates/sMemory, 2000 MB cache @ 50,000 vectors: 1.41M updates/sMemory, 2000 MB cache @ 100,000 vectors: 1.41M updates/sMemory, 2000 MB cache @ 500,000 vectors: 1.48M updates/sMemory, 2000 MB cache @ 1,000,000 vectors: 871.54k updates/s IVS, 10 MB cache @ 500 vectors: 1.18M updates/sIVS, 10 MB cache @ 1,000 vectors: 1.39M updates/sIVS, 10 MB cache @ 10,000 vectors: 473.22k updates/sIVS, 10 MB cache @ 50,000 vectors: 985.17k updates/sIVS, 10 MB cache @ 100,000 vectors: 1.37M updates/sIVS, 10 MB cache @ 500,000 vectors: 1.33M updates/sIVS, 10 MB cache @ 1,000,000 vectors: 1.32M updates/s IVS, 100 MB cache @ 500 vectors: 1.49M updates/sIVS, 100 MB cache @ 1,000 vectors: 1.33M updates/sIVS, 100 MB cache @ 10,000 vectors: 1.36M updates/sIVS, 100 MB cache @ 50,000 vectors: 1.38M updates/sIVS, 100 MB cache @ 100,000 vectors: 1.27M updates/sIVS, 100 MB cache @ 500,000 vectors: 1.34M updates/sIVS, 100 MB cache @ 1,000,000 vectors: 891.23k updates/s IVS, 500 MB cache @ 500 vectors: 1.41M updates/sIVS, 500 MB cache @ 1,000 vectors: 1.22M updates/sIVS, 500 MB cache @ 10,000 vectors: 1.38M updates/sIVS, 500 MB cache @ 50,000 vectors: 1.3M updates/sIVS, 500 MB cache @ 100,000 vectors: 1.37M updates/sIVS, 500 MB cache @ 500,000 vectors: 1.34M updates/sIVS, 500 MB cache @ 1,000,000 vectors: 899.73k updates/s IVS, 2000 MB cache @ 500 vectors: 1.29M updates/sIVS, 2000 MB cache @ 1,000 vectors: 1.39M updates/sIVS, 2000 MB cache @ 10,000 vectors: 1.45M updates/sIVS, 2000 MB cache @ 50,000 vectors: 1.41M updates/sIVS, 2000 MB cache @ 100,000 vectors: 1.44M updates/sIVS, 2000 MB cache @ 500,000 vectors: 1.29M updates/sIVS, 2000 MB cache @ 1,000,000 vectors: 982.17k updates/s HNSW, 10 MB cache @ 500 vectors: 1.72k updates/sHNSW, 10 MB cache @ 1,000 vectors: 2.56k updates/sHNSW, 10 MB cache @ 10,000 vectors: 133 updates/sHNSW, 10 MB cache @ 50,000 vectors: 227.9 updates/sHNSW, 10 MB cache @ 100,000 vectors: 159.2 updates/sHNSW, 10 MB cache @ 500,000 vectors: 54.9 updates/sHNSW, 10 MB cache @ 1,000,000 vectors: 42.3 updates/s HNSW, 100 MB cache @ 500 vectors: 1.92k updates/sHNSW, 100 MB cache @ 1,000 vectors: 2.16k updates/sHNSW, 100 MB cache @ 10,000 vectors: 3.08k updates/sHNSW, 100 MB cache @ 50,000 vectors: 2.41k updates/sHNSW, 100 MB cache @ 100,000 vectors: 1.95k updates/sHNSW, 100 MB cache @ 500,000 vectors: 1.23k updates/sHNSW, 100 MB cache @ 1,000,000 vectors: 1.12k updates/s HNSW, 500 MB cache @ 500 vectors: 1.85k updates/sHNSW, 500 MB cache @ 1,000 vectors: 2.24k updates/sHNSW, 500 MB cache @ 10,000 vectors: 3.11k updates/sHNSW, 500 MB cache @ 50,000 vectors: 2.49k updates/sHNSW, 500 MB cache @ 100,000 vectors: 1.97k updates/sHNSW, 500 MB cache @ 500,000 vectors: 1.2k updates/sHNSW, 500 MB cache @ 1,000,000 vectors: 1.12k updates/s HNSW, 2000 MB cache @ 500 vectors: 1.94k updates/sHNSW, 2000 MB cache @ 1,000 vectors: 2.21k updates/sHNSW, 2000 MB cache @ 10,000 vectors: 3.05k updates/sHNSW, 2000 MB cache @ 50,000 vectors: 2.53k updates/sHNSW, 2000 MB cache @ 100,000 vectors: 1.88k updates/sHNSW, 2000 MB cache @ 500,000 vectors: 1.22k updates/sHNSW, 2000 MB cache @ 1,000,000 vectors: 1.12k updates/s

Remove

removes/s · ▲ higher is better · log scale

1M 10M 100M 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 30.86M removes/sMemory, 10 MB cache @ 1,000 vectors: 32.47M removes/sMemory, 10 MB cache @ 10,000 vectors: 40.9M removes/sMemory, 10 MB cache @ 50,000 vectors: 18.35M removes/sMemory, 10 MB cache @ 100,000 vectors: 18.28M removes/sMemory, 10 MB cache @ 500,000 vectors: 11.95M removes/sMemory, 10 MB cache @ 1,000,000 vectors: 12.74M removes/s Memory, 100 MB cache @ 500 vectors: 31.06M removes/sMemory, 100 MB cache @ 1,000 vectors: 33.56M removes/sMemory, 100 MB cache @ 10,000 vectors: 25.74M removes/sMemory, 100 MB cache @ 50,000 vectors: 13.57M removes/sMemory, 100 MB cache @ 100,000 vectors: 10.12M removes/sMemory, 100 MB cache @ 500,000 vectors: 12.51M removes/sMemory, 100 MB cache @ 1,000,000 vectors: 4.23M removes/s Memory, 500 MB cache @ 500 vectors: 30.49M removes/sMemory, 500 MB cache @ 1,000 vectors: 28.49M removes/sMemory, 500 MB cache @ 10,000 vectors: 32.73M removes/sMemory, 500 MB cache @ 50,000 vectors: 21.57M removes/sMemory, 500 MB cache @ 100,000 vectors: 15.79M removes/sMemory, 500 MB cache @ 500,000 vectors: 16.45M removes/sMemory, 500 MB cache @ 1,000,000 vectors: 4.58M removes/s Memory, 2000 MB cache @ 500 vectors: 29.94M removes/sMemory, 2000 MB cache @ 1,000 vectors: 33.22M removes/sMemory, 2000 MB cache @ 10,000 vectors: 30.26M removes/sMemory, 2000 MB cache @ 50,000 vectors: 20.12M removes/sMemory, 2000 MB cache @ 100,000 vectors: 16.57M removes/sMemory, 2000 MB cache @ 500,000 vectors: 15.05M removes/sMemory, 2000 MB cache @ 1,000,000 vectors: 4.59M removes/s IVS, 10 MB cache @ 500 vectors: 12.08M removes/sIVS, 10 MB cache @ 1,000 vectors: 14.06M removes/sIVS, 10 MB cache @ 10,000 vectors: 15.29M removes/sIVS, 10 MB cache @ 50,000 vectors: 12.63M removes/sIVS, 10 MB cache @ 100,000 vectors: 10.67M removes/sIVS, 10 MB cache @ 500,000 vectors: 8.11M removes/sIVS, 10 MB cache @ 1,000,000 vectors: 7.86M removes/s IVS, 100 MB cache @ 500 vectors: 12.08M removes/sIVS, 100 MB cache @ 1,000 vectors: 7.03M removes/sIVS, 100 MB cache @ 10,000 vectors: 16.75M removes/sIVS, 100 MB cache @ 50,000 vectors: 12.75M removes/sIVS, 100 MB cache @ 100,000 vectors: 5.13M removes/sIVS, 100 MB cache @ 500,000 vectors: 8.23M removes/sIVS, 100 MB cache @ 1,000,000 vectors: 6.81M removes/s IVS, 500 MB cache @ 500 vectors: 12.72M removes/sIVS, 500 MB cache @ 1,000 vectors: 16.16M removes/sIVS, 500 MB cache @ 10,000 vectors: 18.66M removes/sIVS, 500 MB cache @ 50,000 vectors: 12.9M removes/sIVS, 500 MB cache @ 100,000 vectors: 10.24M removes/sIVS, 500 MB cache @ 500,000 vectors: 8.18M removes/sIVS, 500 MB cache @ 1,000,000 vectors: 7.54M removes/s IVS, 2000 MB cache @ 500 vectors: 13.16M removes/sIVS, 2000 MB cache @ 1,000 vectors: 7.96M removes/sIVS, 2000 MB cache @ 10,000 vectors: 18.28M removes/sIVS, 2000 MB cache @ 50,000 vectors: 8.96M removes/sIVS, 2000 MB cache @ 100,000 vectors: 11.04M removes/sIVS, 2000 MB cache @ 500,000 vectors: 5M removes/sIVS, 2000 MB cache @ 1,000,000 vectors: 6.57M removes/s HNSW, 10 MB cache @ 500 vectors: 3.39M removes/sHNSW, 10 MB cache @ 1,000 vectors: 2.35M removes/sHNSW, 10 MB cache @ 10,000 vectors: 2.85M removes/sHNSW, 10 MB cache @ 50,000 vectors: 4.29M removes/sHNSW, 10 MB cache @ 100,000 vectors: 4.02M removes/sHNSW, 10 MB cache @ 500,000 vectors: 3.42M removes/sHNSW, 10 MB cache @ 1,000,000 vectors: 2.99M removes/s HNSW, 100 MB cache @ 500 vectors: 18.66M removes/sHNSW, 100 MB cache @ 1,000 vectors: 10.25M removes/sHNSW, 100 MB cache @ 10,000 vectors: 3.28M removes/sHNSW, 100 MB cache @ 50,000 vectors: 5.82M removes/sHNSW, 100 MB cache @ 100,000 vectors: 5.19M removes/sHNSW, 100 MB cache @ 500,000 vectors: 4.18M removes/sHNSW, 100 MB cache @ 1,000,000 vectors: 3.34M removes/s HNSW, 500 MB cache @ 500 vectors: 13.66M removes/sHNSW, 500 MB cache @ 1,000 vectors: 10.16M removes/sHNSW, 500 MB cache @ 10,000 vectors: 3.3M removes/sHNSW, 500 MB cache @ 50,000 vectors: 5.87M removes/sHNSW, 500 MB cache @ 100,000 vectors: 5.13M removes/sHNSW, 500 MB cache @ 500,000 vectors: 4.04M removes/sHNSW, 500 MB cache @ 1,000,000 vectors: 3.83M removes/s HNSW, 2000 MB cache @ 500 vectors: 21.01M removes/sHNSW, 2000 MB cache @ 1,000 vectors: 9.35M removes/sHNSW, 2000 MB cache @ 10,000 vectors: 3.39M removes/sHNSW, 2000 MB cache @ 50,000 vectors: 6.06M removes/sHNSW, 2000 MB cache @ 100,000 vectors: 5.3M removes/sHNSW, 2000 MB cache @ 500,000 vectors: 4.08M removes/sHNSW, 2000 MB cache @ 1,000,000 vectors: 3.24M removes/s

Mixed

ops/s · ▲ higher is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 16.18k ops/sMemory, 10 MB cache @ 1,000 vectors: 13.77k ops/sMemory, 10 MB cache @ 10,000 vectors: 2.25k ops/sMemory, 10 MB cache @ 50,000 vectors: 361.5 ops/sMemory, 10 MB cache @ 100,000 vectors: 186.8 ops/sMemory, 10 MB cache @ 500,000 vectors: 38.7 ops/sMemory, 10 MB cache @ 1,000,000 vectors: 19.2 ops/s Memory, 100 MB cache @ 500 vectors: 16.04k ops/sMemory, 100 MB cache @ 1,000 vectors: 13.53k ops/sMemory, 100 MB cache @ 10,000 vectors: 2.23k ops/sMemory, 100 MB cache @ 50,000 vectors: 362.6 ops/sMemory, 100 MB cache @ 100,000 vectors: 184.7 ops/sMemory, 100 MB cache @ 500,000 vectors: 38.5 ops/sMemory, 100 MB cache @ 1,000,000 vectors: 17.9 ops/s Memory, 500 MB cache @ 500 vectors: 16.48k ops/sMemory, 500 MB cache @ 1,000 vectors: 13.23k ops/sMemory, 500 MB cache @ 10,000 vectors: 2.11k ops/sMemory, 500 MB cache @ 50,000 vectors: 365.4 ops/sMemory, 500 MB cache @ 100,000 vectors: 187.4 ops/sMemory, 500 MB cache @ 500,000 vectors: 38.8 ops/sMemory, 500 MB cache @ 1,000,000 vectors: 18.7 ops/s Memory, 2000 MB cache @ 500 vectors: 16.21k ops/sMemory, 2000 MB cache @ 1,000 vectors: 13.73k ops/sMemory, 2000 MB cache @ 10,000 vectors: 2.14k ops/sMemory, 2000 MB cache @ 50,000 vectors: 360.8 ops/sMemory, 2000 MB cache @ 100,000 vectors: 186.9 ops/sMemory, 2000 MB cache @ 500,000 vectors: 38.7 ops/sMemory, 2000 MB cache @ 1,000,000 vectors: 18.7 ops/s IVS, 10 MB cache @ 500 vectors: 12.21k ops/sIVS, 10 MB cache @ 1,000 vectors: 7.99k ops/sIVS, 10 MB cache @ 10,000 vectors: 126.9 ops/sIVS, 10 MB cache @ 50,000 vectors: 106.8 ops/sIVS, 10 MB cache @ 100,000 vectors: 55.1 ops/sIVS, 10 MB cache @ 500,000 vectors: 11.7 ops/sIVS, 10 MB cache @ 1,000,000 vectors: 5.59 ops/s IVS, 100 MB cache @ 500 vectors: 12.38k ops/sIVS, 100 MB cache @ 1,000 vectors: 7k ops/sIVS, 100 MB cache @ 10,000 vectors: 964.7 ops/sIVS, 100 MB cache @ 50,000 vectors: 150.8 ops/sIVS, 100 MB cache @ 100,000 vectors: 63.1 ops/sIVS, 100 MB cache @ 500,000 vectors: 11.9 ops/sIVS, 100 MB cache @ 1,000,000 vectors: 5.46 ops/s IVS, 500 MB cache @ 500 vectors: 12.36k ops/sIVS, 500 MB cache @ 1,000 vectors: 7.53k ops/sIVS, 500 MB cache @ 10,000 vectors: 957.3 ops/sIVS, 500 MB cache @ 50,000 vectors: 744.4 ops/sIVS, 500 MB cache @ 100,000 vectors: 214.8 ops/sIVS, 500 MB cache @ 500,000 vectors: 13.5 ops/sIVS, 500 MB cache @ 1,000,000 vectors: 5.9 ops/s IVS, 2000 MB cache @ 500 vectors: 12.79k ops/sIVS, 2000 MB cache @ 1,000 vectors: 6.89k ops/sIVS, 2000 MB cache @ 10,000 vectors: 946.3 ops/sIVS, 2000 MB cache @ 50,000 vectors: 770.2 ops/sIVS, 2000 MB cache @ 100,000 vectors: 548 ops/sIVS, 2000 MB cache @ 500,000 vectors: 29.5 ops/sIVS, 2000 MB cache @ 1,000,000 vectors: 7.75 ops/s HNSW, 10 MB cache @ 500 vectors: 1.24k ops/sHNSW, 10 MB cache @ 1,000 vectors: 706.1 ops/sHNSW, 10 MB cache @ 10,000 vectors: 194.6 ops/sHNSW, 10 MB cache @ 50,000 vectors: 272.9 ops/sHNSW, 10 MB cache @ 100,000 vectors: 186.6 ops/sHNSW, 10 MB cache @ 500,000 vectors: 69.4 ops/sHNSW, 10 MB cache @ 1,000,000 vectors: 54.6 ops/s HNSW, 100 MB cache @ 500 vectors: 4.6k ops/sHNSW, 100 MB cache @ 1,000 vectors: 6.02k ops/sHNSW, 100 MB cache @ 10,000 vectors: 1.81k ops/sHNSW, 100 MB cache @ 50,000 vectors: 1.62k ops/sHNSW, 100 MB cache @ 100,000 vectors: 1.47k ops/sHNSW, 100 MB cache @ 500,000 vectors: 1.1k ops/sHNSW, 100 MB cache @ 1,000,000 vectors: 966.1 ops/s HNSW, 500 MB cache @ 500 vectors: 4.5k ops/sHNSW, 500 MB cache @ 1,000 vectors: 5.98k ops/sHNSW, 500 MB cache @ 10,000 vectors: 6.14k ops/sHNSW, 500 MB cache @ 50,000 vectors: 5.22k ops/sHNSW, 500 MB cache @ 100,000 vectors: 1.48k ops/sHNSW, 500 MB cache @ 500,000 vectors: 1.09k ops/sHNSW, 500 MB cache @ 1,000,000 vectors: 985.3 ops/s HNSW, 2000 MB cache @ 500 vectors: 4.49k ops/sHNSW, 2000 MB cache @ 1,000 vectors: 6.14k ops/sHNSW, 2000 MB cache @ 10,000 vectors: 6.31k ops/sHNSW, 2000 MB cache @ 50,000 vectors: 5.51k ops/sHNSW, 2000 MB cache @ 100,000 vectors: 3.9k ops/sHNSW, 2000 MB cache @ 500,000 vectors: 1.09k ops/sHNSW, 2000 MB cache @ 1,000,000 vectors: 942 ops/s

Searches

Top10

queries/s · ▲ higher is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 9.78k queries/sMemory, 10 MB cache @ 1,000 vectors: 2.76k queries/sMemory, 10 MB cache @ 10,000 vectors: 1.38k queries/sMemory, 10 MB cache @ 50,000 vectors: 217.4 queries/sMemory, 10 MB cache @ 100,000 vectors: 113.6 queries/sMemory, 10 MB cache @ 500,000 vectors: 22.9 queries/sMemory, 10 MB cache @ 1,000,000 vectors: 11.5 queries/s Memory, 100 MB cache @ 500 vectors: 4.23k queries/sMemory, 100 MB cache @ 1,000 vectors: 4.28k queries/sMemory, 100 MB cache @ 10,000 vectors: 1.34k queries/sMemory, 100 MB cache @ 50,000 vectors: 222.5 queries/sMemory, 100 MB cache @ 100,000 vectors: 113.4 queries/sMemory, 100 MB cache @ 500,000 vectors: 22.9 queries/sMemory, 100 MB cache @ 1,000,000 vectors: 10.8 queries/s Memory, 500 MB cache @ 500 vectors: 2.31k queries/sMemory, 500 MB cache @ 1,000 vectors: 1.95k queries/sMemory, 500 MB cache @ 10,000 vectors: 1.26k queries/sMemory, 500 MB cache @ 50,000 vectors: 223.3 queries/sMemory, 500 MB cache @ 100,000 vectors: 113.2 queries/sMemory, 500 MB cache @ 500,000 vectors: 23.3 queries/sMemory, 500 MB cache @ 1,000,000 vectors: 11.2 queries/s Memory, 2000 MB cache @ 500 vectors: 6.6k queries/sMemory, 2000 MB cache @ 1,000 vectors: 1.42k queries/sMemory, 2000 MB cache @ 10,000 vectors: 1.29k queries/sMemory, 2000 MB cache @ 50,000 vectors: 221.6 queries/sMemory, 2000 MB cache @ 100,000 vectors: 112.1 queries/sMemory, 2000 MB cache @ 500,000 vectors: 23.3 queries/sMemory, 2000 MB cache @ 1,000,000 vectors: 10.9 queries/s IVS, 10 MB cache @ 500 vectors: 8.74k queries/sIVS, 10 MB cache @ 1,000 vectors: 5.67k queries/sIVS, 10 MB cache @ 10,000 vectors: 79.6 queries/sIVS, 10 MB cache @ 50,000 vectors: 60.5 queries/sIVS, 10 MB cache @ 100,000 vectors: 33 queries/sIVS, 10 MB cache @ 500,000 vectors: 7.08 queries/sIVS, 10 MB cache @ 1,000,000 vectors: 3.49 queries/s IVS, 100 MB cache @ 500 vectors: 8.47k queries/sIVS, 100 MB cache @ 1,000 vectors: 5k queries/sIVS, 100 MB cache @ 10,000 vectors: 816.8 queries/sIVS, 100 MB cache @ 50,000 vectors: 96.2 queries/sIVS, 100 MB cache @ 100,000 vectors: 38.7 queries/sIVS, 100 MB cache @ 500,000 vectors: 7.51 queries/sIVS, 100 MB cache @ 1,000,000 vectors: 3.46 queries/s IVS, 500 MB cache @ 500 vectors: 8.75k queries/sIVS, 500 MB cache @ 1,000 vectors: 5.45k queries/sIVS, 500 MB cache @ 10,000 vectors: 721.7 queries/sIVS, 500 MB cache @ 50,000 vectors: 635.2 queries/sIVS, 500 MB cache @ 100,000 vectors: 146.6 queries/sIVS, 500 MB cache @ 500,000 vectors: 7.82 queries/sIVS, 500 MB cache @ 1,000,000 vectors: 3.5 queries/s IVS, 2000 MB cache @ 500 vectors: 9.01k queries/sIVS, 2000 MB cache @ 1,000 vectors: 5.12k queries/sIVS, 2000 MB cache @ 10,000 vectors: 821.4 queries/sIVS, 2000 MB cache @ 50,000 vectors: 672.8 queries/sIVS, 2000 MB cache @ 100,000 vectors: 417 queries/sIVS, 2000 MB cache @ 500,000 vectors: 17.4 queries/sIVS, 2000 MB cache @ 1,000,000 vectors: 4.36 queries/s HNSW, 10 MB cache @ 500 vectors: 1.69k queries/sHNSW, 10 MB cache @ 1,000 vectors: 1.11k queries/sHNSW, 10 MB cache @ 10,000 vectors: 151.3 queries/sHNSW, 10 MB cache @ 50,000 vectors: 238.9 queries/sHNSW, 10 MB cache @ 100,000 vectors: 175.9 queries/sHNSW, 10 MB cache @ 500,000 vectors: 67.6 queries/sHNSW, 10 MB cache @ 1,000,000 vectors: 54.7 queries/s HNSW, 100 MB cache @ 500 vectors: 11.3k queries/sHNSW, 100 MB cache @ 1,000 vectors: 11.33k queries/sHNSW, 100 MB cache @ 10,000 vectors: 6.43k queries/sHNSW, 100 MB cache @ 50,000 vectors: 1.18k queries/sHNSW, 100 MB cache @ 100,000 vectors: 1.11k queries/sHNSW, 100 MB cache @ 500,000 vectors: 898.3 queries/sHNSW, 100 MB cache @ 1,000,000 vectors: 817.9 queries/s HNSW, 500 MB cache @ 500 vectors: 11.81k queries/sHNSW, 500 MB cache @ 1,000 vectors: 5.63k queries/sHNSW, 500 MB cache @ 10,000 vectors: 5.92k queries/sHNSW, 500 MB cache @ 50,000 vectors: 6.45k queries/sHNSW, 500 MB cache @ 100,000 vectors: 1.13k queries/sHNSW, 500 MB cache @ 500,000 vectors: 903.7 queries/sHNSW, 500 MB cache @ 1,000,000 vectors: 771.7 queries/s HNSW, 2000 MB cache @ 500 vectors: 12.26k queries/sHNSW, 2000 MB cache @ 1,000 vectors: 5.99k queries/sHNSW, 2000 MB cache @ 10,000 vectors: 6.06k queries/sHNSW, 2000 MB cache @ 50,000 vectors: 6.56k queries/sHNSW, 2000 MB cache @ 100,000 vectors: 6.11k queries/sHNSW, 2000 MB cache @ 500,000 vectors: 883.9 queries/sHNSW, 2000 MB cache @ 1,000,000 vectors: 761.9 queries/s

Top100

queries/s · ▲ higher is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 8.7k queries/sMemory, 10 MB cache @ 1,000 vectors: 5.97k queries/sMemory, 10 MB cache @ 10,000 vectors: 1.43k queries/sMemory, 10 MB cache @ 50,000 vectors: 216.5 queries/sMemory, 10 MB cache @ 100,000 vectors: 106.5 queries/sMemory, 10 MB cache @ 500,000 vectors: 22.8 queries/sMemory, 10 MB cache @ 1,000,000 vectors: 11.6 queries/s Memory, 100 MB cache @ 500 vectors: 4.11k queries/sMemory, 100 MB cache @ 1,000 vectors: 4.09k queries/sMemory, 100 MB cache @ 10,000 vectors: 1.42k queries/sMemory, 100 MB cache @ 50,000 vectors: 222.8 queries/sMemory, 100 MB cache @ 100,000 vectors: 112.9 queries/sMemory, 100 MB cache @ 500,000 vectors: 23 queries/sMemory, 100 MB cache @ 1,000,000 vectors: 11.4 queries/s Memory, 500 MB cache @ 500 vectors: 4.17k queries/sMemory, 500 MB cache @ 1,000 vectors: 5.8k queries/sMemory, 500 MB cache @ 10,000 vectors: 1.39k queries/sMemory, 500 MB cache @ 50,000 vectors: 222.5 queries/sMemory, 500 MB cache @ 100,000 vectors: 113.3 queries/sMemory, 500 MB cache @ 500,000 vectors: 23.3 queries/sMemory, 500 MB cache @ 1,000,000 vectors: 11 queries/s Memory, 2000 MB cache @ 500 vectors: 8.79k queries/sMemory, 2000 MB cache @ 1,000 vectors: 7.64k queries/sMemory, 2000 MB cache @ 10,000 vectors: 1.42k queries/sMemory, 2000 MB cache @ 50,000 vectors: 219.6 queries/sMemory, 2000 MB cache @ 100,000 vectors: 113.2 queries/sMemory, 2000 MB cache @ 500,000 vectors: 23.3 queries/sMemory, 2000 MB cache @ 1,000,000 vectors: 10.9 queries/s IVS, 10 MB cache @ 500 vectors: 9.98k queries/sIVS, 10 MB cache @ 1,000 vectors: 5.44k queries/sIVS, 10 MB cache @ 10,000 vectors: 77.8 queries/sIVS, 10 MB cache @ 50,000 vectors: 68.3 queries/sIVS, 10 MB cache @ 100,000 vectors: 33.8 queries/sIVS, 10 MB cache @ 500,000 vectors: 6.89 queries/sIVS, 10 MB cache @ 1,000,000 vectors: 3.53 queries/s IVS, 100 MB cache @ 500 vectors: 9.3k queries/sIVS, 100 MB cache @ 1,000 vectors: 5.07k queries/sIVS, 100 MB cache @ 10,000 vectors: 828.8 queries/sIVS, 100 MB cache @ 50,000 vectors: 93.4 queries/sIVS, 100 MB cache @ 100,000 vectors: 39.6 queries/sIVS, 100 MB cache @ 500,000 vectors: 7.52 queries/sIVS, 100 MB cache @ 1,000,000 vectors: 3.43 queries/s IVS, 500 MB cache @ 500 vectors: 9.88k queries/sIVS, 500 MB cache @ 1,000 vectors: 5.67k queries/sIVS, 500 MB cache @ 10,000 vectors: 837.6 queries/sIVS, 500 MB cache @ 50,000 vectors: 777.2 queries/sIVS, 500 MB cache @ 100,000 vectors: 142.6 queries/sIVS, 500 MB cache @ 500,000 vectors: 7.79 queries/sIVS, 500 MB cache @ 1,000,000 vectors: 3.51 queries/s IVS, 2000 MB cache @ 500 vectors: 9.99k queries/sIVS, 2000 MB cache @ 1,000 vectors: 5.55k queries/sIVS, 2000 MB cache @ 10,000 vectors: 827.4 queries/sIVS, 2000 MB cache @ 50,000 vectors: 761.1 queries/sIVS, 2000 MB cache @ 100,000 vectors: 411 queries/sIVS, 2000 MB cache @ 500,000 vectors: 17.3 queries/sIVS, 2000 MB cache @ 1,000,000 vectors: 4.55 queries/s HNSW, 10 MB cache @ 500 vectors: 1.91k queries/sHNSW, 10 MB cache @ 1,000 vectors: 1.16k queries/sHNSW, 10 MB cache @ 10,000 vectors: 108.6 queries/sHNSW, 10 MB cache @ 50,000 vectors: 20.8 queries/sHNSW, 10 MB cache @ 100,000 vectors: 24.6 queries/sHNSW, 10 MB cache @ 500,000 vectors: 32.7 queries/sHNSW, 10 MB cache @ 1,000,000 vectors: 20.6 queries/s HNSW, 100 MB cache @ 500 vectors: 11.01k queries/sHNSW, 100 MB cache @ 1,000 vectors: 11.76k queries/sHNSW, 100 MB cache @ 10,000 vectors: 1.48k queries/sHNSW, 100 MB cache @ 50,000 vectors: 126.7 queries/sHNSW, 100 MB cache @ 100,000 vectors: 126.9 queries/sHNSW, 100 MB cache @ 500,000 vectors: 127.4 queries/sHNSW, 100 MB cache @ 1,000,000 vectors: 115 queries/s HNSW, 500 MB cache @ 500 vectors: 12.61k queries/sHNSW, 500 MB cache @ 1,000 vectors: 10.37k queries/sHNSW, 500 MB cache @ 10,000 vectors: 1.64k queries/sHNSW, 500 MB cache @ 50,000 vectors: 672.7 queries/sHNSW, 500 MB cache @ 100,000 vectors: 128.9 queries/sHNSW, 500 MB cache @ 500,000 vectors: 126.7 queries/sHNSW, 500 MB cache @ 1,000,000 vectors: 109 queries/s HNSW, 2000 MB cache @ 500 vectors: 12.99k queries/sHNSW, 2000 MB cache @ 1,000 vectors: 10.2k queries/sHNSW, 2000 MB cache @ 10,000 vectors: 1.63k queries/sHNSW, 2000 MB cache @ 50,000 vectors: 719.4 queries/sHNSW, 2000 MB cache @ 100,000 vectors: 776.6 queries/sHNSW, 2000 MB cache @ 500,000 vectors: 127.2 queries/sHNSW, 2000 MB cache @ 1,000,000 vectors: 105.2 queries/s

NoFloor

queries/s · ▲ higher is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 12.76k queries/sMemory, 10 MB cache @ 1,000 vectors: 8.93k queries/sMemory, 10 MB cache @ 10,000 vectors: 1.19k queries/sMemory, 10 MB cache @ 50,000 vectors: 210.5 queries/sMemory, 10 MB cache @ 100,000 vectors: 109 queries/sMemory, 10 MB cache @ 500,000 vectors: 22.2 queries/sMemory, 10 MB cache @ 1,000,000 vectors: 11.6 queries/s Memory, 100 MB cache @ 500 vectors: 12.64k queries/sMemory, 100 MB cache @ 1,000 vectors: 9.28k queries/sMemory, 100 MB cache @ 10,000 vectors: 1.17k queries/sMemory, 100 MB cache @ 50,000 vectors: 216.6 queries/sMemory, 100 MB cache @ 100,000 vectors: 111 queries/sMemory, 100 MB cache @ 500,000 vectors: 22.7 queries/sMemory, 100 MB cache @ 1,000,000 vectors: 10.8 queries/s Memory, 500 MB cache @ 500 vectors: 10.4k queries/sMemory, 500 MB cache @ 1,000 vectors: 8.51k queries/sMemory, 500 MB cache @ 10,000 vectors: 1.16k queries/sMemory, 500 MB cache @ 50,000 vectors: 215.9 queries/sMemory, 500 MB cache @ 100,000 vectors: 111.9 queries/sMemory, 500 MB cache @ 500,000 vectors: 23.2 queries/sMemory, 500 MB cache @ 1,000,000 vectors: 11.2 queries/s Memory, 2000 MB cache @ 500 vectors: 10.95k queries/sMemory, 2000 MB cache @ 1,000 vectors: 8.98k queries/sMemory, 2000 MB cache @ 10,000 vectors: 1.24k queries/sMemory, 2000 MB cache @ 50,000 vectors: 215.5 queries/sMemory, 2000 MB cache @ 100,000 vectors: 111.6 queries/sMemory, 2000 MB cache @ 500,000 vectors: 23.1 queries/sMemory, 2000 MB cache @ 1,000,000 vectors: 11.2 queries/s IVS, 10 MB cache @ 500 vectors: 10.93k queries/sIVS, 10 MB cache @ 1,000 vectors: 7.01k queries/sIVS, 10 MB cache @ 10,000 vectors: 76.2 queries/sIVS, 10 MB cache @ 50,000 vectors: 63.4 queries/sIVS, 10 MB cache @ 100,000 vectors: 33.3 queries/sIVS, 10 MB cache @ 500,000 vectors: 7.02 queries/sIVS, 10 MB cache @ 1,000,000 vectors: 3.46 queries/s IVS, 100 MB cache @ 500 vectors: 11.36k queries/sIVS, 100 MB cache @ 1,000 vectors: 6.98k queries/sIVS, 100 MB cache @ 10,000 vectors: 860.5 queries/sIVS, 100 MB cache @ 50,000 vectors: 95.4 queries/sIVS, 100 MB cache @ 100,000 vectors: 37 queries/sIVS, 100 MB cache @ 500,000 vectors: 7.09 queries/sIVS, 100 MB cache @ 1,000,000 vectors: 3.41 queries/s IVS, 500 MB cache @ 500 vectors: 10.71k queries/sIVS, 500 MB cache @ 1,000 vectors: 6.47k queries/sIVS, 500 MB cache @ 10,000 vectors: 844.1 queries/sIVS, 500 MB cache @ 50,000 vectors: 747.5 queries/sIVS, 500 MB cache @ 100,000 vectors: 146.7 queries/sIVS, 500 MB cache @ 500,000 vectors: 7.95 queries/sIVS, 500 MB cache @ 1,000,000 vectors: 3.54 queries/s IVS, 2000 MB cache @ 500 vectors: 10k queries/sIVS, 2000 MB cache @ 1,000 vectors: 6k queries/sIVS, 2000 MB cache @ 10,000 vectors: 838.7 queries/sIVS, 2000 MB cache @ 50,000 vectors: 745 queries/sIVS, 2000 MB cache @ 100,000 vectors: 398.8 queries/sIVS, 2000 MB cache @ 500,000 vectors: 17.2 queries/sIVS, 2000 MB cache @ 1,000,000 vectors: 4.55 queries/s HNSW, 10 MB cache @ 500 vectors: 2.04k queries/sHNSW, 10 MB cache @ 1,000 vectors: 1.25k queries/sHNSW, 10 MB cache @ 10,000 vectors: 150.4 queries/sHNSW, 10 MB cache @ 50,000 vectors: 239.9 queries/sHNSW, 10 MB cache @ 100,000 vectors: 173.7 queries/sHNSW, 10 MB cache @ 500,000 vectors: 67.6 queries/sHNSW, 10 MB cache @ 1,000,000 vectors: 53.3 queries/s HNSW, 100 MB cache @ 500 vectors: 12k queries/sHNSW, 100 MB cache @ 1,000 vectors: 10.08k queries/sHNSW, 100 MB cache @ 10,000 vectors: 7.65k queries/sHNSW, 100 MB cache @ 50,000 vectors: 1.19k queries/sHNSW, 100 MB cache @ 100,000 vectors: 1.12k queries/sHNSW, 100 MB cache @ 500,000 vectors: 895.9 queries/sHNSW, 100 MB cache @ 1,000,000 vectors: 836.4 queries/s HNSW, 500 MB cache @ 500 vectors: 10.44k queries/sHNSW, 500 MB cache @ 1,000 vectors: 10.02k queries/sHNSW, 500 MB cache @ 10,000 vectors: 7.26k queries/sHNSW, 500 MB cache @ 50,000 vectors: 7.87k queries/sHNSW, 500 MB cache @ 100,000 vectors: 1.13k queries/sHNSW, 500 MB cache @ 500,000 vectors: 887.5 queries/sHNSW, 500 MB cache @ 1,000,000 vectors: 784.6 queries/s HNSW, 2000 MB cache @ 500 vectors: 16.15k queries/sHNSW, 2000 MB cache @ 1,000 vectors: 10.59k queries/sHNSW, 2000 MB cache @ 10,000 vectors: 7.6k queries/sHNSW, 2000 MB cache @ 50,000 vectors: 7.98k queries/sHNSW, 2000 MB cache @ 100,000 vectors: 5.9k queries/sHNSW, 2000 MB cache @ 500,000 vectors: 887.5 queries/sHNSW, 2000 MB cache @ 1,000,000 vectors: 762.2 queries/s

Filter

queries/s · ▲ higher is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 11.15k queries/sMemory, 10 MB cache @ 1,000 vectors: 9.02k queries/sMemory, 10 MB cache @ 10,000 vectors: 1.35k queries/sMemory, 10 MB cache @ 50,000 vectors: 223 queries/sMemory, 10 MB cache @ 100,000 vectors: 113.5 queries/sMemory, 10 MB cache @ 500,000 vectors: 23.2 queries/sMemory, 10 MB cache @ 1,000,000 vectors: 11.6 queries/s Memory, 100 MB cache @ 500 vectors: 11.3k queries/sMemory, 100 MB cache @ 1,000 vectors: 8.83k queries/sMemory, 100 MB cache @ 10,000 vectors: 1.31k queries/sMemory, 100 MB cache @ 50,000 vectors: 224.2 queries/sMemory, 100 MB cache @ 100,000 vectors: 113.4 queries/sMemory, 100 MB cache @ 500,000 vectors: 23.2 queries/sMemory, 100 MB cache @ 1,000,000 vectors: 10.5 queries/s Memory, 500 MB cache @ 500 vectors: 10.81k queries/sMemory, 500 MB cache @ 1,000 vectors: 8.84k queries/sMemory, 500 MB cache @ 10,000 vectors: 1.31k queries/sMemory, 500 MB cache @ 50,000 vectors: 224.2 queries/sMemory, 500 MB cache @ 100,000 vectors: 114.1 queries/sMemory, 500 MB cache @ 500,000 vectors: 23.1 queries/sMemory, 500 MB cache @ 1,000,000 vectors: 11.4 queries/s Memory, 2000 MB cache @ 500 vectors: 11.67k queries/sMemory, 2000 MB cache @ 1,000 vectors: 9.3k queries/sMemory, 2000 MB cache @ 10,000 vectors: 1.37k queries/sMemory, 2000 MB cache @ 50,000 vectors: 222.5 queries/sMemory, 2000 MB cache @ 100,000 vectors: 113.6 queries/sMemory, 2000 MB cache @ 500,000 vectors: 23.3 queries/sMemory, 2000 MB cache @ 1,000,000 vectors: 11.3 queries/s IVS, 10 MB cache @ 500 vectors: 12.49k queries/sIVS, 10 MB cache @ 1,000 vectors: 6.99k queries/sIVS, 10 MB cache @ 10,000 vectors: 77.3 queries/sIVS, 10 MB cache @ 50,000 vectors: 65.8 queries/sIVS, 10 MB cache @ 100,000 vectors: 33.3 queries/sIVS, 10 MB cache @ 500,000 vectors: 6.99 queries/sIVS, 10 MB cache @ 1,000,000 vectors: 3.24 queries/s IVS, 100 MB cache @ 500 vectors: 12.48k queries/sIVS, 100 MB cache @ 1,000 vectors: 6.6k queries/sIVS, 100 MB cache @ 10,000 vectors: 880.3 queries/sIVS, 100 MB cache @ 50,000 vectors: 92.6 queries/sIVS, 100 MB cache @ 100,000 vectors: 37.3 queries/sIVS, 100 MB cache @ 500,000 vectors: 7.12 queries/sIVS, 100 MB cache @ 1,000,000 vectors: 3.42 queries/s IVS, 500 MB cache @ 500 vectors: 12.09k queries/sIVS, 500 MB cache @ 1,000 vectors: 6.06k queries/sIVS, 500 MB cache @ 10,000 vectors: 868.8 queries/sIVS, 500 MB cache @ 50,000 vectors: 805.2 queries/sIVS, 500 MB cache @ 100,000 vectors: 149.1 queries/sIVS, 500 MB cache @ 500,000 vectors: 8.07 queries/sIVS, 500 MB cache @ 1,000,000 vectors: 3.56 queries/s IVS, 2000 MB cache @ 500 vectors: 12.67k queries/sIVS, 2000 MB cache @ 1,000 vectors: 7.12k queries/sIVS, 2000 MB cache @ 10,000 vectors: 880.3 queries/sIVS, 2000 MB cache @ 50,000 vectors: 812.4 queries/sIVS, 2000 MB cache @ 100,000 vectors: 417 queries/sIVS, 2000 MB cache @ 500,000 vectors: 17.2 queries/sIVS, 2000 MB cache @ 1,000,000 vectors: 4.39 queries/s HNSW, 10 MB cache @ 500 vectors: 2.11k queries/sHNSW, 10 MB cache @ 1,000 vectors: 1.31k queries/sHNSW, 10 MB cache @ 10,000 vectors: 38.5 queries/sHNSW, 10 MB cache @ 50,000 vectors: 15.3 queries/sHNSW, 10 MB cache @ 100,000 vectors: 12 queries/sHNSW, 10 MB cache @ 500,000 vectors: 9.19 queries/sHNSW, 10 MB cache @ 1,000,000 vectors: 7.7 queries/s HNSW, 100 MB cache @ 500 vectors: 12.01k queries/sHNSW, 100 MB cache @ 1,000 vectors: 16.7k queries/sHNSW, 100 MB cache @ 10,000 vectors: 875.3 queries/sHNSW, 100 MB cache @ 50,000 vectors: 43.6 queries/sHNSW, 100 MB cache @ 100,000 vectors: 20.9 queries/sHNSW, 100 MB cache @ 500,000 vectors: 70.8 queries/sHNSW, 100 MB cache @ 1,000,000 vectors: 47.1 queries/s HNSW, 500 MB cache @ 500 vectors: 17.51k queries/sHNSW, 500 MB cache @ 1,000 vectors: 17.03k queries/sHNSW, 500 MB cache @ 10,000 vectors: 874.7 queries/sHNSW, 500 MB cache @ 50,000 vectors: 301.6 queries/sHNSW, 500 MB cache @ 100,000 vectors: 20.9 queries/sHNSW, 500 MB cache @ 500,000 vectors: 70.9 queries/sHNSW, 500 MB cache @ 1,000,000 vectors: 44.9 queries/s HNSW, 2000 MB cache @ 500 vectors: 25.76k queries/sHNSW, 2000 MB cache @ 1,000 vectors: 17.12k queries/sHNSW, 2000 MB cache @ 10,000 vectors: 882.3 queries/sHNSW, 2000 MB cache @ 50,000 vectors: 302 queries/sHNSW, 2000 MB cache @ 100,000 vectors: 187.1 queries/sHNSW, 2000 MB cache @ 500,000 vectors: 70 queries/sHNSW, 2000 MB cache @ 1,000,000 vectors: 44.5 queries/s

Accuracy

Recall

% · ▲ higher is better

0 25 50 75 100 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 100 %Memory, 10 MB cache @ 1,000 vectors: 100 %Memory, 10 MB cache @ 10,000 vectors: 100 %Memory, 10 MB cache @ 50,000 vectors: 100 %Memory, 10 MB cache @ 100,000 vectors: 100 %Memory, 10 MB cache @ 500,000 vectors: 100 %Memory, 10 MB cache @ 1,000,000 vectors: 100 % Memory, 100 MB cache @ 500 vectors: 100 %Memory, 100 MB cache @ 1,000 vectors: 100 %Memory, 100 MB cache @ 10,000 vectors: 100 %Memory, 100 MB cache @ 50,000 vectors: 100 %Memory, 100 MB cache @ 100,000 vectors: 100 %Memory, 100 MB cache @ 500,000 vectors: 100 %Memory, 100 MB cache @ 1,000,000 vectors: 100 % Memory, 500 MB cache @ 500 vectors: 100 %Memory, 500 MB cache @ 1,000 vectors: 100 %Memory, 500 MB cache @ 10,000 vectors: 100 %Memory, 500 MB cache @ 50,000 vectors: 100 %Memory, 500 MB cache @ 100,000 vectors: 100 %Memory, 500 MB cache @ 500,000 vectors: 100 %Memory, 500 MB cache @ 1,000,000 vectors: 100 % Memory, 2000 MB cache @ 500 vectors: 100 %Memory, 2000 MB cache @ 1,000 vectors: 100 %Memory, 2000 MB cache @ 10,000 vectors: 100 %Memory, 2000 MB cache @ 50,000 vectors: 100 %Memory, 2000 MB cache @ 100,000 vectors: 100 %Memory, 2000 MB cache @ 500,000 vectors: 100 %Memory, 2000 MB cache @ 1,000,000 vectors: 100 % IVS, 10 MB cache @ 500 vectors: 100 %IVS, 10 MB cache @ 1,000 vectors: 100 %IVS, 10 MB cache @ 10,000 vectors: 100 %IVS, 10 MB cache @ 50,000 vectors: 100 %IVS, 10 MB cache @ 100,000 vectors: 100 %IVS, 10 MB cache @ 500,000 vectors: 100 %IVS, 10 MB cache @ 1,000,000 vectors: 100 % IVS, 100 MB cache @ 500 vectors: 100 %IVS, 100 MB cache @ 1,000 vectors: 100 %IVS, 100 MB cache @ 10,000 vectors: 100 %IVS, 100 MB cache @ 50,000 vectors: 100 %IVS, 100 MB cache @ 100,000 vectors: 100 %IVS, 100 MB cache @ 500,000 vectors: 100 %IVS, 100 MB cache @ 1,000,000 vectors: 100 % IVS, 500 MB cache @ 500 vectors: 100 %IVS, 500 MB cache @ 1,000 vectors: 100 %IVS, 500 MB cache @ 10,000 vectors: 100 %IVS, 500 MB cache @ 50,000 vectors: 100 %IVS, 500 MB cache @ 100,000 vectors: 100 %IVS, 500 MB cache @ 500,000 vectors: 100 %IVS, 500 MB cache @ 1,000,000 vectors: 100 % IVS, 2000 MB cache @ 500 vectors: 100 %IVS, 2000 MB cache @ 1,000 vectors: 100 %IVS, 2000 MB cache @ 10,000 vectors: 100 %IVS, 2000 MB cache @ 50,000 vectors: 100 %IVS, 2000 MB cache @ 100,000 vectors: 100 %IVS, 2000 MB cache @ 500,000 vectors: 100 %IVS, 2000 MB cache @ 1,000,000 vectors: 100 % HNSW, 10 MB cache @ 500 vectors: 100 %HNSW, 10 MB cache @ 1,000 vectors: 100 %HNSW, 10 MB cache @ 10,000 vectors: 100 %HNSW, 10 MB cache @ 50,000 vectors: 100 %HNSW, 10 MB cache @ 100,000 vectors: 100 %HNSW, 10 MB cache @ 500,000 vectors: 83.2 %HNSW, 10 MB cache @ 1,000,000 vectors: 75 % HNSW, 100 MB cache @ 500 vectors: 100 %HNSW, 100 MB cache @ 1,000 vectors: 100 %HNSW, 100 MB cache @ 10,000 vectors: 99.8 %HNSW, 100 MB cache @ 50,000 vectors: 99.4 %HNSW, 100 MB cache @ 100,000 vectors: 100 %HNSW, 100 MB cache @ 500,000 vectors: 80.6 %HNSW, 100 MB cache @ 1,000,000 vectors: 74.6 % HNSW, 500 MB cache @ 500 vectors: 100 %HNSW, 500 MB cache @ 1,000 vectors: 100 %HNSW, 500 MB cache @ 10,000 vectors: 99.8 %HNSW, 500 MB cache @ 50,000 vectors: 99.8 %HNSW, 500 MB cache @ 100,000 vectors: 100 %HNSW, 500 MB cache @ 500,000 vectors: 84.6 %HNSW, 500 MB cache @ 1,000,000 vectors: 76 % HNSW, 2000 MB cache @ 500 vectors: 100 %HNSW, 2000 MB cache @ 1,000 vectors: 100 %HNSW, 2000 MB cache @ 10,000 vectors: 99.4 %HNSW, 2000 MB cache @ 50,000 vectors: 99.8 %HNSW, 2000 MB cache @ 100,000 vectors: 100 %HNSW, 2000 MB cache @ 500,000 vectors: 86.6 %HNSW, 2000 MB cache @ 1,000,000 vectors: 77.2 %

Filter recall

% · ▲ higher is better

0 25 50 75 100 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 100 %Memory, 10 MB cache @ 1,000 vectors: 100 %Memory, 10 MB cache @ 10,000 vectors: 100 %Memory, 10 MB cache @ 50,000 vectors: 100 %Memory, 10 MB cache @ 100,000 vectors: 100 %Memory, 10 MB cache @ 500,000 vectors: 100 %Memory, 10 MB cache @ 1,000,000 vectors: 100 % Memory, 100 MB cache @ 500 vectors: 100 %Memory, 100 MB cache @ 1,000 vectors: 100 %Memory, 100 MB cache @ 10,000 vectors: 100 %Memory, 100 MB cache @ 50,000 vectors: 100 %Memory, 100 MB cache @ 100,000 vectors: 100 %Memory, 100 MB cache @ 500,000 vectors: 100 %Memory, 100 MB cache @ 1,000,000 vectors: 100 % Memory, 500 MB cache @ 500 vectors: 100 %Memory, 500 MB cache @ 1,000 vectors: 100 %Memory, 500 MB cache @ 10,000 vectors: 100 %Memory, 500 MB cache @ 50,000 vectors: 100 %Memory, 500 MB cache @ 100,000 vectors: 100 %Memory, 500 MB cache @ 500,000 vectors: 100 %Memory, 500 MB cache @ 1,000,000 vectors: 100 % Memory, 2000 MB cache @ 500 vectors: 100 %Memory, 2000 MB cache @ 1,000 vectors: 100 %Memory, 2000 MB cache @ 10,000 vectors: 100 %Memory, 2000 MB cache @ 50,000 vectors: 100 %Memory, 2000 MB cache @ 100,000 vectors: 100 %Memory, 2000 MB cache @ 500,000 vectors: 100 %Memory, 2000 MB cache @ 1,000,000 vectors: 100 % IVS, 10 MB cache @ 500 vectors: 100 %IVS, 10 MB cache @ 1,000 vectors: 100 %IVS, 10 MB cache @ 10,000 vectors: 100 %IVS, 10 MB cache @ 50,000 vectors: 94.8 %IVS, 10 MB cache @ 100,000 vectors: 100 %IVS, 10 MB cache @ 500,000 vectors: 100 %IVS, 10 MB cache @ 1,000,000 vectors: 100 % IVS, 100 MB cache @ 500 vectors: 100 %IVS, 100 MB cache @ 1,000 vectors: 100 %IVS, 100 MB cache @ 10,000 vectors: 100 %IVS, 100 MB cache @ 50,000 vectors: 94.8 %IVS, 100 MB cache @ 100,000 vectors: 100 %IVS, 100 MB cache @ 500,000 vectors: 100 %IVS, 100 MB cache @ 1,000,000 vectors: 100 % IVS, 500 MB cache @ 500 vectors: 100 %IVS, 500 MB cache @ 1,000 vectors: 100 %IVS, 500 MB cache @ 10,000 vectors: 100 %IVS, 500 MB cache @ 50,000 vectors: 94.8 %IVS, 500 MB cache @ 100,000 vectors: 100 %IVS, 500 MB cache @ 500,000 vectors: 100 %IVS, 500 MB cache @ 1,000,000 vectors: 100 % IVS, 2000 MB cache @ 500 vectors: 100 %IVS, 2000 MB cache @ 1,000 vectors: 100 %IVS, 2000 MB cache @ 10,000 vectors: 100 %IVS, 2000 MB cache @ 50,000 vectors: 94.8 %IVS, 2000 MB cache @ 100,000 vectors: 100 %IVS, 2000 MB cache @ 500,000 vectors: 100 %IVS, 2000 MB cache @ 1,000,000 vectors: 100 % HNSW, 10 MB cache @ 500 vectors: 100 %HNSW, 10 MB cache @ 1,000 vectors: 100 %HNSW, 10 MB cache @ 10,000 vectors: 100 %HNSW, 10 MB cache @ 50,000 vectors: 99.5 %HNSW, 10 MB cache @ 100,000 vectors: 98 %HNSW, 10 MB cache @ 500,000 vectors: 87.2 %HNSW, 10 MB cache @ 1,000,000 vectors: 87.7 % HNSW, 100 MB cache @ 500 vectors: 100 %HNSW, 100 MB cache @ 1,000 vectors: 100 %HNSW, 100 MB cache @ 10,000 vectors: 100 %HNSW, 100 MB cache @ 50,000 vectors: 99.4 %HNSW, 100 MB cache @ 100,000 vectors: 99.9 %HNSW, 100 MB cache @ 500,000 vectors: 87.1 %HNSW, 100 MB cache @ 1,000,000 vectors: 87.7 % HNSW, 500 MB cache @ 500 vectors: 100 %HNSW, 500 MB cache @ 1,000 vectors: 100 %HNSW, 500 MB cache @ 10,000 vectors: 100 %HNSW, 500 MB cache @ 50,000 vectors: 99.3 %HNSW, 500 MB cache @ 100,000 vectors: 99.9 %HNSW, 500 MB cache @ 500,000 vectors: 87.2 %HNSW, 500 MB cache @ 1,000,000 vectors: 87.7 % HNSW, 2000 MB cache @ 500 vectors: 100 %HNSW, 2000 MB cache @ 1,000 vectors: 100 %HNSW, 2000 MB cache @ 10,000 vectors: 100 %HNSW, 2000 MB cache @ 50,000 vectors: 99.4 %HNSW, 2000 MB cache @ 100,000 vectors: 99.9 %HNSW, 2000 MB cache @ 500,000 vectors: 87.2 %HNSW, 2000 MB cache @ 1,000,000 vectors: 89.5 %

Durability and restart

Save

ms · ▼ lower is better · log scale

1 10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 13.7 msMemory, 10 MB cache @ 1,000 vectors: 19.9 msMemory, 10 MB cache @ 10,000 vectors: 140.5 msMemory, 10 MB cache @ 50,000 vectors: 518.9 msMemory, 10 MB cache @ 100,000 vectors: 1.01k msMemory, 10 MB cache @ 500,000 vectors: 5.05k msMemory, 10 MB cache @ 1,000,000 vectors: 9.78k ms Memory, 100 MB cache @ 500 vectors: 13 msMemory, 100 MB cache @ 1,000 vectors: 20.6 msMemory, 100 MB cache @ 10,000 vectors: 140.1 msMemory, 100 MB cache @ 50,000 vectors: 506.5 msMemory, 100 MB cache @ 100,000 vectors: 1.02k msMemory, 100 MB cache @ 500,000 vectors: 5.03k msMemory, 100 MB cache @ 1,000,000 vectors: 11.19k ms Memory, 500 MB cache @ 500 vectors: 12.8 msMemory, 500 MB cache @ 1,000 vectors: 20.9 msMemory, 500 MB cache @ 10,000 vectors: 140.4 msMemory, 500 MB cache @ 50,000 vectors: 538.1 msMemory, 500 MB cache @ 100,000 vectors: 989.1 msMemory, 500 MB cache @ 500,000 vectors: 4.98k msMemory, 500 MB cache @ 1,000,000 vectors: 10.48k ms Memory, 2000 MB cache @ 500 vectors: 12.7 msMemory, 2000 MB cache @ 1,000 vectors: 20 msMemory, 2000 MB cache @ 10,000 vectors: 140.8 msMemory, 2000 MB cache @ 50,000 vectors: 506.6 msMemory, 2000 MB cache @ 100,000 vectors: 1.01k msMemory, 2000 MB cache @ 500,000 vectors: 4.84k msMemory, 2000 MB cache @ 1,000,000 vectors: 10.25k ms IVS, 10 MB cache @ 500 vectors: 8.56 msIVS, 10 MB cache @ 1,000 vectors: 7.59 msIVS, 10 MB cache @ 10,000 vectors: 9.1 msIVS, 10 MB cache @ 50,000 vectors: 21.7 msIVS, 10 MB cache @ 100,000 vectors: 284.3 msIVS, 10 MB cache @ 500,000 vectors: 35.9 msIVS, 10 MB cache @ 1,000,000 vectors: 40.1 ms IVS, 100 MB cache @ 500 vectors: 7.77 msIVS, 100 MB cache @ 1,000 vectors: 8.39 msIVS, 100 MB cache @ 10,000 vectors: 9.74 msIVS, 100 MB cache @ 50,000 vectors: 31.1 msIVS, 100 MB cache @ 100,000 vectors: 261.2 msIVS, 100 MB cache @ 500,000 vectors: 37.4 msIVS, 100 MB cache @ 1,000,000 vectors: 42.6 ms IVS, 500 MB cache @ 500 vectors: 8.77 msIVS, 500 MB cache @ 1,000 vectors: 9.12 msIVS, 500 MB cache @ 10,000 vectors: 9.18 msIVS, 500 MB cache @ 50,000 vectors: 30.8 msIVS, 500 MB cache @ 100,000 vectors: 245.7 msIVS, 500 MB cache @ 500,000 vectors: 37.6 msIVS, 500 MB cache @ 1,000,000 vectors: 59.4 ms IVS, 2000 MB cache @ 500 vectors: 8.85 msIVS, 2000 MB cache @ 1,000 vectors: 7.27 msIVS, 2000 MB cache @ 10,000 vectors: 9.15 msIVS, 2000 MB cache @ 50,000 vectors: 30.4 msIVS, 2000 MB cache @ 100,000 vectors: 256.7 msIVS, 2000 MB cache @ 500,000 vectors: 48.4 msIVS, 2000 MB cache @ 1,000,000 vectors: 39.5 ms HNSW, 10 MB cache @ 500 vectors: 5.64 msHNSW, 10 MB cache @ 1,000 vectors: 6.6 msHNSW, 10 MB cache @ 10,000 vectors: 25.9 msHNSW, 10 MB cache @ 50,000 vectors: 110.4 msHNSW, 10 MB cache @ 100,000 vectors: 201.5 msHNSW, 10 MB cache @ 500,000 vectors: 280.6 msHNSW, 10 MB cache @ 1,000,000 vectors: 274.6 ms HNSW, 100 MB cache @ 500 vectors: 5.94 msHNSW, 100 MB cache @ 1,000 vectors: 6.87 msHNSW, 100 MB cache @ 10,000 vectors: 25 msHNSW, 100 MB cache @ 50,000 vectors: 108.9 msHNSW, 100 MB cache @ 100,000 vectors: 212 msHNSW, 100 MB cache @ 500,000 vectors: 335.8 msHNSW, 100 MB cache @ 1,000,000 vectors: 248.5 ms HNSW, 500 MB cache @ 500 vectors: 5.83 msHNSW, 500 MB cache @ 1,000 vectors: 6.45 msHNSW, 500 MB cache @ 10,000 vectors: 26.4 msHNSW, 500 MB cache @ 50,000 vectors: 108.2 msHNSW, 500 MB cache @ 100,000 vectors: 211.2 msHNSW, 500 MB cache @ 500,000 vectors: 317.1 msHNSW, 500 MB cache @ 1,000,000 vectors: 256.3 ms HNSW, 2000 MB cache @ 500 vectors: 5.63 msHNSW, 2000 MB cache @ 1,000 vectors: 6.94 msHNSW, 2000 MB cache @ 10,000 vectors: 25.8 msHNSW, 2000 MB cache @ 50,000 vectors: 114 msHNSW, 2000 MB cache @ 100,000 vectors: 203.6 msHNSW, 2000 MB cache @ 500,000 vectors: 323.2 msHNSW, 2000 MB cache @ 1,000,000 vectors: 265.6 ms

Flush

ms · ▼ lower is better · log scale

1 10 100 1k 10k 5001k10k50k100k500k1Mvectors IVS, 10 MB cache @ 500 vectors: 16.8 msIVS, 10 MB cache @ 1,000 vectors: 15.4 msIVS, 10 MB cache @ 10,000 vectors: 14.9 msIVS, 10 MB cache @ 50,000 vectors: 40.2 msIVS, 10 MB cache @ 100,000 vectors: 873.6 msIVS, 10 MB cache @ 500,000 vectors: 78.4 msIVS, 10 MB cache @ 1,000,000 vectors: 78.2 ms IVS, 100 MB cache @ 500 vectors: 16.6 msIVS, 100 MB cache @ 1,000 vectors: 15.5 msIVS, 100 MB cache @ 10,000 vectors: 14 msIVS, 100 MB cache @ 50,000 vectors: 59.9 msIVS, 100 MB cache @ 100,000 vectors: 1.02k msIVS, 100 MB cache @ 500,000 vectors: 87 msIVS, 100 MB cache @ 1,000,000 vectors: 88.4 ms IVS, 500 MB cache @ 500 vectors: 15.6 msIVS, 500 MB cache @ 1,000 vectors: 13.9 msIVS, 500 MB cache @ 10,000 vectors: 14.6 msIVS, 500 MB cache @ 50,000 vectors: 39.1 msIVS, 500 MB cache @ 100,000 vectors: 970.9 msIVS, 500 MB cache @ 500,000 vectors: 76.6 msIVS, 500 MB cache @ 1,000,000 vectors: 102.2 ms IVS, 2000 MB cache @ 500 vectors: 15.1 msIVS, 2000 MB cache @ 1,000 vectors: 14.8 msIVS, 2000 MB cache @ 10,000 vectors: 14.1 msIVS, 2000 MB cache @ 50,000 vectors: 34.9 msIVS, 2000 MB cache @ 100,000 vectors: 1.09k msIVS, 2000 MB cache @ 500,000 vectors: 77.1 msIVS, 2000 MB cache @ 1,000,000 vectors: 94.5 ms HNSW, 10 MB cache @ 500 vectors: 4.6 msHNSW, 10 MB cache @ 1,000 vectors: 3.82 msHNSW, 10 MB cache @ 10,000 vectors: 4.74 msHNSW, 10 MB cache @ 50,000 vectors: 4.66 msHNSW, 10 MB cache @ 100,000 vectors: 4.72 msHNSW, 10 MB cache @ 500,000 vectors: 6.18 msHNSW, 10 MB cache @ 1,000,000 vectors: 5.88 ms HNSW, 100 MB cache @ 500 vectors: 4.36 msHNSW, 100 MB cache @ 1,000 vectors: 4.79 msHNSW, 100 MB cache @ 10,000 vectors: 4.44 msHNSW, 100 MB cache @ 50,000 vectors: 12.2 msHNSW, 100 MB cache @ 100,000 vectors: 44.2 msHNSW, 100 MB cache @ 500,000 vectors: 42.5 msHNSW, 100 MB cache @ 1,000,000 vectors: 14.2 ms HNSW, 500 MB cache @ 500 vectors: 7.46 msHNSW, 500 MB cache @ 1,000 vectors: 4.91 msHNSW, 500 MB cache @ 10,000 vectors: 5.58 msHNSW, 500 MB cache @ 50,000 vectors: 9.86 msHNSW, 500 MB cache @ 100,000 vectors: 21 msHNSW, 500 MB cache @ 500,000 vectors: 23.6 msHNSW, 500 MB cache @ 1,000,000 vectors: 21 ms HNSW, 2000 MB cache @ 500 vectors: 4.98 msHNSW, 2000 MB cache @ 1,000 vectors: 4.92 msHNSW, 2000 MB cache @ 10,000 vectors: 5.57 msHNSW, 2000 MB cache @ 50,000 vectors: 10.5 msHNSW, 2000 MB cache @ 100,000 vectors: 14.5 msHNSW, 2000 MB cache @ 500,000 vectors: 53 msHNSW, 2000 MB cache @ 1,000,000 vectors: 18.9 ms

Open

ms · ▼ lower is better · log scale

0.1 1 10 100 1k 10k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 10.2 msMemory, 10 MB cache @ 1,000 vectors: 11.9 msMemory, 10 MB cache @ 10,000 vectors: 62.1 msMemory, 10 MB cache @ 50,000 vectors: 412.7 msMemory, 10 MB cache @ 100,000 vectors: 708.8 msMemory, 10 MB cache @ 500,000 vectors: 2.54k msMemory, 10 MB cache @ 1,000,000 vectors: 5.33k ms Memory, 100 MB cache @ 500 vectors: 11.7 msMemory, 100 MB cache @ 1,000 vectors: 11.7 msMemory, 100 MB cache @ 10,000 vectors: 60.9 msMemory, 100 MB cache @ 50,000 vectors: 392.7 msMemory, 100 MB cache @ 100,000 vectors: 709.3 msMemory, 100 MB cache @ 500,000 vectors: 3.16k msMemory, 100 MB cache @ 1,000,000 vectors: 6.77k ms Memory, 500 MB cache @ 500 vectors: 11.2 msMemory, 500 MB cache @ 1,000 vectors: 12.1 msMemory, 500 MB cache @ 10,000 vectors: 60.3 msMemory, 500 MB cache @ 50,000 vectors: 401.9 msMemory, 500 MB cache @ 100,000 vectors: 699.4 msMemory, 500 MB cache @ 500,000 vectors: 2.55k msMemory, 500 MB cache @ 1,000,000 vectors: 6.52k ms Memory, 2000 MB cache @ 500 vectors: 12.2 msMemory, 2000 MB cache @ 1,000 vectors: 10.9 msMemory, 2000 MB cache @ 10,000 vectors: 59.3 msMemory, 2000 MB cache @ 50,000 vectors: 417.2 msMemory, 2000 MB cache @ 100,000 vectors: 702.5 msMemory, 2000 MB cache @ 500,000 vectors: 2.47k msMemory, 2000 MB cache @ 1,000,000 vectors: 7.35k ms IVS, 10 MB cache @ 500 vectors: 1.4 msIVS, 10 MB cache @ 1,000 vectors: 0.8 msIVS, 10 MB cache @ 10,000 vectors: 2.92 msIVS, 10 MB cache @ 50,000 vectors: 4.04 msIVS, 10 MB cache @ 100,000 vectors: 7.87 msIVS, 10 MB cache @ 500,000 vectors: 44.6 msIVS, 10 MB cache @ 1,000,000 vectors: 71.7 ms IVS, 100 MB cache @ 500 vectors: 0.79 msIVS, 100 MB cache @ 1,000 vectors: 0.82 msIVS, 100 MB cache @ 10,000 vectors: 1.03 msIVS, 100 MB cache @ 50,000 vectors: 3.05 msIVS, 100 MB cache @ 100,000 vectors: 8.05 msIVS, 100 MB cache @ 500,000 vectors: 45.1 msIVS, 100 MB cache @ 1,000,000 vectors: 75.1 ms IVS, 500 MB cache @ 500 vectors: 0.81 msIVS, 500 MB cache @ 1,000 vectors: 0.78 msIVS, 500 MB cache @ 10,000 vectors: 1 msIVS, 500 MB cache @ 50,000 vectors: 2.81 msIVS, 500 MB cache @ 100,000 vectors: 7.86 msIVS, 500 MB cache @ 500,000 vectors: 44.3 msIVS, 500 MB cache @ 1,000,000 vectors: 75 ms IVS, 2000 MB cache @ 500 vectors: 0.79 msIVS, 2000 MB cache @ 1,000 vectors: 0.85 msIVS, 2000 MB cache @ 10,000 vectors: 1.01 msIVS, 2000 MB cache @ 50,000 vectors: 2.79 msIVS, 2000 MB cache @ 100,000 vectors: 7.6 msIVS, 2000 MB cache @ 500,000 vectors: 47.2 msIVS, 2000 MB cache @ 1,000,000 vectors: 75 ms HNSW, 10 MB cache @ 500 vectors: 8.56 msHNSW, 10 MB cache @ 1,000 vectors: 9.57 msHNSW, 10 MB cache @ 10,000 vectors: 4.8 msHNSW, 10 MB cache @ 50,000 vectors: 8.38 msHNSW, 10 MB cache @ 100,000 vectors: 16.1 msHNSW, 10 MB cache @ 500,000 vectors: 19.4 msHNSW, 10 MB cache @ 1,000,000 vectors: 39.3 ms HNSW, 100 MB cache @ 500 vectors: 10.9 msHNSW, 100 MB cache @ 1,000 vectors: 15.8 msHNSW, 100 MB cache @ 10,000 vectors: 17.9 msHNSW, 100 MB cache @ 50,000 vectors: 28.7 msHNSW, 100 MB cache @ 100,000 vectors: 15.1 msHNSW, 100 MB cache @ 500,000 vectors: 19.2 msHNSW, 100 MB cache @ 1,000,000 vectors: 31.5 ms HNSW, 500 MB cache @ 500 vectors: 15.5 msHNSW, 500 MB cache @ 1,000 vectors: 11.9 msHNSW, 500 MB cache @ 10,000 vectors: 19.3 msHNSW, 500 MB cache @ 50,000 vectors: 79.1 msHNSW, 500 MB cache @ 100,000 vectors: 50.1 msHNSW, 500 MB cache @ 500,000 vectors: 22.8 msHNSW, 500 MB cache @ 1,000,000 vectors: 31.2 ms HNSW, 2000 MB cache @ 500 vectors: 10.1 msHNSW, 2000 MB cache @ 1,000 vectors: 12.7 msHNSW, 2000 MB cache @ 10,000 vectors: 18.1 msHNSW, 2000 MB cache @ 50,000 vectors: 91.2 msHNSW, 2000 MB cache @ 100,000 vectors: 152.4 msHNSW, 2000 MB cache @ 500,000 vectors: 174 msHNSW, 2000 MB cache @ 1,000,000 vectors: 362.2 ms

Footprint

Memory

MB · ▼ lower is better · log scale

0.1 1 10 100 1k 10k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 2.99 MBMemory, 10 MB cache @ 1,000 vectors: 5.97 MBMemory, 10 MB cache @ 10,000 vectors: 59.3 MBMemory, 10 MB cache @ 50,000 vectors: 296.1 MBMemory, 10 MB cache @ 100,000 vectors: 592.4 MBMemory, 10 MB cache @ 500,000 vectors: 2.96k MBMemory, 10 MB cache @ 1,000,000 vectors: 5.92k MB Memory, 100 MB cache @ 500 vectors: 2.99 MBMemory, 100 MB cache @ 1,000 vectors: 5.97 MBMemory, 100 MB cache @ 10,000 vectors: 59.3 MBMemory, 100 MB cache @ 50,000 vectors: 296.1 MBMemory, 100 MB cache @ 100,000 vectors: 592.4 MBMemory, 100 MB cache @ 500,000 vectors: 2.96k MBMemory, 100 MB cache @ 1,000,000 vectors: 5.92k MB Memory, 500 MB cache @ 500 vectors: 2.99 MBMemory, 500 MB cache @ 1,000 vectors: 5.97 MBMemory, 500 MB cache @ 10,000 vectors: 59.3 MBMemory, 500 MB cache @ 50,000 vectors: 296.1 MBMemory, 500 MB cache @ 100,000 vectors: 592.4 MBMemory, 500 MB cache @ 500,000 vectors: 2.96k MBMemory, 500 MB cache @ 1,000,000 vectors: 5.92k MB Memory, 2000 MB cache @ 500 vectors: 2.99 MBMemory, 2000 MB cache @ 1,000 vectors: 5.97 MBMemory, 2000 MB cache @ 10,000 vectors: 59.3 MBMemory, 2000 MB cache @ 50,000 vectors: 296.1 MBMemory, 2000 MB cache @ 100,000 vectors: 592.4 MBMemory, 2000 MB cache @ 500,000 vectors: 2.96k MBMemory, 2000 MB cache @ 1,000,000 vectors: 5.92k MB IVS, 10 MB cache @ 500 vectors: 3.01 MBIVS, 10 MB cache @ 1,000 vectors: 6.02 MBIVS, 10 MB cache @ 10,000 vectors: 0.99 MBIVS, 10 MB cache @ 50,000 vectors: 3.27 MBIVS, 10 MB cache @ 100,000 vectors: 6.29 MBIVS, 10 MB cache @ 500,000 vectors: 26.4 MBIVS, 10 MB cache @ 1,000,000 vectors: 53.5 MB IVS, 100 MB cache @ 500 vectors: 3.01 MBIVS, 100 MB cache @ 1,000 vectors: 6.02 MBIVS, 100 MB cache @ 10,000 vectors: 0.99 MBIVS, 100 MB cache @ 50,000 vectors: 3.27 MBIVS, 100 MB cache @ 100,000 vectors: 6.29 MBIVS, 100 MB cache @ 500,000 vectors: 26.4 MBIVS, 100 MB cache @ 1,000,000 vectors: 53.5 MB IVS, 500 MB cache @ 500 vectors: 3.01 MBIVS, 500 MB cache @ 1,000 vectors: 6.02 MBIVS, 500 MB cache @ 10,000 vectors: 0.99 MBIVS, 500 MB cache @ 50,000 vectors: 3.27 MBIVS, 500 MB cache @ 100,000 vectors: 6.29 MBIVS, 500 MB cache @ 500,000 vectors: 26.4 MBIVS, 500 MB cache @ 1,000,000 vectors: 53.5 MB IVS, 2000 MB cache @ 500 vectors: 3.01 MBIVS, 2000 MB cache @ 1,000 vectors: 6.02 MBIVS, 2000 MB cache @ 10,000 vectors: 0.99 MBIVS, 2000 MB cache @ 50,000 vectors: 3.27 MBIVS, 2000 MB cache @ 100,000 vectors: 6.29 MBIVS, 2000 MB cache @ 500,000 vectors: 26.4 MBIVS, 2000 MB cache @ 1,000,000 vectors: 53.5 MB HNSW, 10 MB cache @ 500 vectors: 4.82 MBHNSW, 10 MB cache @ 1,000 vectors: 9.01 MBHNSW, 10 MB cache @ 10,000 vectors: 11.8 MBHNSW, 10 MB cache @ 50,000 vectors: 14.5 MBHNSW, 10 MB cache @ 100,000 vectors: 18.3 MBHNSW, 10 MB cache @ 500,000 vectors: 42.4 MBHNSW, 10 MB cache @ 1,000,000 vectors: 76.4 MB HNSW, 100 MB cache @ 500 vectors: 34.4 MBHNSW, 100 MB cache @ 1,000 vectors: 37.4 MBHNSW, 100 MB cache @ 10,000 vectors: 96.5 MBHNSW, 100 MB cache @ 50,000 vectors: 104.1 MBHNSW, 100 MB cache @ 100,000 vectors: 200.2 MBHNSW, 100 MB cache @ 500,000 vectors: 917.8 MBHNSW, 100 MB cache @ 1,000,000 vectors: 1.81k MB HNSW, 500 MB cache @ 500 vectors: 34.4 MBHNSW, 500 MB cache @ 1,000 vectors: 37.4 MBHNSW, 500 MB cache @ 10,000 vectors: 94.5 MBHNSW, 500 MB cache @ 50,000 vectors: 424.6 MBHNSW, 500 MB cache @ 100,000 vectors: 217 MBHNSW, 500 MB cache @ 500,000 vectors: 935.9 MBHNSW, 500 MB cache @ 1,000,000 vectors: 1.83k MB HNSW, 2000 MB cache @ 500 vectors: 34.5 MBHNSW, 2000 MB cache @ 1,000 vectors: 37.4 MBHNSW, 2000 MB cache @ 10,000 vectors: 94.5 MBHNSW, 2000 MB cache @ 50,000 vectors: 424.6 MBHNSW, 2000 MB cache @ 100,000 vectors: 816.7 MBHNSW, 2000 MB cache @ 500,000 vectors: 935.9 MBHNSW, 2000 MB cache @ 1,000,000 vectors: 1.83k MB

Warm memory

MB · ▼ lower is better · log scale

1 10 100 1k 10k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 3.67 MBMemory, 10 MB cache @ 1,000 vectors: 6.64 MBMemory, 10 MB cache @ 10,000 vectors: 60 MBMemory, 10 MB cache @ 50,000 vectors: 299.2 MBMemory, 10 MB cache @ 100,000 vectors: 598.5 MBMemory, 10 MB cache @ 500,000 vectors: 2.97k MBMemory, 10 MB cache @ 1,000,000 vectors: 5.93k MB Memory, 100 MB cache @ 500 vectors: 3.65 MBMemory, 100 MB cache @ 1,000 vectors: 6.63 MBMemory, 100 MB cache @ 10,000 vectors: 60 MBMemory, 100 MB cache @ 50,000 vectors: 299.2 MBMemory, 100 MB cache @ 100,000 vectors: 598.5 MBMemory, 100 MB cache @ 500,000 vectors: 2.97k MBMemory, 100 MB cache @ 1,000,000 vectors: 5.93k MB Memory, 500 MB cache @ 500 vectors: 3.66 MBMemory, 500 MB cache @ 1,000 vectors: 6.64 MBMemory, 500 MB cache @ 10,000 vectors: 60 MBMemory, 500 MB cache @ 50,000 vectors: 299.2 MBMemory, 500 MB cache @ 100,000 vectors: 598.5 MBMemory, 500 MB cache @ 500,000 vectors: 2.97k MBMemory, 500 MB cache @ 1,000,000 vectors: 5.93k MB Memory, 2000 MB cache @ 500 vectors: 3.66 MBMemory, 2000 MB cache @ 1,000 vectors: 6.64 MBMemory, 2000 MB cache @ 10,000 vectors: 60 MBMemory, 2000 MB cache @ 50,000 vectors: 299.2 MBMemory, 2000 MB cache @ 100,000 vectors: 598.5 MBMemory, 2000 MB cache @ 500,000 vectors: 2.97k MBMemory, 2000 MB cache @ 1,000,000 vectors: 5.93k MB IVS, 10 MB cache @ 500 vectors: 7.16 MBIVS, 10 MB cache @ 1,000 vectors: 13.1 MBIVS, 10 MB cache @ 10,000 vectors: 2.18 MBIVS, 10 MB cache @ 50,000 vectors: 9.08 MBIVS, 10 MB cache @ 100,000 vectors: 12.2 MBIVS, 10 MB cache @ 500,000 vectors: 31.8 MBIVS, 10 MB cache @ 1,000,000 vectors: 62.8 MB IVS, 100 MB cache @ 500 vectors: 7.16 MBIVS, 100 MB cache @ 1,000 vectors: 13.1 MBIVS, 100 MB cache @ 10,000 vectors: 60.9 MBIVS, 100 MB cache @ 50,000 vectors: 101.4 MBIVS, 100 MB cache @ 100,000 vectors: 103.9 MBIVS, 100 MB cache @ 500,000 vectors: 124.1 MBIVS, 100 MB cache @ 1,000,000 vectors: 147.4 MB IVS, 500 MB cache @ 500 vectors: 7.16 MBIVS, 500 MB cache @ 1,000 vectors: 13.1 MBIVS, 500 MB cache @ 10,000 vectors: 60.9 MBIVS, 500 MB cache @ 50,000 vectors: 302.5 MBIVS, 500 MB cache @ 100,000 vectors: 505.1 MBIVS, 500 MB cache @ 500,000 vectors: 521.8 MBIVS, 500 MB cache @ 1,000,000 vectors: 551.7 MB IVS, 2000 MB cache @ 500 vectors: 7.16 MBIVS, 2000 MB cache @ 1,000 vectors: 13.1 MBIVS, 2000 MB cache @ 10,000 vectors: 60.9 MBIVS, 2000 MB cache @ 50,000 vectors: 302.4 MBIVS, 2000 MB cache @ 100,000 vectors: 604.3 MBIVS, 2000 MB cache @ 500,000 vectors: 2.02k MBIVS, 2000 MB cache @ 1,000,000 vectors: 2.03k MB HNSW, 10 MB cache @ 500 vectors: 13.6 MBHNSW, 10 MB cache @ 1,000 vectors: 19.8 MBHNSW, 10 MB cache @ 10,000 vectors: 37.5 MBHNSW, 10 MB cache @ 50,000 vectors: 43.8 MBHNSW, 10 MB cache @ 100,000 vectors: 50.4 MBHNSW, 10 MB cache @ 500,000 vectors: 48.1 MBHNSW, 10 MB cache @ 1,000,000 vectors: 81 MB HNSW, 100 MB cache @ 500 vectors: 42.8 MBHNSW, 100 MB cache @ 1,000 vectors: 48.1 MBHNSW, 100 MB cache @ 10,000 vectors: 120.7 MBHNSW, 100 MB cache @ 50,000 vectors: 129.3 MBHNSW, 100 MB cache @ 100,000 vectors: 225.5 MBHNSW, 100 MB cache @ 500,000 vectors: 918.7 MBHNSW, 100 MB cache @ 1,000,000 vectors: 1.81k MB HNSW, 500 MB cache @ 500 vectors: 42.8 MBHNSW, 500 MB cache @ 1,000 vectors: 46.1 MBHNSW, 500 MB cache @ 10,000 vectors: 119.7 MBHNSW, 500 MB cache @ 50,000 vectors: 449.8 MBHNSW, 500 MB cache @ 100,000 vectors: 242.2 MBHNSW, 500 MB cache @ 500,000 vectors: 936.8 MBHNSW, 500 MB cache @ 1,000,000 vectors: 1.83k MB HNSW, 2000 MB cache @ 500 vectors: 42.8 MBHNSW, 2000 MB cache @ 1,000 vectors: 46.1 MBHNSW, 2000 MB cache @ 10,000 vectors: 119.7 MBHNSW, 2000 MB cache @ 50,000 vectors: 449.8 MBHNSW, 2000 MB cache @ 100,000 vectors: 842.1 MBHNSW, 2000 MB cache @ 500,000 vectors: 936.8 MBHNSW, 2000 MB cache @ 1,000,000 vectors: 1.83k MB

Working set

MB · ▼ lower is better · log scale

10 100 1k 10k 100k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 13.8 MBMemory, 10 MB cache @ 1,000 vectors: 19.3 MBMemory, 10 MB cache @ 10,000 vectors: 357.6 MBMemory, 10 MB cache @ 50,000 vectors: 1.39k MBMemory, 10 MB cache @ 100,000 vectors: 2.89k MBMemory, 10 MB cache @ 500,000 vectors: 13.47k MBMemory, 10 MB cache @ 1,000,000 vectors: 9.93k MB Memory, 100 MB cache @ 500 vectors: 14.2 MBMemory, 100 MB cache @ 1,000 vectors: 19.4 MBMemory, 100 MB cache @ 10,000 vectors: 326.4 MBMemory, 100 MB cache @ 50,000 vectors: 1.39k MBMemory, 100 MB cache @ 100,000 vectors: 2.89k MBMemory, 100 MB cache @ 500,000 vectors: 5.56k MBMemory, 100 MB cache @ 1,000,000 vectors: 7.45k MB Memory, 500 MB cache @ 500 vectors: 13.6 MBMemory, 500 MB cache @ 1,000 vectors: 19.1 MBMemory, 500 MB cache @ 10,000 vectors: 326.3 MBMemory, 500 MB cache @ 50,000 vectors: 1.39k MBMemory, 500 MB cache @ 100,000 vectors: 2.89k MBMemory, 500 MB cache @ 500,000 vectors: 12.43k MBMemory, 500 MB cache @ 1,000,000 vectors: 11.82k MB Memory, 2000 MB cache @ 500 vectors: 13.9 MBMemory, 2000 MB cache @ 1,000 vectors: 19.5 MBMemory, 2000 MB cache @ 10,000 vectors: 357.5 MBMemory, 2000 MB cache @ 50,000 vectors: 1.39k MBMemory, 2000 MB cache @ 100,000 vectors: 2.89k MBMemory, 2000 MB cache @ 500,000 vectors: 13.44k MBMemory, 2000 MB cache @ 1,000,000 vectors: 11.33k MB IVS, 10 MB cache @ 500 vectors: 19.5 MBIVS, 10 MB cache @ 1,000 vectors: 27.8 MBIVS, 10 MB cache @ 10,000 vectors: 368.1 MBIVS, 10 MB cache @ 50,000 vectors: 1.48k MBIVS, 10 MB cache @ 100,000 vectors: 2.83k MBIVS, 10 MB cache @ 500,000 vectors: 9.37k MBIVS, 10 MB cache @ 1,000,000 vectors: 8.23k MB IVS, 100 MB cache @ 500 vectors: 19.6 MBIVS, 100 MB cache @ 1,000 vectors: 27.7 MBIVS, 100 MB cache @ 10,000 vectors: 72.5 MBIVS, 100 MB cache @ 50,000 vectors: 1.81k MBIVS, 100 MB cache @ 100,000 vectors: 2.18k MBIVS, 100 MB cache @ 500,000 vectors: 7.38k MBIVS, 100 MB cache @ 1,000,000 vectors: 7.84k MB IVS, 500 MB cache @ 500 vectors: 19.5 MBIVS, 500 MB cache @ 1,000 vectors: 27.8 MBIVS, 500 MB cache @ 10,000 vectors: 71.6 MBIVS, 500 MB cache @ 50,000 vectors: 766.2 MBIVS, 500 MB cache @ 100,000 vectors: 1.2k MBIVS, 500 MB cache @ 500,000 vectors: 9.36k MBIVS, 500 MB cache @ 1,000,000 vectors: 8.35k MB IVS, 2000 MB cache @ 500 vectors: 19.6 MBIVS, 2000 MB cache @ 1,000 vectors: 27.8 MBIVS, 2000 MB cache @ 10,000 vectors: 72.2 MBIVS, 2000 MB cache @ 50,000 vectors: 766.3 MBIVS, 2000 MB cache @ 100,000 vectors: 1.41k MBIVS, 2000 MB cache @ 500,000 vectors: 3.93k MBIVS, 2000 MB cache @ 1,000,000 vectors: 6.91k MB HNSW, 10 MB cache @ 500 vectors: 28.8 MBHNSW, 10 MB cache @ 1,000 vectors: 38.4 MBHNSW, 10 MB cache @ 10,000 vectors: 47.7 MBHNSW, 10 MB cache @ 50,000 vectors: 60.1 MBHNSW, 10 MB cache @ 100,000 vectors: 76.4 MBHNSW, 10 MB cache @ 500,000 vectors: 78.2 MB HNSW, 100 MB cache @ 500 vectors: 18.4 MBHNSW, 100 MB cache @ 1,000 vectors: 30 MBHNSW, 100 MB cache @ 10,000 vectors: 94.2 MBHNSW, 100 MB cache @ 50,000 vectors: 137.6 MBHNSW, 100 MB cache @ 100,000 vectors: 242.3 MBHNSW, 100 MB cache @ 500,000 vectors: 943.8 MBHNSW, 100 MB cache @ 1,000,000 vectors: 1.82k MB HNSW, 500 MB cache @ 500 vectors: 22.9 MBHNSW, 500 MB cache @ 1,000 vectors: 29.9 MBHNSW, 500 MB cache @ 10,000 vectors: 92.5 MBHNSW, 500 MB cache @ 50,000 vectors: 421.9 MBHNSW, 500 MB cache @ 100,000 vectors: 267.6 MBHNSW, 500 MB cache @ 500,000 vectors: 949.8 MBHNSW, 500 MB cache @ 1,000,000 vectors: 1.86k MB HNSW, 2000 MB cache @ 500 vectors: 18.8 MBHNSW, 2000 MB cache @ 1,000 vectors: 29.9 MBHNSW, 2000 MB cache @ 10,000 vectors: 91.3 MBHNSW, 2000 MB cache @ 50,000 vectors: 421.8 MBHNSW, 2000 MB cache @ 100,000 vectors: 827.8 MBHNSW, 2000 MB cache @ 500,000 vectors: 1.03k MBHNSW, 2000 MB cache @ 1,000,000 vectors: 1.86k MB

Disk

MB · ▼ lower is better · log scale

1 10 100 1k 10k 5001k10k50k100k500k1Mvectors Memory, 10 MB cache @ 500 vectors: 2.94 MBMemory, 10 MB cache @ 1,000 vectors: 5.87 MBMemory, 10 MB cache @ 10,000 vectors: 58.7 MBMemory, 10 MB cache @ 50,000 vectors: 293.5 MBMemory, 10 MB cache @ 100,000 vectors: 587.1 MBMemory, 10 MB cache @ 500,000 vectors: 2.94k MBMemory, 10 MB cache @ 1,000,000 vectors: 5.87k MB Memory, 100 MB cache @ 500 vectors: 2.94 MBMemory, 100 MB cache @ 1,000 vectors: 5.87 MBMemory, 100 MB cache @ 10,000 vectors: 58.7 MBMemory, 100 MB cache @ 50,000 vectors: 293.5 MBMemory, 100 MB cache @ 100,000 vectors: 587.1 MBMemory, 100 MB cache @ 500,000 vectors: 2.94k MBMemory, 100 MB cache @ 1,000,000 vectors: 5.87k MB Memory, 500 MB cache @ 500 vectors: 2.94 MBMemory, 500 MB cache @ 1,000 vectors: 5.87 MBMemory, 500 MB cache @ 10,000 vectors: 58.7 MBMemory, 500 MB cache @ 50,000 vectors: 293.5 MBMemory, 500 MB cache @ 100,000 vectors: 587.1 MBMemory, 500 MB cache @ 500,000 vectors: 2.94k MBMemory, 500 MB cache @ 1,000,000 vectors: 5.87k MB Memory, 2000 MB cache @ 500 vectors: 2.94 MBMemory, 2000 MB cache @ 1,000 vectors: 5.87 MBMemory, 2000 MB cache @ 10,000 vectors: 58.7 MBMemory, 2000 MB cache @ 50,000 vectors: 293.5 MBMemory, 2000 MB cache @ 100,000 vectors: 587.1 MBMemory, 2000 MB cache @ 500,000 vectors: 2.94k MBMemory, 2000 MB cache @ 1,000,000 vectors: 5.87k MB IVS, 10 MB cache @ 500 vectors: 2.93 MBIVS, 10 MB cache @ 1,000 vectors: 5.86 MBIVS, 10 MB cache @ 10,000 vectors: 58.6 MBIVS, 10 MB cache @ 50,000 vectors: 293.7 MBIVS, 10 MB cache @ 100,000 vectors: 587.5 MBIVS, 10 MB cache @ 500,000 vectors: 2.94k MBIVS, 10 MB cache @ 1,000,000 vectors: 5.87k MB IVS, 100 MB cache @ 500 vectors: 2.93 MBIVS, 100 MB cache @ 1,000 vectors: 5.86 MBIVS, 100 MB cache @ 10,000 vectors: 58.6 MBIVS, 100 MB cache @ 50,000 vectors: 293.7 MBIVS, 100 MB cache @ 100,000 vectors: 587.5 MBIVS, 100 MB cache @ 500,000 vectors: 2.94k MBIVS, 100 MB cache @ 1,000,000 vectors: 5.87k MB IVS, 500 MB cache @ 500 vectors: 2.93 MBIVS, 500 MB cache @ 1,000 vectors: 5.86 MBIVS, 500 MB cache @ 10,000 vectors: 58.6 MBIVS, 500 MB cache @ 50,000 vectors: 293.7 MBIVS, 500 MB cache @ 100,000 vectors: 587.5 MBIVS, 500 MB cache @ 500,000 vectors: 2.94k MBIVS, 500 MB cache @ 1,000,000 vectors: 5.87k MB IVS, 2000 MB cache @ 500 vectors: 2.93 MBIVS, 2000 MB cache @ 1,000 vectors: 5.86 MBIVS, 2000 MB cache @ 10,000 vectors: 58.6 MBIVS, 2000 MB cache @ 50,000 vectors: 293.7 MBIVS, 2000 MB cache @ 100,000 vectors: 587.5 MBIVS, 2000 MB cache @ 500,000 vectors: 2.94k MBIVS, 2000 MB cache @ 1,000,000 vectors: 5.87k MB HNSW, 10 MB cache @ 500 vectors: 3.8 MBHNSW, 10 MB cache @ 1,000 vectors: 7.6 MBHNSW, 10 MB cache @ 10,000 vectors: 76 MBHNSW, 10 MB cache @ 50,000 vectors: 379.8 MBHNSW, 10 MB cache @ 100,000 vectors: 759.6 MBHNSW, 10 MB cache @ 500,000 vectors: 3.8k MBHNSW, 10 MB cache @ 1,000,000 vectors: 7.6k MB HNSW, 100 MB cache @ 500 vectors: 3.8 MBHNSW, 100 MB cache @ 1,000 vectors: 7.6 MBHNSW, 100 MB cache @ 10,000 vectors: 76 MBHNSW, 100 MB cache @ 50,000 vectors: 379.8 MBHNSW, 100 MB cache @ 100,000 vectors: 759.6 MBHNSW, 100 MB cache @ 500,000 vectors: 3.8k MBHNSW, 100 MB cache @ 1,000,000 vectors: 7.6k MB HNSW, 500 MB cache @ 500 vectors: 3.8 MBHNSW, 500 MB cache @ 1,000 vectors: 7.6 MBHNSW, 500 MB cache @ 10,000 vectors: 76 MBHNSW, 500 MB cache @ 50,000 vectors: 379.8 MBHNSW, 500 MB cache @ 100,000 vectors: 759.6 MBHNSW, 500 MB cache @ 500,000 vectors: 3.8k MBHNSW, 500 MB cache @ 1,000,000 vectors: 7.6k MB HNSW, 2000 MB cache @ 500 vectors: 3.8 MBHNSW, 2000 MB cache @ 1,000 vectors: 7.6 MBHNSW, 2000 MB cache @ 10,000 vectors: 76 MBHNSW, 2000 MB cache @ 50,000 vectors: 379.8 MBHNSW, 2000 MB cache @ 100,000 vectors: 759.6 MBHNSW, 2000 MB cache @ 500,000 vectors: 3.8k MBHNSW, 2000 MB cache @ 1,000,000 vectors: 7.6k MB

Raw numbers

EngineVectorsCache MBIndex
inserts/s
Update
updates/s
Remove
removes/s
Mixed
ops/s
Top10
queries/s
Top100
queries/s
NoFloor
queries/s
Filter
queries/s
Recall
%
Filter recall
%
Save
ms
Flush
ms
Open
ms
Cold search
ms
Memory
MB
Warm memory
MB
Working set
MB
Disk
MB
Memory5001034.23k1.25M30.86M16.18k9.78k8.7k12.76k11.15k10010013.710.20.252.993.6713.82.94
IVS5001024.53k1.18M12.08M12.21k8.74k9.98k10.93k12.49k1001008.5616.81.41.663.017.1619.52.93
HNSW500101.5k1.72k3.39M1.24k1.69k1.91k2.04k2.11k1001005.644.68.562.54.8213.628.83.8
Memory50010035.85k1.52M31.06M16.04k4.23k4.11k12.64k11.3k1001001311.70.272.993.6514.22.94
IVS50010023.26k1.49M12.08M12.38k8.47k9.3k11.36k12.48k1001007.7716.60.791.663.017.1619.62.93
HNSW5001006.92k1.92k18.66M4.6k11.3k11.01k12k12.01k1001005.944.3610.90.2234.442.818.43.8
Memory50050034.32k1.38M30.49M16.48k2.31k4.17k10.4k10.81k10010012.811.20.222.993.6613.62.94
IVS50050026.22k1.41M12.72M12.36k8.75k9.88k10.71k12.09k1001008.7715.60.811.483.017.1619.52.93
HNSW5005006.8k1.85k13.66M4.5k11.81k12.61k10.44k17.51k1001005.837.4615.50.2134.442.822.93.8
Memory500200036.15k1.42M29.94M16.21k6.6k8.79k10.95k11.67k10010012.712.20.272.993.6613.92.94
IVS500200024.76k1.29M13.16M12.79k9.01k9.99k10k12.67k1001008.8515.10.791.513.017.1619.62.93
HNSW50020006.87k1.94k21.01M4.49k12.26k12.99k16.15k25.76k1001005.634.9810.10.2234.542.818.83.8
Memory1,0001040.31k1.59M32.47M13.77k2.76k5.97k8.93k9.02k10010019.911.90.295.976.6419.35.87
IVS1,0001043.8k1.39M14.06M7.99k5.67k5.44k7.01k6.99k1001007.5915.40.81.496.0213.127.85.86
HNSW1,000101.34k2.56k2.35M706.11.11k1.16k1.25k1.31k1001006.63.829.573.949.0119.838.47.6
Memory1,00010036.19k1.52M33.56M13.53k4.28k4.09k9.28k8.83k10010020.611.70.285.976.6319.45.87
IVS1,00010045.34k1.33M7.03M7k5k5.07k6.98k6.6k1001008.3915.50.821.526.0213.127.75.86
HNSW1,0001009.21k2.16k10.25M6.02k11.33k11.76k10.08k16.7k1001006.874.7915.80.1937.448.1307.6
Memory1,00050037.83k1.47M28.49M13.23k1.95k5.8k8.51k8.84k10010020.912.10.25.976.6419.15.87
IVS1,00050045.13k1.22M16.16M7.53k5.45k5.67k6.47k6.06k1001009.1213.90.781.646.0213.127.85.86
HNSW1,0005009.14k2.24k10.16M5.98k5.63k10.37k10.02k17.03k1001006.454.9111.90.1937.446.129.97.6
Memory1,000200038.46k1.58M33.22M13.73k1.42k7.64k8.98k9.3k1001002010.90.295.976.6419.55.87
IVS1,000200046.74k1.39M7.96M6.89k5.12k5.55k6k7.12k1001007.2714.80.851.56.0213.127.85.86
HNSW1,00020009.05k2.21k9.35M6.14k5.99k10.2k10.59k17.12k1001006.944.9212.70.1937.446.129.97.6
Memory10,0001053.11k1.46M40.9M2.25k1.38k1.43k1.19k1.35k100100140.562.12.2859.360357.658.7
IVS10,00010112.91k473.22k15.29M126.979.677.876.277.31001009.114.92.9213.20.992.18368.158.6
HNSW10,00010271.51332.85M194.6151.3108.6150.438.510010025.94.744.87.8911.837.547.776
Memory10,00010053.9k1.24M25.74M2.23k1.34k1.42k1.17k1.31k100100140.160.92.159.360326.458.7
IVS10,000100135.59k1.36M16.75M964.7816.8828.8860.5880.31001009.74141.03130.9960.972.558.6
HNSW10,0001009.58k3.08k3.28M1.81k6.43k1.48k7.65k875.399.8100254.4417.90.2796.5120.794.276
Memory10,00050052.18k1.28M32.73M2.11k1.26k1.39k1.16k1.31k100100140.460.32.1459.360326.358.7
IVS10,000500137.53k1.38M18.66M957.3721.7837.6844.1868.81001009.1814.61130.9960.971.658.6
HNSW10,00050010.32k3.11k3.3M6.14k5.92k1.64k7.26k874.799.810026.45.5819.30.2794.5119.792.576
Memory10,000200054.04k1.41M30.26M2.14k1.29k1.42k1.24k1.37k100100140.859.32.1759.360357.558.7
IVS10,0002000113.14k1.45M18.28M946.3821.4827.4838.7880.31001009.1514.11.0113.10.9960.972.258.6
HNSW10,000200010.14k3.05k3.39M6.31k6.06k1.63k7.6k882.399.410025.85.5718.10.2794.5119.791.376
Memory50,0001065.76k888.81k18.35M361.5217.4216.5210.5223100100518.9412.76.97296.1299.21.39k293.5
IVS50,0001030.33k985.17k12.63M106.860.568.363.465.810094.821.740.24.0415.43.279.081.48k293.7
HNSW50,00010159227.94.29M272.9238.920.8239.915.310099.5110.44.668.384.2314.543.860.1379.8
Memory50,00010064.98k1.37M13.57M362.6222.5222.8216.6224.2100100506.5392.77.72296.1299.21.39k293.5
IVS50,00010028.38k1.38M12.75M150.896.293.495.492.610094.831.159.93.0515.13.27101.41.81k293.7
HNSW50,00010014.46k2.41k5.82M1.62k1.18k126.71.19k43.699.499.4108.912.228.71.04104.1129.3137.6379.8
Memory50,00050062.13k1.34M21.57M365.4223.3222.5215.9224.2100100538.1401.96.1296.1299.21.39k293.5
IVS50,00050029.33k1.3M12.9M744.4635.2777.2747.5805.210094.830.839.12.8116.63.27302.5766.2293.7
HNSW50,00050015.92k2.49k5.87M5.22k6.45k672.77.87k301.699.899.3108.29.8679.10.2424.6449.8421.9379.8
Memory50,000200075.34k1.41M20.12M360.8221.6219.6215.5222.5100100506.6417.25.85296.1299.21.39k293.5
IVS50,000200033.49k1.41M8.96M770.2672.8761.1745812.410094.830.434.92.7915.33.27302.4766.3293.7
HNSW50,000200015.53k2.53k6.06M5.51k6.56k719.47.98k30299.899.411410.591.20.2424.6449.8421.8379.8
Memory100,0001077.96k1.41M18.28M186.8113.6106.5109113.51001001.01k708.812.9592.4598.52.89k587.1
IVS100,0001027.87k1.37M10.67M55.13333.833.333.3100100284.3873.67.8731.96.2912.22.83k587.5
HNSW100,00010144.4159.24.02M186.6175.924.6173.71210098201.54.7216.112.918.350.476.4759.6
Memory100,00010078.8k1.42M10.12M184.7113.4112.9111113.41001001.02k709.314.7592.4598.52.89k587.1
IVS100,00010029.02k1.27M5.13M63.138.739.63737.3100100261.21.02k8.0531.36.29103.92.18k587.5
HNSW100,00010014.81k1.95k5.19M1.47k1.11k126.91.12k20.910099.921244.215.111200.2225.5242.3759.6
Memory100,00050078.83k1.37M15.79M187.4113.2113.3111.9114.1100100989.1699.412.4592.4598.52.89k587.1
IVS100,00050029.37k1.37M10.24M214.8146.6142.6146.7149.1100100245.7970.97.8630.56.29505.11.2k587.5
HNSW100,00050015.49k1.97k5.13M1.48k1.13k128.91.13k20.910099.9211.22150.11.14217242.2267.6759.6
Memory100,000200076.42k1.41M16.57M186.9112.1113.2111.6113.61001001.01k702.512.5592.4598.52.89k587.1
IVS100,000200028.57k1.44M11.04M548417411398.8417100100256.71.09k7.628.46.29604.31.41k587.5
HNSW100,000200015.62k1.88k5.3M3.9k6.11k776.65.9k187.110099.9203.614.5152.40.29816.7842.1827.8759.6
Memory500,0001083.38k1.35M11.95M38.722.922.822.223.21001005.05k2.54k62.42.96k2.97k13.47k2.94k
IVS500,0001023.52k1.33M8.11M11.77.086.897.026.9910010035.978.444.6127.126.431.89.37k2.94k
HNSW500,0001070.154.93.42M69.467.632.767.69.1983.287.2280.66.1819.414.442.448.178.23.8k
Memory500,00010081.63k1.44M12.51M38.522.92322.723.21001005.03k3.16k592.96k2.97k5.56k2.94k
IVS500,00010025.47k1.34M8.23M11.97.517.527.097.1210010037.48745.1127.526.4124.17.38k2.94k
HNSW500,00010011.07k1.23k4.18M1.1k898.3127.4895.970.880.687.1335.842.519.215.9917.8918.7943.83.8k
Memory500,00050081.75k1.35M16.45M38.823.323.323.223.11001004.98k2.55k48.12.96k2.97k12.43k2.94k
IVS500,00050024.16k1.34M8.18M13.57.827.797.958.0710010037.676.644.3127.126.4521.89.36k2.94k
HNSW500,00050011.33k1.2k4.04M1.09k903.7126.7887.570.984.687.2317.123.622.814.5935.9936.8949.83.8k
Memory500,000200083.43k1.48M15.05M38.723.323.323.123.31001004.84k2.47k64.72.96k2.97k13.44k2.94k
IVS500,000200025.25k1.29M5M29.517.417.317.217.210010048.477.147.213226.42.02k3.93k2.94k
HNSW500,000200011.28k1.22k4.08M1.09k883.9127.2887.57086.687.2323.2531741.35935.9936.81.03k3.8k
Memory1,000,0001083.37k1.33M12.74M19.211.511.611.611.61001009.78k5.33k93.45.92k5.93k9.93k5.87k
IVS1,000,0001015.29k1.32M7.86M5.593.493.533.463.2410010040.178.271.7280.853.562.88.23k5.87k
HNSW1,000,0001051.342.32.99M54.654.720.653.37.77587.7274.65.8839.317.276.48107.6k
Memory1,000,00010074.07k1.33M4.23M17.910.811.410.810.510010011.19k6.77k94.65.92k5.93k7.45k5.87k
IVS1,000,00010013.25k891.23k6.81M5.463.463.433.413.4210010042.688.475.1279.753.5147.47.84k5.87k
HNSW1,000,0001009.16k1.12k3.34M966.1817.9115836.447.174.687.7248.514.231.517.81.81k1.81k1.82k7.6k
Memory1,000,00050077.97k881.21k4.58M18.711.21111.211.410010010.48k6.52k93.95.92k5.93k11.82k5.87k
IVS1,000,00050014.94k899.73k7.54M5.93.53.513.543.5610010059.4102.27529653.5551.78.35k5.87k
HNSW1,000,0005009.44k1.12k3.83M985.3771.7109784.644.97687.7256.32131.218.21.83k1.83k1.86k7.6k
Memory1,000,000200080.34k871.54k4.59M18.710.910.911.211.310010010.25k7.35k101.15.92k5.93k11.33k5.87k
IVS1,000,000200015.16k982.17k6.57M7.754.364.554.554.3910010039.594.575293.153.52.03k6.91k5.87k
HNSW1,000,00020009.37k1.12k3.24M942761.9105.2762.244.577.289.5265.618.9362.21.851.83k1.83k1.86k7.6k