Vector Search Benchmarks¶
Compares vector similarity search engines on insert throughput, search latency, and recall across multiple embedding models, dataset sizes, and corpus types.
Engines¶
| Engine | Library | Method | Strategy |
|---|---|---|---|
| muninn-hnsw | muninn | HNSW graph index | Approximate, O(log N) search |
| sqlite-vector-quantize | sqlite-vector | Product Quantization | Approximate, O(N) scan |
| sqlite-vector-fullscan | sqlite-vector | Brute-force | Exact, O(N) scan |
| vectorlite-hnsw | vectorlite | HNSW via hnswlib | Approximate, O(log N) search |
| sqlite-vec-brute | sqlite-vec | Brute-force KNN | Exact, O(N) scan |
Datasets¶
| Dataset | Source | Passages | Topology |
|---|---|---|---|
| AG News | HuggingFace | ~120K | 4 discrete clusters |
| Wealth of Nations | Project Gutenberg | ~2,500 (256-token windows, 50-token overlap) | Continuous conceptual gradient |
Embedding Models¶
| Model | Dimension | Params | Doc Prefix | Query Prefix |
|---|---|---|---|---|
| MiniLM | 384 | 22M | (none) | (none) |
| NomicEmbed | 768 | 137M | "search_document: " |
"search_query: " |
| BGE-Large | 1024 | 335M | (none) | "Represent this sentence for se..." |
Search Latency — AG News¶
Search Latency vs Dataset Size (MiniLM / AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.12178048780487803,
0.497675,
0.8697435897435898,
2.4135,
3.068857142857143,
1.9502142857142857,
0.41
],
"marker": {
"color": "hsl(270, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(270, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23521951219512194,
1.380325,
3.1572564102564105,
10.8705,
16.824142857142856,
11.299785714285715,
0.0
],
"arrayminus": [
0.09078048780487803,
0.455675,
0.8257435897435897,
2.3575,
2.994857142857143,
1.8142142857142858,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.125,
0.14,
0.202,
1.232,
3.252,
13.921,
28.88
],
"marker": {
"color": "hsl(130, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(130, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.035,
0.134,
0.308,
2.369,
5.495,
27.219,
56.638
],
"marker": {
"color": "hsl(18, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(18, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.023,
0.05,
0.055,
0.252,
0.788,
4.522,
11.561
],
"marker": {
"color": "hsl(175, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(175, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.039634146341463415,
0.10470731707317074,
0.13073170731707318,
0.22926829268292684,
0.2866923076923077,
0.3910666666666666,
0.203
],
"marker": {
"color": "hsl(210, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(210, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.017365853658536587,
0.09729268292682927,
0.1612682926829268,
0.4097317073170732,
0.5193076923076924,
0.5139333333333334,
0.0
],
"arrayminus": [
0.016634146341463416,
0.07070731707317074,
0.09273170731707317,
0.19926829268292684,
0.24769230769230768,
0.3300666666666666,
0.0
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Search Latency vs Dataset Size (MiniLM / AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Search Latency vs Dataset Size (NomicEmbed / AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.13602439024390245,
0.5592777777777778,
0.9025625,
2.4684,
2.8293513513513515,
2.4699999999999998,
0.579
],
"marker": {
"color": "hsl(270, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(270, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23997560975609755,
1.7997222222222222,
2.8594375,
8.6676,
15.194648648648649,
2.019,
0.0
],
"arrayminus": [
0.09702439024390244,
0.49927777777777776,
0.8145625000000001,
2.3804,
2.7293513513513514,
2.0189999999999997,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.48,
0.475,
0.447,
2.794,
5.979,
30.793,
58.79
],
"marker": {
"color": "hsl(130, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(130, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.047,
0.252,
0.812,
4.626,
9.986,
51.568,
102.799
],
"marker": {
"color": "hsl(18, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(18, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.026,
0.067,
0.139,
0.891,
1.944,
12.658,
24.449
],
"marker": {
"color": "hsl(175, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(175, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.04731707317073171,
0.12282926829268291,
0.17263414634146343,
0.34217073170731704,
0.5817567567567568,
1.0683333333333334,
0.332
],
"marker": {
"color": "hsl(210, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(210, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.015682926829268293,
0.12117073170731708,
0.18236585365853655,
0.5008292682926829,
1.1682432432432432,
0.5656666666666665,
0.0
],
"arrayminus": [
0.026317073170731706,
0.08682926829268292,
0.13163414634146342,
0.28617073170731705,
0.5147567567567568,
0.7733333333333334,
0.0
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Search Latency vs Dataset Size (NomicEmbed / AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Search Latency vs Dataset Size (BGE-Large / AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.14885365853658536,
0.6287142857142857,
0.9368666666666667,
2.62815625,
2.7222142857142857,
0.506
],
"marker": {
"color": "hsl(270, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(270, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.24314634146341466,
1.8092857142857146,
2.994133333333333,
10.75584375,
18.795785714285714,
0.0
],
"arrayminus": [
0.09985365853658536,
0.5617142857142856,
0.8678666666666668,
2.52315625,
2.584214285714286,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.708,
0.701,
0.63,
3.924,
7.498,
37.987
],
"marker": {
"color": "hsl(130, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(130, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.067,
0.434,
1.005,
6.211,
12.574,
68.423
],
"marker": {
"color": "hsl(18, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(18, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.032,
0.121,
0.17,
1.477,
3.062,
17.203
],
"marker": {
"color": "hsl(175, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(175, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.053585365853658536,
0.14882926829268295,
0.20178048780487803,
0.45780487804878045,
0.5497666666666666,
0.317
],
"marker": {
"color": "hsl(210, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(210, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.01841463414634146,
0.11817073170731707,
0.21221951219512195,
0.6831951219512196,
0.8812333333333334,
0.0
],
"arrayminus": [
0.030585365853658536,
0.11382926829268294,
0.15378048780487802,
0.37480487804878043,
0.4787666666666666,
0.0
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Search Latency vs Dataset Size (BGE-Large / AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Cross-Model Comparison — AG News¶
Cross-Model Comparison (AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.14885365853658536,
0.6287142857142857,
0.9368666666666667,
2.62815625,
2.7222142857142857,
0.506
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.24314634146341466,
1.8092857142857146,
2.994133333333333,
10.75584375,
18.795785714285714,
0.0
],
"arrayminus": [
0.09985365853658536,
0.5617142857142856,
0.8678666666666668,
2.52315625,
2.584214285714286,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.12178048780487803,
0.497675,
0.8697435897435898,
2.4135,
3.068857142857143,
1.9502142857142857,
0.41
],
"marker": {
"color": "hsl(270, 78%, 47%)",
"size": 8
},
"line": {
"color": "hsl(270, 78%, 47%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23521951219512194,
1.380325,
3.1572564102564105,
10.8705,
16.824142857142856,
11.299785714285715,
0.0
],
"arrayminus": [
0.09078048780487803,
0.455675,
0.8257435897435897,
2.3575,
2.994857142857143,
1.8142142857142858,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.13602439024390245,
0.5592777777777778,
0.9025625,
2.4684,
2.8293513513513515,
2.4699999999999998,
0.579
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23997560975609755,
1.7997222222222222,
2.8594375,
8.6676,
15.194648648648649,
2.019,
0.0
],
"arrayminus": [
0.09702439024390244,
0.49927777777777776,
0.8145625000000001,
2.3804,
2.7293513513513514,
2.0189999999999997,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.708,
0.701,
0.63,
3.924,
7.498,
37.987
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.125,
0.14,
0.202,
1.232,
3.252,
13.921,
28.88
],
"marker": {
"color": "hsl(130, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(130, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.48,
0.475,
0.447,
2.794,
5.979,
30.793,
58.79
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.067,
0.434,
1.005,
6.211,
12.574,
68.423
],
"marker": {
"color": "hsl(18, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(18, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.035,
0.134,
0.308,
2.369,
5.495,
27.219,
56.638
],
"marker": {
"color": "hsl(18, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(18, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.047,
0.252,
0.812,
4.626,
9.986,
51.568,
102.799
],
"marker": {
"color": "hsl(18, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(18, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.032,
0.121,
0.17,
1.477,
3.062,
17.203
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.023,
0.05,
0.055,
0.252,
0.788,
4.522,
11.561
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.026,
0.067,
0.139,
0.891,
1.944,
12.658,
24.449
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.053585365853658536,
0.14882926829268295,
0.20178048780487803,
0.45780487804878045,
0.5497666666666666,
0.317
],
"marker": {
"color": "hsl(210, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(210, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.01841463414634146,
0.11817073170731707,
0.21221951219512195,
0.6831951219512196,
0.8812333333333334,
0.0
],
"arrayminus": [
0.030585365853658536,
0.11382926829268294,
0.15378048780487802,
0.37480487804878043,
0.4787666666666666,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.039634146341463415,
0.10470731707317074,
0.13073170731707318,
0.22926829268292684,
0.2866923076923077,
0.3910666666666666,
0.203
],
"marker": {
"color": "hsl(210, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(210, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.017365853658536587,
0.09729268292682927,
0.1612682926829268,
0.4097317073170732,
0.5193076923076924,
0.5139333333333334,
0.0
],
"arrayminus": [
0.016634146341463416,
0.07070731707317074,
0.09273170731707317,
0.19926829268292684,
0.24769230769230768,
0.3300666666666666,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.04731707317073171,
0.12282926829268291,
0.17263414634146343,
0.34217073170731704,
0.5817567567567568,
1.0683333333333334,
0.332
],
"marker": {
"color": "hsl(210, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(210, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.015682926829268293,
0.12117073170731708,
0.18236585365853655,
0.5008292682926829,
1.1682432432432432,
0.5656666666666665,
0.0
],
"arrayminus": [
0.026317073170731706,
0.08682926829268292,
0.13163414634146342,
0.28617073170731705,
0.5147567567567568,
0.7733333333333334,
0.0
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Cross-Model Comparison (AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Search Latency — Wealth of Nations¶
Search Latency vs Dataset Size (MiniLM / Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw",
"x": [
100,
500,
1000,
1850
],
"y": [
0.12326829268292684,
0.48536842105263156,
0.7906,
1.0667118644067797
],
"marker": {
"color": "hsl(270, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(270, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23373170731707316,
2.024631578947368,
3.3783999999999996,
5.333288135593221
],
"arrayminus": [
0.09426829268292684,
0.4453684210526316,
0.7455999999999999,
1.0137118644067797
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute",
"x": [
100,
500,
1000,
1850
],
"y": [
0.14,
0.141,
0.166,
0.55
],
"marker": {
"color": "hsl(130, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(130, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.06799999999999995
],
"arrayminus": [
0.0,
0.0,
0.0,
0.04400000000000004
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan",
"x": [
100,
500,
1000,
1850
],
"y": [
0.035,
0.133,
0.297,
0.8805
],
"marker": {
"color": "hsl(18, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(18, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.14049999999999996
],
"arrayminus": [
0.0,
0.0,
0.0,
0.05149999999999999
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize",
"x": [
100,
500,
1000,
1850
],
"y": [
0.02,
0.041,
0.058,
0.08925
],
"marker": {
"color": "hsl(175, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(175, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0007500000000000007
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0012500000000000011
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw",
"x": [
100,
500,
1000,
1850
],
"y": [
0.038902439024390244,
0.09851219512195121,
0.12404878048780489,
0.14628125
],
"marker": {
"color": "hsl(210, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(210, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.016097560975609757,
0.0984878048780488,
0.14495121951219514,
0.19171875000000002
],
"arrayminus": [
0.018902439024390243,
0.06751219512195121,
0.09404878048780489,
0.11428125
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Search Latency vs Dataset Size (MiniLM / Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Search Latency vs Dataset Size (NomicEmbed / Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw",
"x": [
100,
500,
1000,
1850
],
"y": [
0.13912195121951218,
0.5811025641025641,
0.8884000000000001,
1.4965507246376812
],
"marker": {
"color": "hsl(270, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(270, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23987804878048782,
1.9358974358974357,
3.4135999999999997,
6.034449275362318
],
"arrayminus": [
0.09812195121951217,
0.5251025641025641,
0.8264,
1.4235507246376813
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute",
"x": [
100,
500,
1000,
1850
],
"y": [
0.406,
0.458,
0.509,
0.99075
],
"marker": {
"color": "hsl(130, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(130, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.027249999999999996
],
"arrayminus": [
0.0,
0.0,
0.0,
0.04375000000000007
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan",
"x": [
100,
500,
1000,
1850
],
"y": [
0.049,
0.234,
0.794,
1.63775
],
"marker": {
"color": "hsl(18, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(18, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.2842499999999999
],
"arrayminus": [
0.0,
0.0,
0.0,
0.14274999999999993
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize",
"x": [
100,
500,
1000,
1850
],
"y": [
0.027,
0.068,
0.121,
0.24175
],
"marker": {
"color": "hsl(175, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(175, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.019250000000000017
],
"arrayminus": [
0.0,
0.0,
0.0,
0.024749999999999994
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw",
"x": [
100,
500,
1000,
1850
],
"y": [
0.04570731707317073,
0.1234047619047619,
0.15909756097560976,
0.21021428571428574
],
"marker": {
"color": "hsl(210, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(210, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.01829268292682927,
0.11159523809523808,
0.1849024390243902,
0.27778571428571425
],
"arrayminus": [
0.02270731707317073,
0.0864047619047619,
0.12109756097560975,
0.16621428571428576
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Search Latency vs Dataset Size (NomicEmbed / Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Search Latency vs Dataset Size (BGE-Large / Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw",
"x": [
100,
500,
1000,
1850
],
"y": [
0.1505609756097561,
0.653945945945946,
1.0936896551724138,
1.5324603174603175
],
"marker": {
"color": "hsl(270, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(270, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.24043902439024392,
1.8760540540540538,
3.152310344827587,
5.558539682539683
],
"arrayminus": [
0.10256097560975609,
0.5779459459459461,
1.0156896551724137,
1.4434603174603176
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute",
"x": [
100,
500,
1000,
1850
],
"y": [
0.59,
0.702,
0.674,
1.47
],
"marker": {
"color": "hsl(130, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(130, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.131
],
"arrayminus": [
0.0,
0.0,
0.0,
0.09899999999999998
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan",
"x": [
100,
500,
1000,
1850
],
"y": [
0.069,
0.368,
1.047,
1.9615
],
"marker": {
"color": "hsl(18, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(18, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.010499999999999954
],
"arrayminus": [
0.0,
0.0,
0.0,
0.009500000000000064
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize",
"x": [
100,
500,
1000,
1850
],
"y": [
0.033,
0.096,
0.206,
0.35025
],
"marker": {
"color": "hsl(175, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(175, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.017749999999999988
],
"arrayminus": [
0.0,
0.0,
0.0,
0.02024999999999999
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw",
"x": [
100,
500,
1000,
1850
],
"y": [
0.05348780487804878,
0.1401219512195122,
0.18797560975609756,
0.25406493506493505
],
"marker": {
"color": "hsl(210, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(210, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.016512195121951227,
0.1228780487804878,
0.20902439024390246,
0.38893506493506497
],
"arrayminus": [
0.02248780487804878,
0.0991219512195122,
0.13497560975609757,
0.20306493506493506
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Search Latency vs Dataset Size (BGE-Large / Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Cross-Model Comparison — Wealth of Nations¶
Cross-Model Comparison (Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
0.1505609756097561,
0.653945945945946,
1.0936896551724138,
1.5324603174603175
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.24043902439024392,
1.8760540540540538,
3.152310344827587,
5.558539682539683
],
"arrayminus": [
0.10256097560975609,
0.5779459459459461,
1.0156896551724137,
1.4434603174603176
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
0.12326829268292684,
0.48536842105263156,
0.7906,
1.0667118644067797
],
"marker": {
"color": "hsl(270, 78%, 47%)",
"size": 8
},
"line": {
"color": "hsl(270, 78%, 47%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23373170731707316,
2.024631578947368,
3.3783999999999996,
5.333288135593221
],
"arrayminus": [
0.09426829268292684,
0.4453684210526316,
0.7455999999999999,
1.0137118644067797
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
0.13912195121951218,
0.5811025641025641,
0.8884000000000001,
1.4965507246376812
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23987804878048782,
1.9358974358974357,
3.4135999999999997,
6.034449275362318
],
"arrayminus": [
0.09812195121951217,
0.5251025641025641,
0.8264,
1.4235507246376813
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
0.59,
0.702,
0.674,
1.47
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.131
],
"arrayminus": [
0.0,
0.0,
0.0,
0.09899999999999998
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
0.14,
0.141,
0.166,
0.55
],
"marker": {
"color": "hsl(130, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(130, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.06799999999999995
],
"arrayminus": [
0.0,
0.0,
0.0,
0.04400000000000004
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
0.406,
0.458,
0.509,
0.99075
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.027249999999999996
],
"arrayminus": [
0.0,
0.0,
0.0,
0.04375000000000007
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
0.069,
0.368,
1.047,
1.9615
],
"marker": {
"color": "hsl(18, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(18, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.010499999999999954
],
"arrayminus": [
0.0,
0.0,
0.0,
0.009500000000000064
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
0.035,
0.133,
0.297,
0.8805
],
"marker": {
"color": "hsl(18, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(18, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.14049999999999996
],
"arrayminus": [
0.0,
0.0,
0.0,
0.05149999999999999
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
0.049,
0.234,
0.794,
1.63775
],
"marker": {
"color": "hsl(18, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(18, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.2842499999999999
],
"arrayminus": [
0.0,
0.0,
0.0,
0.14274999999999993
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
0.033,
0.096,
0.206,
0.35025
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.017749999999999988
],
"arrayminus": [
0.0,
0.0,
0.0,
0.02024999999999999
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
0.02,
0.041,
0.058,
0.08925
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0007500000000000007
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0012500000000000011
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
0.027,
0.068,
0.121,
0.24175
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.019250000000000017
],
"arrayminus": [
0.0,
0.0,
0.0,
0.024749999999999994
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
0.05348780487804878,
0.1401219512195122,
0.18797560975609756,
0.25406493506493505
],
"marker": {
"color": "hsl(210, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(210, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.016512195121951227,
0.1228780487804878,
0.20902439024390246,
0.38893506493506497
],
"arrayminus": [
0.02248780487804878,
0.0991219512195122,
0.13497560975609757,
0.20306493506493506
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
0.038902439024390244,
0.09851219512195121,
0.12404878048780489,
0.14628125
],
"marker": {
"color": "hsl(210, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(210, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.016097560975609757,
0.0984878048780488,
0.14495121951219514,
0.19171875000000002
],
"arrayminus": [
0.018902439024390243,
0.06751219512195121,
0.09404878048780489,
0.11428125
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
0.04570731707317073,
0.1234047619047619,
0.15909756097560976,
0.21021428571428574
],
"marker": {
"color": "hsl(210, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(210, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.01829268292682927,
0.11159523809523808,
0.1849024390243902,
0.27778571428571425
],
"arrayminus": [
0.02270731707317073,
0.0864047619047619,
0.12109756097560975,
0.16621428571428576
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Cross-Model Comparison (Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Dataset Comparison¶
Dataset Comparison (MiniLM)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.12178048780487803,
0.497675,
0.8697435897435898,
2.4135,
3.068857142857143,
1.9502142857142857,
0.41
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23521951219512194,
1.380325,
3.1572564102564105,
10.8705,
16.824142857142856,
11.299785714285715,
0.0
],
"arrayminus": [
0.09078048780487803,
0.455675,
0.8257435897435897,
2.3575,
2.994857142857143,
1.8142142857142858,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.12326829268292684,
0.48536842105263156,
0.7906,
1.0667118644067797
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23373170731707316,
2.024631578947368,
3.3783999999999996,
5.333288135593221
],
"arrayminus": [
0.09426829268292684,
0.4453684210526316,
0.7455999999999999,
1.0137118644067797
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.125,
0.14,
0.202,
1.232,
3.252,
13.921,
28.88
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.14,
0.141,
0.166,
0.55
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.06799999999999995
],
"arrayminus": [
0.0,
0.0,
0.0,
0.04400000000000004
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.035,
0.134,
0.308,
2.369,
5.495,
27.219,
56.638
],
"marker": {
"color": "hsl(18, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(18, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.035,
0.133,
0.297,
0.8805
],
"marker": {
"color": "hsl(18, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(18, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.14049999999999996
],
"arrayminus": [
0.0,
0.0,
0.0,
0.05149999999999999
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.023,
0.05,
0.055,
0.252,
0.788,
4.522,
11.561
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.02,
0.041,
0.058,
0.08925
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0007500000000000007
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0012500000000000011
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.039634146341463415,
0.10470731707317074,
0.13073170731707318,
0.22926829268292684,
0.2866923076923077,
0.3910666666666666,
0.203
],
"marker": {
"color": "hsl(210, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(210, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.017365853658536587,
0.09729268292682927,
0.1612682926829268,
0.4097317073170732,
0.5193076923076924,
0.5139333333333334,
0.0
],
"arrayminus": [
0.016634146341463416,
0.07070731707317074,
0.09273170731707317,
0.19926829268292684,
0.24769230769230768,
0.3300666666666666,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.038902439024390244,
0.09851219512195121,
0.12404878048780489,
0.14628125
],
"marker": {
"color": "hsl(210, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(210, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.016097560975609757,
0.0984878048780488,
0.14495121951219514,
0.19171875000000002
],
"arrayminus": [
0.018902439024390243,
0.06751219512195121,
0.09404878048780489,
0.11428125
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Dataset Comparison (MiniLM)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Dataset Comparison (NomicEmbed)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.13602439024390245,
0.5592777777777778,
0.9025625,
2.4684,
2.8293513513513515,
2.4699999999999998,
0.579
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23997560975609755,
1.7997222222222222,
2.8594375,
8.6676,
15.194648648648649,
2.019,
0.0
],
"arrayminus": [
0.09702439024390244,
0.49927777777777776,
0.8145625000000001,
2.3804,
2.7293513513513514,
2.0189999999999997,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.13912195121951218,
0.5811025641025641,
0.8884000000000001,
1.4965507246376812
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.23987804878048782,
1.9358974358974357,
3.4135999999999997,
6.034449275362318
],
"arrayminus": [
0.09812195121951217,
0.5251025641025641,
0.8264,
1.4235507246376813
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.48,
0.475,
0.447,
2.794,
5.979,
30.793,
58.79
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.406,
0.458,
0.509,
0.99075
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.027249999999999996
],
"arrayminus": [
0.0,
0.0,
0.0,
0.04375000000000007
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.047,
0.252,
0.812,
4.626,
9.986,
51.568,
102.799
],
"marker": {
"color": "hsl(18, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(18, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.049,
0.234,
0.794,
1.63775
],
"marker": {
"color": "hsl(18, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(18, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.2842499999999999
],
"arrayminus": [
0.0,
0.0,
0.0,
0.14274999999999993
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.026,
0.067,
0.139,
0.891,
1.944,
12.658,
24.449
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.027,
0.068,
0.121,
0.24175
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.019250000000000017
],
"arrayminus": [
0.0,
0.0,
0.0,
0.024749999999999994
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.04731707317073171,
0.12282926829268291,
0.17263414634146343,
0.34217073170731704,
0.5817567567567568,
1.0683333333333334,
0.332
],
"marker": {
"color": "hsl(210, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(210, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.015682926829268293,
0.12117073170731708,
0.18236585365853655,
0.5008292682926829,
1.1682432432432432,
0.5656666666666665,
0.0
],
"arrayminus": [
0.026317073170731706,
0.08682926829268292,
0.13163414634146342,
0.28617073170731705,
0.5147567567567568,
0.7733333333333334,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.04570731707317073,
0.1234047619047619,
0.15909756097560976,
0.21021428571428574
],
"marker": {
"color": "hsl(210, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(210, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.01829268292682927,
0.11159523809523808,
0.1849024390243902,
0.27778571428571425
],
"arrayminus": [
0.02270731707317073,
0.0864047619047619,
0.12109756097560975,
0.16621428571428576
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Dataset Comparison (NomicEmbed)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Dataset Comparison (BGE-Large)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.14885365853658536,
0.6287142857142857,
0.9368666666666667,
2.62815625,
2.7222142857142857,
0.506
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.24314634146341466,
1.8092857142857146,
2.994133333333333,
10.75584375,
18.795785714285714,
0.0
],
"arrayminus": [
0.09985365853658536,
0.5617142857142856,
0.8678666666666668,
2.52315625,
2.584214285714286,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.1505609756097561,
0.653945945945946,
1.0936896551724138,
1.5324603174603175
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.24043902439024392,
1.8760540540540538,
3.152310344827587,
5.558539682539683
],
"arrayminus": [
0.10256097560975609,
0.5779459459459461,
1.0156896551724137,
1.4434603174603176
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.708,
0.701,
0.63,
3.924,
7.498,
37.987
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.59,
0.702,
0.674,
1.47
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.131
],
"arrayminus": [
0.0,
0.0,
0.0,
0.09899999999999998
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.067,
0.434,
1.005,
6.211,
12.574,
68.423
],
"marker": {
"color": "hsl(18, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(18, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.069,
0.368,
1.047,
1.9615
],
"marker": {
"color": "hsl(18, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(18, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.010499999999999954
],
"arrayminus": [
0.0,
0.0,
0.0,
0.009500000000000064
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.032,
0.121,
0.17,
1.477,
3.062,
17.203
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.033,
0.096,
0.206,
0.35025
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.017749999999999988
],
"arrayminus": [
0.0,
0.0,
0.0,
0.02024999999999999
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / ag-news",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.053585365853658536,
0.14882926829268295,
0.20178048780487803,
0.45780487804878045,
0.5497666666666666,
0.317
],
"marker": {
"color": "hsl(210, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(210, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.01841463414634146,
0.11817073170731707,
0.21221951219512195,
0.6831951219512196,
0.8812333333333334,
0.0
],
"arrayminus": [
0.030585365853658536,
0.11382926829268294,
0.15378048780487802,
0.37480487804878043,
0.4787666666666666,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / wealth-of-nations",
"x": [
100,
500,
1000,
1850
],
"y": [
0.05348780487804878,
0.1401219512195122,
0.18797560975609756,
0.25406493506493505
],
"marker": {
"color": "hsl(210, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(210, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.016512195121951227,
0.1228780487804878,
0.20902439024390246,
0.38893506493506497
],
"arrayminus": [
0.02248780487804878,
0.0991219512195122,
0.13497560975609757,
0.20306493506493506
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Dataset Comparison (BGE-Large)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Recall¶
Recall@k (AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.9981951219512195,
0.9930000000000001,
0.9844,
0.9733125,
0.9524285714285714,
0.942
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0018048780487804894,
0.006999999999999895,
0.015599999999999947,
0.026687499999999975,
0.0475714285714286,
0.0
],
"arrayminus": [
0.025195121951219535,
0.10000000000000009,
0.13940000000000008,
0.1993125,
0.3034285714285714,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.9986341463414635,
0.99125,
0.9884358974358974,
0.9721785714285714,
0.9597714285714285,
0.8812142857142857,
0.916
],
"marker": {
"color": "hsl(270, 78%, 47%)",
"size": 8
},
"line": {
"color": "hsl(270, 78%, 47%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0013658536585364756,
0.008750000000000036,
0.011564102564102563,
0.027821428571428553,
0.0402285714285715,
0.11778571428571427,
0.0
],
"arrayminus": [
0.02563414634146355,
0.10224999999999995,
0.13843589743589746,
0.1741785714285714,
0.30477142857142847,
0.3612142857142857,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.9986341463414635,
0.9905277777777778,
0.9945937499999999,
0.9670333333333333,
0.9550000000000001,
0.9425,
0.863
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0013658536585364756,
0.009472222222222215,
0.005406250000000057,
0.0329666666666667,
0.04499999999999993,
0.05449999999999999,
0.0
],
"arrayminus": [
0.02563414634146355,
0.12152777777777779,
0.04459374999999999,
0.30703333333333327,
0.3670000000000001,
0.05449999999999999,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
1.0,
1.0,
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
1.0,
1.0,
1.0,
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(130, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(130, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
1.0,
1.0,
1.0,
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
1.0,
1.0,
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(18, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(18, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
1.0,
1.0,
1.0,
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(18, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(18, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
1.0,
1.0,
1.0,
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(18, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(18, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.984,
0.989,
0.987,
0.981,
0.981,
0.987
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.992,
0.993,
0.991,
0.993,
0.987,
0.993,
0.989
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.991,
0.991,
0.992,
0.989,
0.99,
0.987,
0.983
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
0.9926097560975611,
0.982048780487805,
0.9807804878048781,
0.9766585365853658,
0.9677666666666667,
0.985
],
"marker": {
"color": "hsl(210, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(210, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.00739024390243892,
0.017951219512195027,
0.019219512195121857,
0.023341463414634167,
0.032233333333333336,
0.0
],
"arrayminus": [
0.053609756097561134,
0.131048780487805,
0.13078048780487816,
0.13665853658536586,
0.14976666666666671,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.9924634146341464,
0.9839024390243903,
0.979829268292683,
0.9750731707317074,
0.9714358974358975,
0.9672666666666667,
0.985
],
"marker": {
"color": "hsl(210, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(210, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.007536585365853554,
0.01609756097560966,
0.02017073170731698,
0.024926829268292594,
0.028564102564102467,
0.03173333333333328,
0.0
],
"arrayminus": [
0.0504634146341465,
0.11690243902439035,
0.14282926829268305,
0.14507317073170745,
0.1874358974358975,
0.16026666666666667,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
0.9940731707317073,
0.9851707317073172,
0.980048780487805,
0.9765121951219512,
0.9775675675675676,
0.997,
0.988
],
"marker": {
"color": "hsl(210, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(210, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.005926829268292688,
0.014829268292682829,
0.01995121951219503,
0.0234878048780488,
0.022432432432432425,
0.0020000000000000018,
0.0
],
"arrayminus": [
0.04007317073170735,
0.10317073170731716,
0.12204878048780499,
0.14651219512195124,
0.1385675675675676,
0.0030000000000000027,
0.0
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Recall@k (AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Recall@k"
},
"type": "linear"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Recall@k (Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
0.9955121951219513,
0.982054054054054,
0.9688965517241379,
0.9544285714285714
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0044878048780486735,
0.017945945945946007,
0.03110344827586209,
0.045571428571428596
],
"arrayminus": [
0.048512195121951374,
0.14405405405405403,
0.26189655172413795,
0.2974285714285714
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
0.995439024390244,
0.9800263157894736,
0.971025,
0.9602033898305085
],
"marker": {
"color": "hsl(270, 78%, 47%)",
"size": 8
},
"line": {
"color": "hsl(270, 78%, 47%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.004560975609755991,
0.019973684210526366,
0.028974999999999973,
0.03979661016949154
],
"arrayminus": [
0.06943902439024396,
0.15102631578947368,
0.21802500000000002,
0.2642033898305085
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
0.9974634146341463,
0.9846666666666667,
0.9713749999999999,
0.9732318840579711
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.002536585365853661,
0.01533333333333331,
0.028625000000000123,
0.02676811594202888
],
"arrayminus": [
0.04546341463414638,
0.14266666666666672,
0.21037499999999987,
0.24423188405797114
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(130, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(130, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(18, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(18, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(18, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(18, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
1.0,
1.0,
1.0,
1.0
],
"marker": {
"color": "hsl(18, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(18, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
0.985,
0.976,
0.965,
0.977
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0020000000000000018
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0050000000000000044
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
0.993,
0.991,
0.993,
0.9884999999999999
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0035000000000000586
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0044999999999999485
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
0.989,
0.987,
0.977,
0.9795
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.005499999999999949
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0035000000000000586
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
0.9865365853658536,
0.9700731707317074,
0.9613902439024391,
0.9527012987012987
],
"marker": {
"color": "hsl(210, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(210, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.013463414634146353,
0.0299268292682926,
0.0386097560975609,
0.047298701298701284
],
"arrayminus": [
0.11753658536585365,
0.16907317073170736,
0.2233902439024391,
0.21970129870129873
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
0.9907560975609757,
0.9729756097560976,
0.9654390243902439,
0.9577291666666666
],
"marker": {
"color": "hsl(210, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(210, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.009243902439024287,
0.027024390243902352,
0.03456097560975613,
0.04227083333333337
],
"arrayminus": [
0.06575609756097567,
0.1639756097560976,
0.17543902439024384,
0.20372916666666663
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
0.9903658536585365,
0.9779761904761906,
0.9703902439024391,
0.9615357142857144
],
"marker": {
"color": "hsl(210, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(210, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.009634146341463534,
0.022023809523809446,
0.02960975609756089,
0.03846428571428562
],
"arrayminus": [
0.06336585365853642,
0.13297619047619058,
0.18539024390243908,
0.19053571428571436
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Recall@k (Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Recall@k"
},
"type": "linear"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Insert Throughput¶
Insert Throughput (AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
368.99756097560976,
250.43428571428572,
202.70666666666665,
158.15625,
156.66071428571428,
133.3
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
616.2024390243903,
520.3657142857143,
552.4933333333333,
311.24375,
337.8392857142857,
0.0
],
"arrayminus": [
269.79756097560977,
242.43428571428572,
195.80666666666664,
152.85625,
150.9607142857143,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
420.5560975609756,
281.71500000000003,
227.16923076923078,
205.825,
195.02857142857144,
203.79999999999998,
147.6
],
"marker": {
"color": "hsl(270, 78%, 47%)",
"size": 8
},
"line": {
"color": "hsl(270, 78%, 47%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
673.0439024390244,
576.985,
660.4307692307692,
407.47499999999997,
406.2714285714285,
360.6,
0.0
],
"arrayminus": [
307.95609756097565,
273.21500000000003,
220.36923076923077,
200.42499999999998,
189.82857142857145,
199.39999999999998,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
402.7390243902439,
201.6138888888889,
248.33125,
174.81333333333333,
151.25405405405405,
74.55000000000001,
136.1
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
684.6609756097562,
626.0861111111111,
562.8687500000001,
427.08666666666664,
347.6459459459459,
67.75,
0.0
],
"arrayminus": [
295.33902439024394,
193.41388888888892,
241.33125,
169.71333333333334,
146.25405405405405,
67.75000000000001,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
20654.2,
26639.8,
8835.3,
7890.6,
8839.4,
9015.8
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
94764.3,
93214.0,
59853.7,
64381.0,
62194.0,
60760.3,
60642.7
],
"marker": {
"color": "hsl(130, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(130, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
28939.7,
36277.3,
14060.6,
16008.1,
16494.7,
15651.8,
10426.3
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
294804.2,
206058.1,
166480.5,
118133.7,
112831.7,
197553.7
],
"marker": {
"color": "hsl(18, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(18, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
294876.5,
486499.6,
403375.0,
238455.3,
218267.3,
233129.6,
161595.8
],
"marker": {
"color": "hsl(18, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(18, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
295311.8,
272845.0,
162992.5,
136257.9,
119199.6,
155367.5,
15742.7
],
"marker": {
"color": "hsl(18, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(18, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
260021.3,
179021.6,
158245.6,
119889.1,
137186.5,
202561.6
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
300827.0,
441809.7,
394153.4,
240589.9,
217236.6,
241402.9,
154973.7
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
289156.8,
287150.0,
153524.3,
131538.7,
88102.8,
163793.5,
18166.9
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
17370.731707317074,
6929.246341463414,
5211.073170731707,
2532.9024390243903,
2016.8600000000001,
1422.5
],
"marker": {
"color": "hsl(210, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(210, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
23276.868292682924,
4194.053658536585,
3227.526829268293,
1681.3975609756098,
1554.54,
0.0
],
"arrayminus": [
2294.931707317075,
2141.746341463414,
1784.0731707317073,
1020.9024390243903,
1128.8600000000001,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
24430.646341463416,
9656.341463414634,
7968.368292682926,
4825.319512195122,
3946.8692307692304,
2596.1,
2492.4
],
"marker": {
"color": "hsl(210, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(210, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
22040.453658536582,
8211.958536585365,
3755.631707317074,
4426.980487804877,
2997.8307692307694,
1796.7000000000003,
0.0
],
"arrayminus": [
4952.046341463418,
2581.5414634146337,
2809.668292682926,
2211.1195121951223,
1969.3692307692304,
1534.8999999999999,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
19729.941463414634,
8326.758536585365,
6003.10487804878,
3344.829268292683,
2305.554054054054,
1091.7333333333333,
1465.5
],
"marker": {
"color": "hsl(210, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(210, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
25407.458536585367,
3716.3414634146357,
3772.9951219512204,
3062.7707317073173,
2090.245945945946,
624.5666666666666,
0.0
],
"arrayminus": [
2584.8414634146357,
2564.858536585365,
1973.00487804878,
1535.0292682926831,
1186.5540540540542,
422.33333333333337,
0.0
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Insert Throughput (AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Insert Rate (vectors/sec)"
},
"type": "linear"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Insert Throughput (Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
366.1463414634146,
248.5918918918919,
247.27241379310342,
201.68095238095236
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
625.9536585365854,
536.708108108108,
463.1275862068966,
481.1190476190476
],
"arrayminus": [
264.8463414634146,
240.3918918918919,
240.27241379310342,
195.68095238095236
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
441.79024390243904,
305.37105263157895,
269.9525,
292.62033898305083
],
"marker": {
"color": "hsl(270, 78%, 47%)",
"size": 8
},
"line": {
"color": "hsl(270, 78%, 47%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
772.009756097561,
643.5289473684211,
668.3475,
538.7796610169491
],
"arrayminus": [
329.99024390243903,
296.67105263157896,
262.9525,
286.3203389830508
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
396.9268292682927,
239.63076923076923,
244.23000000000002,
194.44347826086957
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
681.4731707317073,
540.6692307692307,
559.97,
548.3565217391304
],
"arrayminus": [
292.02682926829266,
231.33076923076922,
237.53000000000003,
188.44347826086957
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
18900.6,
31279.8,
8013.9,
8857.65
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
963.1499999999996
],
"arrayminus": [
0.0,
0.0,
0.0,
2793.3499999999995
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
84116.1,
85478.6,
69057.6,
66060.5
],
"marker": {
"color": "hsl(130, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(130, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
1907.6000000000058
],
"arrayminus": [
0.0,
0.0,
0.0,
2519.4000000000015
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
31643.9,
39775.9,
13432.1,
15776.875
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
2728.5250000000015
],
"arrayminus": [
0.0,
0.0,
0.0,
5490.174999999999
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
304491.0,
228628.1,
175714.8,
112126.15
],
"marker": {
"color": "hsl(18, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(18, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
36825.649999999994
],
"arrayminus": [
0.0,
0.0,
0.0,
100887.34999999999
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
179829.2,
367590.8,
405391.7,
297192.05000000005
],
"marker": {
"color": "hsl(18, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(18, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
6389.349999999977
],
"arrayminus": [
0.0,
0.0,
0.0,
10066.150000000023
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
280636.5,
271936.1,
181655.8,
144373.925
],
"marker": {
"color": "hsl(18, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(18, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
11495.975000000006
],
"arrayminus": [
0.0,
0.0,
0.0,
15543.124999999985
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
285952.7,
234677.5,
177170.1,
114192.525
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
36951.774999999994
],
"arrayminus": [
0.0,
0.0,
0.0,
97879.825
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
210452.3,
457875.5,
372433.6,
293306.525
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
8102.774999999965
],
"arrayminus": [
0.0,
0.0,
0.0,
11555.625
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
307889.4,
239296.4,
188743.1,
150216.1
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
17684.0
],
"arrayminus": [
0.0,
0.0,
0.0,
21698.5
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
17637.19024390244,
7483.448780487805,
5634.012195121952,
4316.171428571429
],
"marker": {
"color": "hsl(210, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(210, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
22839.70975609756,
5040.051219512195,
2856.687804878049,
3050.828571428571
],
"arrayminus": [
1846.3902439024423,
2404.348780487805,
1915.2121951219515,
1446.6714285714288
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
25244.30243902439,
10209.017073170731,
8471.160975609755,
7365.402083333333
],
"marker": {
"color": "hsl(210, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(210, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
26009.297560975607,
9513.18292682927,
5731.939024390245,
5102.597916666667
],
"arrayminus": [
5584.102439024391,
2724.217073170731,
2771.2609756097554,
2790.4020833333334
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
20593.234146341463,
8335.39523809524,
6509.182926829269,
5261.619047619048
],
"marker": {
"color": "hsl(210, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(210, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
21570.465853658534,
6231.204761904761,
2917.6170731707307,
3392.4809523809527
],
"arrayminus": [
3870.234146341463,
2411.5952380952394,
2194.282926829269,
1893.419047619048
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Insert Throughput (Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Insert Rate (vectors/sec)"
},
"type": "linear"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Storage¶
Storage (AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
653661.6585365854,
3171591.314285714,
5879398.4,
11362048.0,
24970093.714285713,
290832384.0
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
153250.3414634146,
1366776.6857142858,
3213721.5999999996,
33431808.0,
65084562.28571428,
0.0
],
"arrayminus": [
112989.6585365854,
1946887.3142857142,
5854822.4,
11083520.0,
24945517.714285713,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
391617.56097560975,
1938432.0,
4150298.2564102565,
7963794.285714285,
15545958.4,
29234322.285714287,
331563008.0
],
"marker": {
"color": "hsl(270, 78%, 47%)",
"size": 8
},
"line": {
"color": "hsl(270, 78%, 47%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
149054.43902439025,
1326080.0,
2399205.7435897435,
25078637.714285716,
48798105.6,
133811053.71428572,
0.0
],
"arrayminus": [
113089.56097560975,
1041408.0,
2515994.2564102565,
7939218.285714285,
15226470.4,
28120210.285714287,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
595918.0487804879,
2861624.888888889,
5267968.0,
15346892.8,
21455955.027027026,
149309440.0,
537030656.0
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
149553.95121951215,
1410503.111111111,
3333632.0,
28025651.2,
63327148.972972974,
116439040.0,
0.0
],
"arrayminus": [
112590.04878048785,
2837048.888888889,
5243392.0,
15322316.8,
21431379.027027026,
116439040.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
4239360.0,
4247552.0,
4251648.0,
21131264.0,
42246144.0,
206893056.0
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
1613824.0,
1622016.0,
1626112.0,
8015872.0,
16003072.0,
78315520.0,
156606464.0
],
"marker": {
"color": "hsl(130, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(130, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
3186688.0,
3194880.0,
3198976.0,
15888384.0,
31752192.0,
155484160.0,
310947840.0
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
479232.0,
2322432.0,
4624384.0,
23064576.0,
46108672.0,
230477824.0
],
"marker": {
"color": "hsl(18, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(18, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
221184.0,
1040384.0,
2064384.0,
10280960.0,
20541440.0,
102666240.0,
205320192.0
],
"marker": {
"color": "hsl(18, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(18, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
425984.0,
2064384.0,
4120576.0,
20541440.0,
41066496.0,
205312000.0,
410628096.0
],
"marker": {
"color": "hsl(18, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(18, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
585728.0,
2842624.0,
5660672.0,
28233728.0,
56442880.0,
282128384.0
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
262144.0,
1236992.0,
2457600.0,
12242944.0,
24465408.0,
122286080.0,
244559872.0
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
503808.0,
2453504.0,
4898816.0,
24428544.0,
48836608.0,
244150272.0,
488304640.0
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / BGE-Large",
"x": [
100,
500,
1000,
5000,
10000,
50000
],
"y": [
4096.0,
4096.0,
4096.0,
4096.0,
4096.0,
4096.0
],
"marker": {
"color": "hsl(210, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(210, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
4096.0,
4096.0,
4096.0,
4096.0,
4096.0,
4096.0,
4096.0
],
"marker": {
"color": "hsl(210, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(210, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000,
10000,
50000,
100000
],
"y": [
4096.0,
4096.0,
4096.0,
4096.0,
4096.0,
4096.0,
4096.0
],
"marker": {
"color": "hsl(210, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(210, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Storage (AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Database Size (bytes)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Storage (Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
652362.9268292683,
3289198.7027027025,
5770840.275862069,
8608296.634920634
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
150453.07317073166,
1261457.2972972975,
3318183.724137931,
8418775.365079366
],
"arrayminus": [
111690.92682926834,
2674798.7027027025,
5746264.275862069,
7502376.634920634
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
391417.756097561,
1899897.2631578948,
4077056.0,
5891922.440677966
],
"marker": {
"color": "hsl(270, 78%, 47%)",
"size": 8
},
"line": {
"color": "hsl(270, 78%, 47%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
153350.24390243902,
1360518.7368421052,
2501120.0,
6371501.559322034
],
"arrayminus": [
112889.75609756098,
1875321.2631578948,
1426944.0,
5121874.440677966
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
596217.756097561,
2944918.9743589745,
6093619.2,
7919289.507246377
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_hnsw",
"legendgrouptitle": {
"text": "muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
153350.24390243902,
1323113.0256410255,
2487500.8,
8153414.492753623
],
"arrayminus": [
112889.75609756098,
2920342.9743589745,
1391411.2000000002,
7894713.507246377
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
4239360.0,
4247552.0,
4251648.0,
8470528.0
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
1613824.0,
1622016.0,
1626112.0,
3219456.0
],
"marker": {
"color": "hsl(130, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(130, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
3186688.0,
3194880.0,
3198976.0,
6373376.0
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vec_brute_force",
"legendgrouptitle": {
"text": "sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
479232.0,
2322432.0,
4624384.0,
8544256.0
],
"marker": {
"color": "hsl(18, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(18, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
221184.0,
1040384.0,
2064384.0,
3813376.0
],
"marker": {
"color": "hsl(18, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(18, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-fullscan / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
425984.0,
2064384.0,
4120576.0,
7610368.0
],
"marker": {
"color": "hsl(18, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(18, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_full_scan",
"legendgrouptitle": {
"text": "sqlite-vector-fullscan"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
585728.0,
2842624.0,
5660672.0,
10457088.0
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
262144.0,
1236992.0,
2457600.0,
4542464.0
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "sqlite-vector-quantize / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
503808.0,
2453504.0,
4898816.0,
9048064.0
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "sqlite_vector_quantize_scan",
"legendgrouptitle": {
"text": "sqlite-vector-quantize"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / BGE-Large",
"x": [
100,
500,
1000,
1850
],
"y": [
4096.0,
4096.0,
4096.0,
4096.0
],
"marker": {
"color": "hsl(210, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(210, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / MiniLM",
"x": [
100,
500,
1000,
1850
],
"y": [
4096.0,
4096.0,
4096.0,
4096.0
],
"marker": {
"color": "hsl(210, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(210, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "vectorlite-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
1850
],
"y": [
4096.0,
4096.0,
4096.0,
4096.0
],
"marker": {
"color": "hsl(210, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(210, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "vectorlite_hnsw",
"legendgrouptitle": {
"text": "vectorlite-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0,
0.0,
0.0
],
"visible": true
}
}
],
"layout": {
"title": {
"text": "Storage (Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Database Size (bytes)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}