Embed Benchmarks¶
Compares llama.cpp-based embedding functions on metrics:
- end-to-end query latency,
- embedding-only latency,
- insert throughput,
- and recall
...across multiple GGUF embedding models, search backends, and corpus types.
Both embedding functions use llama.cpp under the hood to run GGUF-format embedding models. This benchmark compares their end-to-end performance.
Embedding Functions¶
| Function | Description |
|---|---|
| muninn_embed | muninn native llama.cpp embedding wrapper |
| lembed | sqlite-lembed llama.cpp embedding wrapper |
Search Backends¶
| Backend | Method | Strategy |
|---|---|---|
| muninn HNSW | HNSW graph index | Approximate, O(log N) search |
| sqlite-vector PQ | Product Quantization | Approximate, O(N) scan |
| sqlite-vec brute | Brute-force KNN | Exact, O(N) scan |
GGUF Embedding Models¶
| Model | Dimension | Params | GGUF File |
|---|---|---|---|
| MiniLM | 384 | 22M | all-MiniLM-L6-v2.Q8_0.gguf |
| NomicEmbed | 768 | 137M | nomic-embed-text-v1.5.Q8_0.gguf |
Datasets¶
| Dataset | Source | Passages | Topology |
|---|---|---|---|
| AG News | HuggingFace | ~120K | 4 discrete clusters |
| Wealth of Nations | Project Gutenberg | ~2,500 (256-token windows, 50-token overlap) | Continuous conceptual gradient |
Query+Search Latency — AG News¶
Query Embed+Search Latency (MiniLM / AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw",
"x": [
100,
500,
1000,
5000
],
"y": [
3.796,
4.79,
3.756,
4.287
],
"marker": {
"color": "hsl(175, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(175, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute",
"x": [
100,
500,
1000,
5000
],
"y": [
3.803,
3.9755,
4.344,
5.434
],
"marker": {
"color": "hsl(50, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(50, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.22849999999999993,
0.0,
0.0
],
"arrayminus": [
0.0,
0.22849999999999993,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq",
"x": [
100,
500,
1000,
5000
],
"y": [
4.044,
3.837,
3.832,
4.296
],
"marker": {
"color": "hsl(130, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(130, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw",
"x": [
100,
500,
1000,
5000
],
"y": [
3.5575,
4.304,
3.575,
3.661
],
"marker": {
"color": "hsl(270, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(270, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.15949999999999998,
0.0,
0.0,
0.0
],
"arrayminus": [
0.15949999999999998,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute",
"x": [
100,
500,
1000,
5000
],
"y": [
3.561,
3.392,
3.9,
4.483
],
"marker": {
"color": "hsl(240, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(240, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq",
"x": [
100,
500,
1000,
5000
],
"y": [
3.526,
3.183,
3.785,
3.666
],
"marker": {
"color": "hsl(300, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(300, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Query Embed+Search Latency (MiniLM / AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Query Embed+Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Query Embed+Search Latency (NomicEmbed / AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw",
"x": [
100,
500,
1000,
5000
],
"y": [
30.728,
26.857,
28.107,
29.728
],
"marker": {
"color": "hsl(175, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(175, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute",
"x": [
100,
500,
1000,
5000
],
"y": [
33.955,
27.374,
29.235,
31.586
],
"marker": {
"color": "hsl(50, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(50, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq",
"x": [
100,
500,
1000,
5000
],
"y": [
36.736,
27.32,
27.359,
29.741
],
"marker": {
"color": "hsl(130, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(130, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw",
"x": [
100,
500,
1000,
5000
],
"y": [
26.42,
22.264,
24.374,
23.252
],
"marker": {
"color": "hsl(270, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(270, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute",
"x": [
100,
500,
1000,
5000
],
"y": [
24.756,
23.8,
26.796,
26.797
],
"marker": {
"color": "hsl(240, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(240, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq",
"x": [
100,
500,
1000,
5000
],
"y": [
25.37,
22.454,
24.22,
23.975
],
"marker": {
"color": "hsl(300, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(300, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Query Embed+Search Latency (NomicEmbed / AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Query Embed+Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Query+Search Latency — Wealth of Nations¶
Query Embed+Search Latency (MiniLM / Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw",
"x": [
100
],
"y": [
2.336
],
"marker": {
"color": "hsl(175, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(175, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute",
"x": [
100,
500
],
"y": [
2.529,
16.95
],
"marker": {
"color": "hsl(50, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(50, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq",
"x": [
100
],
"y": [
2.459
],
"marker": {
"color": "hsl(130, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(130, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw",
"x": [
100,
500
],
"y": [
2.269,
19.266
],
"marker": {
"color": "hsl(270, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(270, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute",
"x": [
100,
500,
1000
],
"y": [
2.344,
15.481,
18.175
],
"marker": {
"color": "hsl(240, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(240, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq",
"x": [
100,
500,
1000
],
"y": [
1.67,
1.744,
1.649
],
"marker": {
"color": "hsl(300, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(300, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Query Embed+Search Latency (MiniLM / Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Query Embed+Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Query Embed+Search Latency (NomicEmbed / Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw",
"x": [
100
],
"y": [
20.925
],
"marker": {
"color": "hsl(175, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(175, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute",
"x": [
100
],
"y": [
20.759
],
"marker": {
"color": "hsl(50, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(50, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq",
"x": [
100
],
"y": [
21.163
],
"marker": {
"color": "hsl(130, 75%, 45%)",
"size": 7
},
"line": {
"color": "hsl(130, 75%, 45%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw",
"x": [
100
],
"y": [
15.797
],
"marker": {
"color": "hsl(270, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(270, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute",
"x": [
100
],
"y": [
15.363
],
"marker": {
"color": "hsl(240, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(240, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq",
"x": [
100
],
"y": [
14.273
],
"marker": {
"color": "hsl(300, 75%, 45%)",
"size": 8
},
"line": {
"color": "hsl(300, 75%, 45%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Query Embed+Search Latency (NomicEmbed / Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Query Embed+Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Cross-Model Comparison — AG News¶
Cross-Model Comparison (AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / BGE-Large",
"x": [
100
],
"y": [
99.965
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
3.796,
4.79,
3.756,
4.287
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
30.728,
26.857,
28.107,
29.728
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
3.803,
3.9755,
4.344,
5.434
],
"marker": {
"color": "hsl(50, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(50, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.22849999999999993,
0.0,
0.0
],
"arrayminus": [
0.0,
0.22849999999999993,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
33.955,
27.374,
29.235,
31.586
],
"marker": {
"color": "hsl(50, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(50, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
4.044,
3.837,
3.832,
4.296
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
36.736,
27.32,
27.359,
29.741
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
3.5575,
4.304,
3.575,
3.661
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.15949999999999998,
0.0,
0.0,
0.0
],
"arrayminus": [
0.15949999999999998,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
26.42,
22.264,
24.374,
23.252
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
3.561,
3.392,
3.9,
4.483
],
"marker": {
"color": "hsl(240, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(240, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
24.756,
23.8,
26.796,
26.797
],
"marker": {
"color": "hsl(240, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(240, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
3.526,
3.183,
3.785,
3.666
],
"marker": {
"color": "hsl(300, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(300, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
25.37,
22.454,
24.22,
23.975
],
"marker": {
"color": "hsl(300, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(300, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Cross-Model Comparison (AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Query Embed+Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Cross-Model Comparison — Wealth of Nations¶
Cross-Model Comparison (Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / MiniLM",
"x": [
100
],
"y": [
2.336
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / NomicEmbed",
"x": [
100
],
"y": [
20.925
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / MiniLM",
"x": [
100,
500
],
"y": [
2.529,
16.95
],
"marker": {
"color": "hsl(50, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(50, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / NomicEmbed",
"x": [
100
],
"y": [
20.759
],
"marker": {
"color": "hsl(50, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(50, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / MiniLM",
"x": [
100
],
"y": [
2.459
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / NomicEmbed",
"x": [
100
],
"y": [
21.163
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / MiniLM",
"x": [
100,
500
],
"y": [
2.269,
19.266
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / NomicEmbed",
"x": [
100
],
"y": [
15.797
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000
],
"y": [
2.344,
15.481,
18.175
],
"marker": {
"color": "hsl(240, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(240, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / NomicEmbed",
"x": [
100
],
"y": [
15.363
],
"marker": {
"color": "hsl(240, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(240, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000
],
"y": [
1.67,
1.744,
1.649
],
"marker": {
"color": "hsl(300, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(300, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / NomicEmbed",
"x": [
100
],
"y": [
14.273
],
"marker": {
"color": "hsl(300, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(300, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Cross-Model Comparison (Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Query Embed+Search Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Embedding-Only Latency¶
Embedding-Only Latency (AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / BGE-Large",
"x": [
100
],
"y": [
99.823
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
3.716,
4.588,
3.511,
3.92
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
30.603,
26.642,
27.821,
29.238
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
3.607,
3.7785,
3.848,
3.924
],
"marker": {
"color": "hsl(50, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(50, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.2214999999999998,
0.0,
0.0
],
"arrayminus": [
0.0,
0.22150000000000025,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
33.207,
26.761,
27.944,
28.281
],
"marker": {
"color": "hsl(50, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(50, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
3.992,
3.764,
3.718,
3.87
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
36.6,
27.176,
27.141,
28.55
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
3.4779999999999998,
4.148,
3.375,
3.367
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.15100000000000025,
0.0,
0.0,
0.0
],
"arrayminus": [
0.1509999999999998,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
26.288,
22.045,
24.105,
22.819
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
3.326,
3.199,
3.434,
3.125
],
"marker": {
"color": "hsl(240, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(240, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
23.977,
23.147,
25.492,
23.635
],
"marker": {
"color": "hsl(240, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(240, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
3.485,
3.134,
3.707,
3.271
],
"marker": {
"color": "hsl(300, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(300, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
25.272,
22.323,
24.024,
22.701
],
"marker": {
"color": "hsl(300, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(300, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Embedding-Only Latency (AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Embedding-Only Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Embedding-Only Latency (Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / MiniLM",
"x": [
100
],
"y": [
2.269
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / NomicEmbed",
"x": [
100
],
"y": [
20.798
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / MiniLM",
"x": [
100,
500
],
"y": [
2.338,
15.825
],
"marker": {
"color": "hsl(50, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(50, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / NomicEmbed",
"x": [
100
],
"y": [
19.883
],
"marker": {
"color": "hsl(50, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(50, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / MiniLM",
"x": [
100
],
"y": [
2.423
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / NomicEmbed",
"x": [
100
],
"y": [
21.037
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / MiniLM",
"x": [
100,
500
],
"y": [
2.19,
18.792
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / NomicEmbed",
"x": [
100
],
"y": [
15.679
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000
],
"y": [
2.083,
14.344,
16.46
],
"marker": {
"color": "hsl(240, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(240, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / NomicEmbed",
"x": [
100
],
"y": [
14.511
],
"marker": {
"color": "hsl(240, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(240, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000
],
"y": [
1.633,
1.694,
1.574
],
"marker": {
"color": "hsl(300, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(300, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / NomicEmbed",
"x": [
100
],
"y": [
14.19
],
"marker": {
"color": "hsl(300, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(300, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Embedding-Only Latency (Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Embedding-Only Latency (ms)"
},
"type": "log"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Insert Throughput¶
Embed+Insert Throughput (AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / BGE-Large",
"x": [
100
],
"y": [
9.9
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
150.1,
115.8,
125.8,
111.5
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
27.1,
31.1,
31.2,
29.4
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
247.4,
256.9,
261.2,
259.7
],
"marker": {
"color": "hsl(50, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(50, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
2.400000000000034,
0.0,
0.0
],
"arrayminus": [
0.0,
2.3999999999999773,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
32.5,
35.8,
36.2,
34.9
],
"marker": {
"color": "hsl(50, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(50, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
266.9,
247.9,
247.6,
256.1
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
29.3,
35.9,
36.0,
35.5
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
148.6,
138.3,
139.8,
119.3
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
10.099999999999994,
0.0,
0.0,
0.0
],
"arrayminus": [
10.099999999999994,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
34.0,
34.1,
34.6,
33.3
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
252.0,
261.3,
273.0,
267.0
],
"marker": {
"color": "hsl(240, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(240, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
36.2,
41.4,
40.4,
40.0
],
"marker": {
"color": "hsl(240, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(240, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
266.2,
254.9,
289.5,
281.3
],
"marker": {
"color": "hsl(300, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(300, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
33.3,
39.9,
40.2,
39.7
],
"marker": {
"color": "hsl(300, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(300, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Embed+Insert Throughput (AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Embed+Insert Rate (vectors/sec)"
},
"type": "linear"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Embed+Insert Throughput (Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / MiniLM",
"x": [
100
],
"y": [
46.0
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / NomicEmbed",
"x": [
100
],
"y": [
8.3
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / MiniLM",
"x": [
100,
500
],
"y": [
52.0,
5.1
],
"marker": {
"color": "hsl(50, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(50, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / NomicEmbed",
"x": [
100
],
"y": [
8.3
],
"marker": {
"color": "hsl(50, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(50, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / MiniLM",
"x": [
100
],
"y": [
52.0
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / NomicEmbed",
"x": [
100
],
"y": [
8.2
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / MiniLM",
"x": [
100,
500
],
"y": [
23.1,
4.7
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / NomicEmbed",
"x": [
100
],
"y": [
4.6
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000
],
"y": [
24.8,
4.8,
5.2
],
"marker": {
"color": "hsl(240, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(240, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / NomicEmbed",
"x": [
100
],
"y": [
4.8
],
"marker": {
"color": "hsl(240, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(240, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000
],
"y": [
25.1,
25.6,
25.6
],
"marker": {
"color": "hsl(300, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(300, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / NomicEmbed",
"x": [
100
],
"y": [
4.7
],
"marker": {
"color": "hsl(300, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(300, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Embed+Insert Throughput (Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Embed+Insert Rate (vectors/sec)"
},
"type": "linear"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Recall¶
Recall@k (AG News)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / BGE-Large",
"x": [
100
],
"y": [
0.702
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
0.652,
0.92,
0.941,
0.973
],
"marker": {
"color": "hsl(175, 78%, 47%)",
"size": 7
},
"line": {
"color": "hsl(175, 78%, 47%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
0.658,
0.913,
0.97,
0.953
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
0.649,
0.908,
0.96,
0.989
],
"marker": {
"color": "hsl(50, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(50, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0,
0.0050000000000000044,
0.0,
0.0
],
"arrayminus": [
0.0,
0.0050000000000000044,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
0.67,
0.935,
0.96,
0.991
],
"marker": {
"color": "hsl(50, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(50, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
0.7,
0.911,
0.954,
0.985
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
0.685,
0.911,
0.956,
0.978
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
0.6685000000000001,
0.921,
0.944,
0.949
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
},
"error_y": {
"type": "data",
"symmetric": false,
"array": [
0.0004999999999999449,
0.0,
0.0,
0.0
],
"arrayminus": [
0.000500000000000056,
0.0,
0.0,
0.0
],
"visible": true
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
0.635,
0.888,
0.925,
0.902
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
0.628,
0.919,
0.956,
0.971
],
"marker": {
"color": "hsl(240, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(240, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
0.654,
0.898,
0.951,
0.958
],
"marker": {
"color": "hsl(240, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(240, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000,
5000
],
"y": [
0.669,
0.921,
0.949,
0.977
],
"marker": {
"color": "hsl(300, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(300, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / NomicEmbed",
"x": [
100,
500,
1000,
5000
],
"y": [
0.68,
0.901,
0.932,
0.951
],
"marker": {
"color": "hsl(300, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(300, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Recall@k (AG News)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Recall@k"
},
"type": "linear"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}
Recall@k (Wealth of Nations)¶
{
"data": [
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / MiniLM",
"x": [
100
],
"y": [
0.675
],
"marker": {
"color": "hsl(175, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(175, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + muninn-hnsw / NomicEmbed",
"x": [
100
],
"y": [
0.682
],
"marker": {
"color": "hsl(175, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(175, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_muninn-hnsw",
"legendgrouptitle": {
"text": "lembed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / MiniLM",
"x": [
100,
500
],
"y": [
0.641,
0.89
],
"marker": {
"color": "hsl(50, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(50, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vec-brute / NomicEmbed",
"x": [
100
],
"y": [
0.631
],
"marker": {
"color": "hsl(50, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(50, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "lembed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / MiniLM",
"x": [
100
],
"y": [
0.679
],
"marker": {
"color": "hsl(130, 85%, 58%)",
"size": 7
},
"line": {
"color": "hsl(130, 85%, 58%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "lembed + sqlite-vector-pq / NomicEmbed",
"x": [
100
],
"y": [
0.693
],
"marker": {
"color": "hsl(130, 70%, 35%)",
"size": 7
},
"line": {
"color": "hsl(130, 70%, 35%)",
"width": 2
},
"opacity": 0.6,
"legendgroup": "lembed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "lembed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / MiniLM",
"x": [
100,
500
],
"y": [
0.654,
0.907
],
"marker": {
"color": "hsl(270, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(270, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + muninn-hnsw / NomicEmbed",
"x": [
100
],
"y": [
0.643
],
"marker": {
"color": "hsl(270, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(270, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_muninn-hnsw",
"legendgrouptitle": {
"text": "muninn-embed + muninn-hnsw"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / MiniLM",
"x": [
100,
500,
1000
],
"y": [
0.633,
0.902,
0.944
],
"marker": {
"color": "hsl(240, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(240, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vec-brute / NomicEmbed",
"x": [
100
],
"y": [
0.607
],
"marker": {
"color": "hsl(240, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(240, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vec-brute",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vec-brute"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / MiniLM",
"x": [
100,
500,
1000
],
"y": [
0.674,
0.912,
0.942
],
"marker": {
"color": "hsl(300, 85%, 58%)",
"size": 8
},
"line": {
"color": "hsl(300, 85%, 58%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
},
{
"type": "scatter",
"mode": "lines+markers",
"name": "muninn-embed + sqlite-vector-pq / NomicEmbed",
"x": [
100
],
"y": [
0.666
],
"marker": {
"color": "hsl(300, 70%, 35%)",
"size": 8
},
"line": {
"color": "hsl(300, 70%, 35%)",
"width": 3
},
"opacity": 1.0,
"legendgroup": "muninn_embed_sqlite-vector-pq",
"legendgrouptitle": {
"text": "muninn-embed + sqlite-vector-pq"
}
}
],
"layout": {
"title": {
"text": "Recall@k (Wealth of Nations)"
},
"xaxis": {
"title": {
"text": "Dataset Size (N vectors)"
},
"type": "log"
},
"yaxis": {
"title": {
"text": "Recall@k"
},
"type": "linear"
},
"template": "plotly_white",
"legend": {
"orientation": "v",
"yanchor": "top",
"y": 0.99,
"xanchor": "left",
"x": 1.02,
"groupclick": "togglegroup"
}
}
}