Hugging Face's logo

ibm-granite
/
granite-vision-3.3-2b-embedding

Feature Extraction
Transformers
Safetensors
English
granitevisionemb
custom_code
Model card Files
xet
Community
12
Adirazgold commited on
Commit
baa53d1
·
verified ·
1 Parent(s): cee615d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -12
README.md CHANGED
@@ -17,23 +17,23 @@ We evaluated granite-vision-3.3-2b-embedding alongside other top colBERT style m
17
  ## **NDCG@5 - ViDoRe V2**
18
  | Collection \ Model | ColPali-v1.3 | ColQwen2.5-v0.2 | ColNomic-3b | ColSmolvlm-v0.1 | granite-vision-3.3-2b-embedding |
19
  |----------------------------------------|--------------|------------------|-------------|-------------------|-----------
20
- | ESG Restaurant Human | 51.1 | 68.4 | 65.8 | 62.4 | 62.3 |
21
- | Economics Macro Multilingual | 49.9 | 56.5 | 55.4 | 47.4 | 48.3 |
22
- | MIT Biomedical | 59.7 | 63.6 | 63.5 | 58.1 |60.0 |
23
- | ESG Restaurant Synthetic | 57.0 | 57.4 | 56.6 | 51.1 |54.0 |
24
- | ESG Restaurant Synthetic Multilingual | 55.7 | 57.4 | 57.2 | 47.6 |53.5 |
25
- | MIT Biomedical Multilingual | 56.5 | 61.1 | 62.5 | 50.5 | 53.6 |
26
- | Economics Macro | 51.6 | 59.8 | 60.2 | 60.9 |60.0 |
27
- | **Avg (ViDoRe2)** | **54.5** | **60.6** | **60.2** | **54.0** |**56.0** |
28
 
29
  ## **NDCG@5 - REAL-MM-RAG**
30
  | Collection \ Model | ColPali-v1.3 | ColQwen2.5-v0.2 | ColNomic-3b | ColSmolvlm-v0.1 | granite-vision-3.3-2b-embedding |
31
  |----------------------------------------|--------------|------------------|-------------|--------------------------| ------------------
32
- | FinReport | 55 | 66 | 78 | 65 |70
33
- | FinSlides | 68 | 79 | 81 | 55 |74
34
- | TechReport | 78 | 86 | 88 | 83 |84
35
  | TechSlides | 90 | 93 | 92 | 91 |93
36
- | **Avg (REAL-MM-RAG)** | **73** | **81** | **85** | **74** |**80**
37
 
38
  - **Release Date**: June 11th 2025
39
  - **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
 
17
  ## **NDCG@5 - ViDoRe V2**
18
  | Collection \ Model | ColPali-v1.3 | ColQwen2.5-v0.2 | ColNomic-3b | ColSmolvlm-v0.1 | granite-vision-3.3-2b-embedding |
19
  |----------------------------------------|--------------|------------------|-------------|-------------------|-----------
20
+ | ESG Restaurant Human | 51.1 | 68.4 | 65.8 | 62.4 | 65.3 |
21
+ | Economics Macro Multilingual | 49.9 | 56.5 | 55.4 | 47.4 | 51.2 |
22
+ | MIT Biomedical | 59.7 | 63.6 | 63.5 | 58.1 |61.5 |
23
+ | ESG Restaurant Synthetic | 57.0 | 57.4 | 56.6 | 51.1 |56.6 |
24
+ | ESG Restaurant Synthetic Multilingual | 55.7 | 57.4 | 57.2 | 47.6 |55.7 |
25
+ | MIT Biomedical Multilingual | 56.5 | 61.1 | 62.5 | 50.5 | 55.5 |
26
+ | Economics Macro | 51.6 | 59.8 | 60.2 | 60.9 |58.3 |
27
+ | **Avg (ViDoRe2)** | **54.5** | **60.6** | **60.2** | **54.0** |**57.7** |
28
 
29
  ## **NDCG@5 - REAL-MM-RAG**
30
  | Collection \ Model | ColPali-v1.3 | ColQwen2.5-v0.2 | ColNomic-3b | ColSmolvlm-v0.1 | granite-vision-3.3-2b-embedding |
31
  |----------------------------------------|--------------|------------------|-------------|--------------------------| ------------------
32
+ | FinReport | 55 | 66 | 78 | 65 |73
33
+ | FinSlides | 68 | 79 | 81 | 55 |79
34
+ | TechReport | 78 | 86 | 88 | 83 |87
35
  | TechSlides | 90 | 93 | 92 | 91 |93
36
+ | **Avg (REAL-MM-RAG)** | **73** | **81** | **85** | **74** |**83**
37
 
38
  - **Release Date**: June 11th 2025
39
  - **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)