KRLabsOrg
/

lettucedect-mmbert-small-hu-v1

Token Classification

token classification

hallucination detection

question answer

Model card Files Files and versions

adaamko commited on Oct 3

Commit

7970abe

·

verified ·

1 Parent(s): 2f30d6e

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -87,8 +87,8 @@ We evaluate our Hungarian models on the translated [RAGTruth](https://aclantholo
 | Language | Model                                   | Precision (%) | Recall (%) | F1 (%) | Maverick F1 (%) | Δ F1 (%) |
 |----------|-----------------------------------------|---------------|------------|--------|-----------------|----------|
 | Hungarian | meta-llama/Llama-4-Maverick-17B-128E-Instruct | 38.70        | **96.82** | 55.30 | 55.30          | +0.00    |
-| Hungarian | mmBERT-small (ours)                    | 70.20         | 72.51      | 71.33 | 55.30          | **+16.03** |
-| Hungarian | mmBERT-base (ours)                     | **76.62**     | 69.21      | **72.73** | 55.30          | **+17.43** |
 *Note:* Percentages are reported for the hallucination class (Class 1). Δ F1 is measured in percentage points vs. the Maverick baseline.

 | Language | Model                                   | Precision (%) | Recall (%) | F1 (%) | Maverick F1 (%) | Δ F1 (%) |
 |----------|-----------------------------------------|---------------|------------|--------|-----------------|----------|
 | Hungarian | meta-llama/Llama-4-Maverick-17B-128E-Instruct | 38.70        | **96.82** | 55.30 | 55.30          | +0.00    |
+| Hungarian | lettucedect-mmBERT-small (ours)                    | 70.20         | 72.51      | 71.33 | 55.30          | **+16.03** |
+| Hungarian | lettucedect-mmBERT-base (ours)                     | **76.62**     | 69.21      | **72.73** | 55.30          | **+17.43** |
 *Note:* Percentages are reported for the hallucination class (Class 1). Δ F1 is measured in percentage points vs. the Maverick baseline.