Update README.md
Browse files
README.md
CHANGED
|
@@ -29,7 +29,7 @@ model-index:
|
|
| 29 |
|
| 30 |
# SciClimateBERT 🌎🔬
|
| 31 |
|
| 32 |
-
**SciClimateBERT** is a domain-adapted version of **ClimateBERT
|
| 33 |
|
| 34 |
## 🔍 Overview
|
| 35 |
|
|
@@ -52,11 +52,22 @@ Evaluated on **ClimaBench**, a benchmark suite for climate-focused NLP tasks:
|
|
| 52 |
|
| 53 |
While based on ClimateBERT, this model focuses on structured scientific input, making it ideal for downstream applications in climate science and research automation.
|
| 54 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 55 |
## 🧪 Intended Uses
|
| 56 |
|
| 57 |
**Use for:**
|
| 58 |
- Scientific climate change text classification and extraction
|
| 59 |
-
- NLP-powered climate science discovery tools
|
| 60 |
- Knowledge base and graph construction in climate policy and research domains
|
| 61 |
|
| 62 |
**Not suitable for:**
|
|
|
|
| 29 |
|
| 30 |
# SciClimateBERT 🌎🔬
|
| 31 |
|
| 32 |
+
**SciClimateBERT** is a domain-adapted version of [**ClimateBERT**](https://huggingface.co/climatebert/distilroberta-base-climate-f), further pretrained on peer-reviewed scientific papers focused on climate change. While ClimateBERT is tuned for general climate-related text, SciClimateBERT narrows the focus to high-quality academic content, improving performance in scientific NLP applications.
|
| 33 |
|
| 34 |
## 🔍 Overview
|
| 35 |
|
|
|
|
| 52 |
|
| 53 |
While based on ClimateBERT, this model focuses on structured scientific input, making it ideal for downstream applications in climate science and research automation.
|
| 54 |
|
| 55 |
+
Climate performance model card:
|
| 56 |
+
|SciClimateBERT||
|
| 57 |
+
|---------------------------------|-----------------------------|
|
| 58 |
+
| 1. Model publicly available? | Yes |
|
| 59 |
+
| 2. Time to train final model |300h |
|
| 60 |
+
| 3. Time for all experiments | 1,226h $\sim$ 51 days |
|
| 61 |
+
| 4. Power of GPU and CPU | 0.250 kW + 0.013 kW |
|
| 62 |
+
| 5. Location for computations | Croatia |
|
| 63 |
+
| 6. Energy mix at location | 224.71 gCO$_2$eq/kWh |
|
| 64 |
+
| 7. CO$_2$eq for final model | 18 kg CO$_2$ |
|
| 65 |
+
| 8. CO$_2$eq for all experiments | 74 kg CO$_2$ |
|
| 66 |
+
|
| 67 |
## 🧪 Intended Uses
|
| 68 |
|
| 69 |
**Use for:**
|
| 70 |
- Scientific climate change text classification and extraction
|
|
|
|
| 71 |
- Knowledge base and graph construction in climate policy and research domains
|
| 72 |
|
| 73 |
**Not suitable for:**
|