Update README.md
Browse files
README.md
CHANGED
|
@@ -13,20 +13,20 @@ library_name: torch
|
|
| 13 |
pipeline_tag: feature-extraction
|
| 14 |
metrics:
|
| 15 |
- type: explained_variance
|
| 16 |
-
value:
|
| 17 |
pretty_name: Explained Variance %
|
| 18 |
range:
|
| 19 |
min: 0
|
| 20 |
max: 100
|
| 21 |
- type: l0
|
| 22 |
-
value:
|
| 23 |
pretty_name: L0
|
| 24 |
---
|
| 25 |
|
| 26 |
-
# CLIP-B-32 Sparse Autoencoder x64 vanilla - L1:
|
| 27 |
|
| 28 |
-

|
| 29 |
+

|
| 30 |
|
| 31 |
### Training Details
|
| 32 |
|
|
|
|
| 45 |
|
| 46 |
### Performance Metrics
|
| 47 |
|
| 48 |
+
- L1 Coefficient: 8e-05
|
| 49 |
+
- L0 Sparsity: 287.6007
|
| 50 |
+
- Explained Variance: 0.7931 (79.31%)
|
| 51 |
|
| 52 |
### Training Configuration
|
| 53 |
|
|
|
|
| 58 |
- Device: NVIDIA Quadro RTX 8000
|
| 59 |
|
| 60 |
**Experiment Tracking:**
|
| 61 |
+
- Weights & Biases Run ID: xwlpfrzs
|
| 62 |
+
- Full experiment details: https://wandb.ai/perceptual-alignment/clip/runs/xwlpfrzs/overview
|
| 63 |
- Git Commit: e22dd02726b74a054a779a4805b96059d83244aa
|
| 64 |
|
| 65 |
## Citation
|
|
|
|
| 71 |
year={2024},
|
| 72 |
publisher={Prisma-Multimodal},
|
| 73 |
url={https://huggingface.co/Prisma-Multimodal},
|
| 74 |
+
note={Layer 11, hook_resid_post, Run ID: xwlpfrzs}
|
| 75 |
}
|