Update README.md
Browse files
README.md
CHANGED
|
@@ -9,8 +9,8 @@ tags:
|
|
| 9 |
|
| 10 |
# DNA and Block Diffusion
|
| 11 |
|
| 12 |
-
Using the
|
| 13 |
-
[AgroNT](https://huggingface.co/InstaDeepAI/agro-nucleotide-transformer-1b)'s
|
| 14 |
|
| 15 |
Took [dna-blockdiff-2](https://huggingface.co/monsoon-nlp/dna-blockdiff-2) weights,
|
| 16 |
trained on [Papaya genome](https://huggingface.co/datasets/monsoon-nlp/wheat-bees) for one epoch. Output tokens are restricted to avoid outputting single-nucleotide or N (unknown nucleotide) tokens.
|
|
|
|
| 9 |
|
| 10 |
# DNA and Block Diffusion
|
| 11 |
|
| 12 |
+
Using the **Block Diffusion** architecture ([code](https://github.com/kuleshov-group/bd3lms), [paper](https://arxiv.org/abs/2503.09573)) and
|
| 13 |
+
[AgroNT](https://huggingface.co/InstaDeepAI/agro-nucleotide-transformer-1b)'s 6-nucleotide tokens (4^6 = 4,096).
|
| 14 |
|
| 15 |
Took [dna-blockdiff-2](https://huggingface.co/monsoon-nlp/dna-blockdiff-2) weights,
|
| 16 |
trained on [Papaya genome](https://huggingface.co/datasets/monsoon-nlp/wheat-bees) for one epoch. Output tokens are restricted to avoid outputting single-nucleotide or N (unknown nucleotide) tokens.
|