Update README.md

README.md

@@ -40,9 +40,14 @@ The following checkpoints are from our paper titled Goldfish Loss: Mitigating Me
 - The control model differs only in the fact that it did not utilize the canaries dataset for memorization and was simply pre-trained on 20B Redpajama tokens. 
 - The Canaries dataset, which contains 2000 Wikidocs, is repeated 50 times throughout the pre-training. Thus, it contains around ~204M tokens in total (including padding).
 
+# Technical Specification
+
+Each checkpoint mentioned above used randomly initialized [TinyLLaMA-1.1B](https://huggingface.co/TinyLlama/TinyLlama_v1.1) architecture. 
+For pretraining details, please find check our [GitHub](https://github.com/ahans30/goldfish-loss) repository. 
+
 # Cite our work
 
-If you find our work useful, please cite our paper:
+If you find our model, codebase or dataset beneficial, please consider citing our work:
 
 ```bibtex
 @misc{hans2024like,