Generated README.md

README.md

@@ -4,8 +4,15 @@ language:
 - en
 pipeline_tag: text-generation
 tags:
-- llm
+- llm-rs
 - ggml
+datasets:
+- mc4
+- c4
+- togethercomputer/RedPajama-Data-1T
+- bigcode/the-stack
+- allenai/s2orc
+inference: false
 ---
 # GGML converted versions of [Mosaic's](https://huggingface.co/mosaicml) MPT Models
 
@@ -15,20 +22,24 @@ This model was trained by [MosaicML](https://www.mosaicml.com).
 MPT-7B is part of the family of MosaicPretrainedTransformer (MPT) models, which use a modified transformer architecture optimized for efficient training and inference. 
 
 ## Converted Models:
-| Name   | Based on |  Type | Container |
-|-|-|-|-|
-| [mpt-7b-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-f16.bin) |  [mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | fp16 | GGML |
-| [mpt-7b-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q4_0.bin) |  [mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | int4 | GGML |
-| [mpt-7b-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q4_0-ggjt.bin) |  [mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | int4 | GGJT |
-| [mpt-7b-chat-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-f16.bin) |  [mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | fp16 | GGML |
-| [mpt-7b-chat-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q4_0.bin) |  [mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | int4 | GGML |
-| [mpt-7b-chat-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q4_0-ggjt.bin) |  [mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | int4 | GGJT |
-| [mpt-7b-instruct-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-f16.bin) |  [mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | fp16 | GGML |
-| [mpt-7b-instruct-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q4_0.bin) |  [mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | int4 | GGML |
-| [mpt-7b-instruct-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q4_0-ggjt.bin) |  [mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | int4 | GGJT |
-| [mpt-7b-storywriter-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-f16.bin) |  [mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | fp16 | GGML | 
-| [mpt-7b-storywriter-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q4_0.bin) |  [mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | int4 | GGML |
-| [mpt-7b-storywriter-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q4_0-ggjt.bin) |  [mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | int4 | GGJT |
+| Name                                                                                                                          | Based on                                                                          | Type   | Container   | GGML Version   |
+|:------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:-------|:------------|:---------------|
+| [mpt-7b-chat-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-f16.bin)                           | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat)               | F16    | GGML        | V3             |
+| [mpt-7b-chat-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q4_0.bin)                         | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat)               | Q4_0   | GGML        | V3             |
+| [mpt-7b-chat-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q4_0-ggjt.bin)               | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat)               | Q4_0   | GGJT        | V3             |
+| [mpt-7b-chat-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q5_1-ggjt.bin)               | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat)               | Q5_1   | GGJT        | V3             |
+| [mpt-7b-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-f16.bin)                                     | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b)                         | F16    | GGML        | V3             |
+| [mpt-7b-instruct-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-f16.bin)                   | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct)       | F16    | GGML        | V3             |
+| [mpt-7b-instruct-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q4_0.bin)                 | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct)       | Q4_0   | GGML        | V3             |
+| [mpt-7b-instruct-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q4_0-ggjt.bin)       | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct)       | Q4_0   | GGJT        | V3             |
+| [mpt-7b-instruct-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q5_1-ggjt.bin)       | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct)       | Q5_1   | GGJT        | V3             |
+| [mpt-7b-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q4_0.bin)                                   | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b)                         | Q4_0   | GGML        | V3             |
+| [mpt-7b-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q4_0-ggjt.bin)                         | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b)                         | Q4_0   | GGJT        | V3             |
+| [mpt-7b-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q5_1-ggjt.bin)                         | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b)                         | Q5_1   | GGJT        | V3             |
+| [mpt-7b-storywriter-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-f16.bin)             | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | F16    | GGML        | V3             |
+| [mpt-7b-storywriter-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q4_0.bin)           | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | Q4_0   | GGML        | V3             |
+| [mpt-7b-storywriter-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q4_0-ggjt.bin) | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | Q4_0   | GGJT        | V3             |
+| [mpt-7b-storywriter-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q5_1-ggjt.bin) | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | Q5_1   | GGJT        | V3             |
 
 ⚠️Caution⚠️: mpt-7b-storywriter is still under development!
 
@@ -53,7 +64,8 @@ print(model.generate("The meaning of life is"))
 
 #### Installation
 ```
-git clone --recurse-submodules git@github.com:rustformers/llm.git
+git clone --recurse-submodules https://github.com/rustformers/llm.git
+cd llm
 cargo build --release
 ```