Jax code for inference?
#7
by
james-golden-arcadia
- opened
Would you consider releasing Jax code for inference? I am hoping to take advantage of Jax compilation for VRAM-efficient inference on long sequences.
Thank you again for this excellent model!