Usage via API

#2
by cnmoro - opened

I've got really good results with this model.
Do you guys plan on providing this model via API? e.g. pay per usage

Thanks

can be served like llms on vllm?

No, though it can be served using FastPlaid and other late interaction libraries.

fernandofernandes changed discussion status to closed

Sign up or log in to comment