- Print
- DarkLight
- PDF
Article summary
Did you find this summary helpful?
Thank you for your feedback
Post
/api/v2/completions
This endpoint can be used to generate completions from a Large Language Model.
It is a simple proxy forwarding your requests to the desired model.
Any LightOn model is deployed on a vLLM-based image and is therefore compatible with the OpenAI request format.
Body parameters
LightOnModelExample
LightOn model example
{
"model": "alfred-40b-1123",
"prompt": "Hello, "
}
object
model
string Required
Model to use, must exist and be configured from the admin.
object
model
string Required
Model to use, must exist and be configured from the admin.
object
model
string Required
Model to use, must exist and be configured from the admin.
Responses
200
No response body
Was this article helpful?