diff --git a/README.md b/README.md index b9c43c6..553ddad 100644 --- a/README.md +++ b/README.md @@ -203,6 +203,15 @@ fabric --help ### Using the `fabric` client +If you want to use it with OpenAI API compatible inference servers, such as [FastChat](https://github.com/lm-sys/FastChat) or [Helmholtz Blablador](http://helmholtz-blablador.fz-juelich.de), simply export the following environment variables: + +- `export OPENAI_BASE_URL=https://YOUR-SERVER:8000/v1/` +- `export DEFAULT_MODEL="YOUR_MODEL"` + +And if your server needs authentication tokens, like Blablador does, you export the token the same way you would with OpenAI: + +- `export OPENAI_API_KEY="YOUR TOKEN"` + Once you have it all set up, here's how to use it. 1. Check out the options