Browse Source

Update README.md for #324

Closes #324 , showing how to connect to another server
pull/325/head
Alexandre Strube 11 months ago committed by GitHub
parent
commit
17fce1bea5
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
  1. 9
      README.md

9
README.md

@ -203,6 +203,15 @@ fabric --help
### Using the `fabric` client ### Using the `fabric` client
If you want to use it with OpenAI API compatible inference servers, such as [FastChat](https://github.com/lm-sys/FastChat) or [Helmholtz Blablador](http://helmholtz-blablador.fz-juelich.de), simply export the following environment variables:
- `export OPENAI_BASE_URL=https://YOUR-SERVER:8000/v1/`
- `export DEFAULT_MODEL="YOUR_MODEL"`
And if your server needs authentication tokens, like Blablador does, you export the token the same way you would with OpenAI:
- `export OPENAI_API_KEY="YOUR TOKEN"`
Once you have it all set up, here's how to use it. Once you have it all set up, here's how to use it.
1. Check out the options 1. Check out the options

Loading…
Cancel
Save