Browse Source

Merge pull request #325 from surak/patch-1

Update README.md for #324
pull/387/head
Daniel Miessler 6 months ago committed by GitHub
parent
commit
4e7652188a
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
  1. 9
      README.md

9
README.md

@ -206,6 +206,15 @@ fabric --help
### Using the `fabric` client ### Using the `fabric` client
If you want to use it with OpenAI API compatible inference servers, such as [FastChat](https://github.com/lm-sys/FastChat), [Helmholtz Blablador](http://helmholtz-blablador.fz-juelich.de), [LM Studio](https://lmstudio.ai) and others, simply export the following environment variables:
- `export OPENAI_BASE_URL=https://YOUR-SERVER:8000/v1/`
- `export DEFAULT_MODEL="YOUR_MODEL"`
And if your server needs authentication tokens, like Blablador does, you export the token the same way you would with OpenAI:
- `export OPENAI_API_KEY="YOUR TOKEN"`
Once you have it all set up, here's how to use it. Once you have it all set up, here's how to use it.
1. Check out the options 1. Check out the options

Loading…
Cancel
Save