From 17fce1bea55630b6c9c963c6ebc9c5a859ac85a2 Mon Sep 17 00:00:00 2001 From: Alexandre Strube Date: Fri, 5 Apr 2024 12:34:49 +0200 Subject: [PATCH 1/2] Update README.md for #324 Closes #324 , showing how to connect to another server --- README.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/README.md b/README.md index b9c43c6..553ddad 100644 --- a/README.md +++ b/README.md @@ -203,6 +203,15 @@ fabric --help ### Using the `fabric` client +If you want to use it with OpenAI API compatible inference servers, such as [FastChat](https://github.com/lm-sys/FastChat) or [Helmholtz Blablador](http://helmholtz-blablador.fz-juelich.de), simply export the following environment variables: + +- `export OPENAI_BASE_URL=https://YOUR-SERVER:8000/v1/` +- `export DEFAULT_MODEL="YOUR_MODEL"` + +And if your server needs authentication tokens, like Blablador does, you export the token the same way you would with OpenAI: + +- `export OPENAI_API_KEY="YOUR TOKEN"` + Once you have it all set up, here's how to use it. 1. Check out the options From c5dd2f300d9999c2a64a5453cb3d2faf6d6dfc93 Mon Sep 17 00:00:00 2001 From: Alexandre Strube Date: Fri, 12 Apr 2024 13:54:17 +0200 Subject: [PATCH 2/2] Add LMStudio --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 553ddad..5e1a9a4 100644 --- a/README.md +++ b/README.md @@ -203,7 +203,7 @@ fabric --help ### Using the `fabric` client -If you want to use it with OpenAI API compatible inference servers, such as [FastChat](https://github.com/lm-sys/FastChat) or [Helmholtz Blablador](http://helmholtz-blablador.fz-juelich.de), simply export the following environment variables: +If you want to use it with OpenAI API compatible inference servers, such as [FastChat](https://github.com/lm-sys/FastChat), [Helmholtz Blablador](http://helmholtz-blablador.fz-juelich.de), [LM Studio](https://lmstudio.ai) and others, simply export the following environment variables: - `export OPENAI_BASE_URL=https://YOUR-SERVER:8000/v1/` - `export DEFAULT_MODEL="YOUR_MODEL"`