Browse Source

Added a note about pausing HuggingFace endpoints

pull/4/head
Edward Donner 7 months ago
parent
commit
08350adabe
  1. 13
      week4/day4.ipynb
  2. 4
      week5/day1.ipynb
  3. 2621
      week6/day3.ipynb

13
week4/day4.ipynb

@ -11,7 +11,18 @@
"\n",
"To replicate this, you'll need to set up a HuggingFace endpoint as I do in the video. It's simple to do, and it's quite satisfying to see the results!\n",
"\n",
"It's also an important part of your learning; this is the first example of deploying an open source model to be behind an API. We'll return to this in Week 8, but this should plant a seed in your mind for what's involved in moving open source models into production."
"It's also an important part of your learning; this is the first example of deploying an open source model to be behind an API. We'll return to this in Week 8, but this should plant a seed in your mind for what's involved in moving open source models into production.\n",
"\n",
"## Important Note\n",
"\n",
"If you do decide to use HuggingFace endpoints for this project, you should stop or pause the endpoints when you are done to avoid accruing unnecessary running cost. The costs are very low as long as you only run the endpoint when you're using it. Naviagte to the HuggingFace endpoint UI here:\n",
"\n",
"https://ui.endpoints.huggingface.co/\n",
"\n",
"And open your endpoint, and click Pause to put it on pause so you no longer pay for it. \n",
"Many thanks to student John L. for raising this.\n",
"\n",
"In week 8 we will use Modal instead of HuggingFace endpoints; with Modal you only pay for the time that you use it."
]
},
{

4
week5/day1.ipynb

@ -140,7 +140,7 @@
"def get_relevant_context(message):\n",
" relevant_context = []\n",
" for context_title, context_details in context.items():\n",
" if context_title in message:\n",
" if context_title.lower() in message.lower():\n",
" relevant_context.append(context_details)\n",
" return relevant_context "
]
@ -152,7 +152,7 @@
"metadata": {},
"outputs": [],
"source": [
"get_relevant_context(\"Who is Lancaster?\")"
"get_relevant_context(\"Who is lancaster?\")"
]
},
{

2621
week6/day3.ipynb

File diff suppressed because one or more lines are too long
Loading…
Cancel
Save