From the uDemy course on LLM engineering.
https://www.udemy.com/course/llm-engineering-master-ai-and-large-language-models
You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
205 lines
5.8 KiB
205 lines
5.8 KiB
WEBVTT |
|
|
|
00:00.500 --> 00:02.780 |
|
Well, how fabulous is that? |
|
|
|
00:02.780 --> 00:09.620 |
|
I hope that you are as wowed as I am by our new airline, I assistant and everything it can do. |
|
|
|
00:09.620 --> 00:16.610 |
|
I've taken another screenshot here of of a conversation I'd had, and you can see again that gorgeous |
|
|
|
00:16.610 --> 00:17.690 |
|
image of London. |
|
|
|
00:17.720 --> 00:18.740 |
|
A very different approach now. |
|
|
|
00:18.740 --> 00:22.430 |
|
Not the montage, but something rather rather simpler. |
|
|
|
00:22.430 --> 00:28.790 |
|
Uh, it I find it astounding that you get such variety, such diversity of images. |
|
|
|
00:28.850 --> 00:34.280 |
|
Um, and I also find it astounding that it's so easy to put together these sophisticated frameworks |
|
|
|
00:34.280 --> 00:36.140 |
|
involving lots of functionality. |
|
|
|
00:36.230 --> 00:39.890 |
|
Remember, we also had our tool running there, looking up the prices. |
|
|
|
00:39.890 --> 00:46.400 |
|
Uh, everything we had together was a very sophisticated, complex app, complete with user interface. |
|
|
|
00:46.400 --> 00:51.470 |
|
And we did it all just in a few hours worth of work. |
|
|
|
00:53.000 --> 00:56.030 |
|
So it's a congratulations. |
|
|
|
00:56.030 --> 01:01.370 |
|
But as always, there's a challenge for you and if I may say, one more time, the best way to learn |
|
|
|
01:01.370 --> 01:02.150 |
|
is by doing. |
|
|
|
01:02.150 --> 01:07.160 |
|
It is incredibly important that you now go and do some exercises and work on this to improve it. |
|
|
|
01:07.190 --> 01:09.930 |
|
It's also a lot of fun as an extra bonus. |
|
|
|
01:09.930 --> 01:11.880 |
|
So here are some of the things you can do. |
|
|
|
01:11.910 --> 01:16.590 |
|
We talked before about adding in another tool to make a booking. |
|
|
|
01:16.620 --> 01:21.360 |
|
In theory, not obviously a real booking, but make a booking and then it should print to an output |
|
|
|
01:21.360 --> 01:22.680 |
|
that a booking has been made. |
|
|
|
01:22.680 --> 01:27.120 |
|
Or maybe if you if you want, you could have it write to a file or something like that to give you a |
|
|
|
01:27.120 --> 01:28.740 |
|
sense that the booking has happened. |
|
|
|
01:28.770 --> 01:29.940 |
|
Add that as a tool. |
|
|
|
01:29.940 --> 01:33.270 |
|
Hopefully you've done it already, but if not, now's a good time to do it. |
|
|
|
01:33.360 --> 01:35.400 |
|
Then add another agent. |
|
|
|
01:35.400 --> 01:41.040 |
|
Uh, have an agent that is able to translate all of the responses to a different language. |
|
|
|
01:41.040 --> 01:43.500 |
|
Uh, something that we'd suggested for a previous project. |
|
|
|
01:43.500 --> 01:48.060 |
|
But do that and then show it on the right hand side and use a different frontier model. |
|
|
|
01:48.090 --> 01:54.240 |
|
How about Claude, for example, use Claude as a way to translate to another language of your choosing, |
|
|
|
01:54.240 --> 01:58.140 |
|
and then you'd have to do some radio work to add another panel. |
|
|
|
01:58.290 --> 02:00.450 |
|
With that translation. |
|
|
|
02:00.450 --> 02:03.510 |
|
There will be a little bit of futzing around with Gradio when you do that. |
|
|
|
02:03.510 --> 02:09.660 |
|
So you may you may find that that requires a little bit of googling, but hopefully you'll get an idea |
|
|
|
02:09.690 --> 02:10.770 |
|
or you don't need to Google. |
|
|
|
02:10.770 --> 02:17.520 |
|
You could actually ask, uh, Claude yourself for some advice on how to extend that Gradio app to add |
|
|
|
02:17.520 --> 02:23.970 |
|
in that extra section to reflect the translation that it makes into another language. |
|
|
|
02:23.970 --> 02:28.650 |
|
You'll find that when you do something like that, you provide a bunch of code and ask it to extend |
|
|
|
02:28.650 --> 02:35.520 |
|
it, to do more, to add more capabilities, that these models are excellent at that kind of, uh, |
|
|
|
02:35.520 --> 02:37.410 |
|
that kind of iterating on code. |
|
|
|
02:37.800 --> 02:45.870 |
|
And then finally, since we've been enjoying multi-modality, one more multimodal task for you is audio |
|
|
|
02:45.870 --> 02:52.890 |
|
to text, uh, add an agent that can listen to audio from your audio input source and turn it into text |
|
|
|
02:52.890 --> 02:55.560 |
|
as the input to the AI assistant. |
|
|
|
02:55.560 --> 02:57.150 |
|
And then you've really completed the loop. |
|
|
|
02:57.150 --> 03:01.950 |
|
You'll be able to talk to it, and it will be able to talk back and draw images. |
|
|
|
03:01.950 --> 03:05.040 |
|
When you were looking to ask for ticket prices. |
|
|
|
03:05.040 --> 03:08.640 |
|
And that will then complete the week two challenge. |
|
|
|
03:08.640 --> 03:15.780 |
|
And at that point you will be very familiar with Multi-modality and with using these, uh, stitching |
|
|
|
03:15.810 --> 03:19.860 |
|
together these different agents to carry out a bigger task. |
|
|
|
03:21.960 --> 03:24.790 |
|
And at that point, May I tell you? |
|
|
|
03:24.820 --> 03:29.260 |
|
You are now 25% of the way to mastering LM engineering. |
|
|
|
03:29.290 --> 03:30.460 |
|
25% of the way. |
|
|
|
03:30.490 --> 03:31.720 |
|
A quarter of the way through. |
|
|
|
03:31.750 --> 03:36.520 |
|
You can describe Transformers comfortably, including all of the terminology. |
|
|
|
03:36.520 --> 03:43.900 |
|
You can code against the APIs, and you can build multimodal assistance using UIs, using tools, using |
|
|
|
03:43.900 --> 03:44.560 |
|
agents. |
|
|
|
03:44.590 --> 03:47.710 |
|
This is practically second nature to you at this point. |
|
|
|
03:48.010 --> 03:48.340 |
|
Uh. |
|
|
|
03:48.370 --> 03:57.910 |
|
Next week, change in topic to something that is absolutely wonderful the thriving open source community |
|
|
|
03:57.910 --> 04:05.110 |
|
and and thriving capabilities that you have access to through open source, you're going to get to know |
|
|
|
04:05.140 --> 04:07.720 |
|
hugging face really well, really, really well. |
|
|
|
04:07.720 --> 04:14.050 |
|
You're going to work with pipelines and also with Tokenizers and with the models themselves with transformer |
|
|
|
04:14.050 --> 04:15.040 |
|
models. |
|
|
|
04:15.280 --> 04:21.430 |
|
And ultimately you're going to be running inference of open source models using Google Colab on their |
|
|
|
04:21.430 --> 04:23.020 |
|
boxes with GPUs. |
|
|
|
04:23.020 --> 04:30.010 |
|
And so by the end of the week, you'll be highly proficient with inference of open source models. |
|
|
|
04:30.010 --> 04:31.540 |
|
And I can't wait to get to it. |
|
|
|
04:31.540 --> 04:32.740 |
|
And I will see you then.
|
|
|