You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 

229 lines
6.4 KiB

WEBVTT
00:00.050 --> 00:06.620
And now let's move to Claude from anthropic, my favorite model and typically the favorite model of
00:06.620 --> 00:08.120
most data scientists.
00:08.120 --> 00:15.020
The most recent version, Claude 3.5 Sonnet New, that came out in October, is currently leading in
00:15.050 --> 00:20.870
most benchmarks, showing that it is right now probably the strongest LLM on the planet.
00:20.900 --> 00:24.080
Let's start off with a difficult question for Claude.
00:24.080 --> 00:29.240
What does it feel like to be jealous?
00:30.590 --> 00:32.450
See how it answers this?
00:32.480 --> 00:39.200
And what you'll find is that we'll get back something that is thoughtful and interesting and remarkably
00:39.200 --> 00:40.340
insightful.
00:40.370 --> 00:44.420
Uh, from my understanding, it's hinting at the fact that it doesn't experience.
00:44.420 --> 00:50.480
Jealousy itself often manifests as fear, insecurity, and desire a tight knot in your stomach.
00:50.480 --> 00:56.540
So it gives it like a almost a biological sort of sense to it and a burning sensation in your chest.
00:56.780 --> 01:00.590
Racing thoughts, uh, a sense of inadequacy or being threatened.
01:00.620 --> 01:02.570
It's really interesting.
01:02.570 --> 01:04.040
Compelling answer.
01:04.070 --> 01:07.140
No problem at all with a difficult question like that.
01:07.170 --> 01:07.680
Okay.
01:07.710 --> 01:15.000
Let's ask how many times does the letter A appear in this sentence?
01:16.500 --> 01:18.300
See how it handles that?
01:18.330 --> 01:20.700
Let me count it.
01:20.700 --> 01:21.660
Gets it wrong.
01:22.590 --> 01:24.420
Hope for humanity still.
01:24.510 --> 01:31.860
Uh, so, uh, Claude counts five times and gives an incorrect explanation for that again.
01:31.890 --> 01:34.710
We'll find out later why these sorts of questions are harder.
01:34.710 --> 01:36.240
And so, so far it's zero.
01:36.240 --> 01:39.870
One preview is the only model that was able to handle that.
01:40.050 --> 01:40.590
All right.
01:40.590 --> 01:47.340
Let's ask it a tricky question compared with other frontier llms what kinds of questions do you best
01:47.340 --> 01:49.980
at answering and what do you find most challenging?
01:50.250 --> 01:53.340
Which others compare with you?
01:53.370 --> 01:56.130
So what you get from Claude here is interesting.
01:56.130 --> 02:03.990
It pushes back and this ties to to anthropic strong views about the need for safety and alignment in
02:03.990 --> 02:04.830
models.
02:05.010 --> 02:09.690
Um, it says I aim to be direct and transparent whilst respecting my ethics.
02:09.690 --> 02:14.480
I am not comfortable making comparative claims versus other AI models.
02:14.480 --> 02:18.110
What it will then do is tell you about its own strengths and weaknesses.
02:18.110 --> 02:20.630
It's a very interesting kind of answer.
02:21.200 --> 02:28.310
By comparison, if we go back to GPT and ask it the same question, we'll see how GPT responds and what
02:28.310 --> 02:34.130
you'll find there is it doesn't have the same kind of qualms about about responding.
02:34.130 --> 02:41.090
You'll get something very clear about where it's strongest, the challenges and then complementary.
02:41.600 --> 02:49.580
So ChatGPT with web browsing and code interpreter, which I think is its name for the canvas piece,
02:49.580 --> 02:50.570
Claude.
02:50.600 --> 02:57.080
It gives interestingly as a comparison point and then it says Barred by Google and it should really
02:57.110 --> 02:58.460
say Gemini.
02:58.820 --> 03:04.850
But it's interesting that it that it does give the main competitors and it talks about some of the differences.
03:04.850 --> 03:05.510
And look at this.
03:05.510 --> 03:13.010
Fascinatingly, it does mention that Claude has more thoughtful responses on broader socio ethical considerations,
03:13.010 --> 03:15.870
which could complement my technical focus.
03:15.870 --> 03:23.520
Fascinating that not only does GPT four have that kind of ability to compare, but it gives really well
03:23.550 --> 03:25.260
considered answers to.
03:25.290 --> 03:27.600
So I thought that was particularly interesting.
03:28.140 --> 03:28.650
All right.
03:28.650 --> 03:33.330
Anyway, that gives us our quick tour of some of the features of, uh, Claude.
03:33.330 --> 03:39.690
It's also worth saying that Claude is really effective at coding and working with you on code.
03:39.750 --> 03:48.150
Let's ask it for, uh, to give an example, let's say please, uh, give me some example code that
03:48.150 --> 04:00.150
uses, uh, that, uh, some example Python that, uh, uses the open AI API.
04:00.450 --> 04:04.620
Let's see how it handles this.
04:04.620 --> 04:13.110
So what you'll see here is that it creates code in what it's called an artifact as a separate piece
04:13.110 --> 04:14.970
of code over on the right.
04:15.150 --> 04:20.220
Uh, and it then has produced quite a lot of code here.
04:20.220 --> 04:26.150
I have to say, but you'll see that it's got client, which is what we called open AI and code chat
04:26.360 --> 04:32.300
completions dot create and that the result is response dot choices, zero dot message content.
04:32.330 --> 04:35.630
Hopefully that's that's a little bit familiar to you since we did that last time.
04:35.630 --> 04:37.160
It's put it into a class.
04:37.160 --> 04:38.690
It's got some examples.
04:38.690 --> 04:45.050
And so it's written this really nicely in this thing that's called an artifact, which is it's not not
04:45.050 --> 04:47.210
quite the same as the way that canvas works with GPT four.
04:47.210 --> 04:53.120
It's a bit different, but but it allows you to see this this file, this artifact, you can then publish
04:53.120 --> 04:56.060
it to share it with other people or download it and so on.
04:56.060 --> 05:02.000
So using Claude with artifacts somewhat similar to to to canvases.
05:02.000 --> 05:04.220
And it gives you this very powerful way to do it.
05:04.220 --> 05:09.620
And as you interact it will produce more different artifacts rather than changing this one.
05:09.650 --> 05:14.030
And it's sometimes useful to have that experience too, because you can tie back and see all the different
05:14.030 --> 05:17.150
versions of the file as you worked together.
05:17.150 --> 05:19.760
So that gives you a little tour of Claude.
05:19.760 --> 05:26.390
What it's good at its sense of alignment and safety, and also the way that you can create artifacts.