And now let's move to Claude from anthropic, my favorite model and typically the favorite model of
most data scientists.
The most recent version, Claude 3.5 Sonnet New, that came out in October, is currently leading in
most benchmarks, showing that it is right now probably the strongest LLM on the planet.
Let's start off with a difficult question for Claude.
What does it feel like to be jealous?
See how it answers this?
And what you'll find is that we'll get back something that is thoughtful and interesting and remarkably
insightful.
Uh, from my understanding, it's hinting at the fact that it doesn't experience.
Jealousy itself often manifests as fear, insecurity, and desire a tight knot in your stomach.
So it gives it like a almost a biological sort of sense to it and a burning sensation in your chest.
Racing thoughts, uh, a sense of inadequacy or being threatened.
It's really interesting.
Compelling answer.
No problem at all with a difficult question like that.
Okay.
Let's ask how many times does the letter A appear in this sentence?
See how it handles that?
Let me count it.
Gets it wrong.
Hope for humanity still.
Uh, so, uh, Claude counts five times and gives an incorrect explanation for that again.
We'll find out later why these sorts of questions are harder.
And so, so far it's zero.
One preview is the only model that was able to handle that.
All right.
Let's ask it a tricky question compared with other frontier llms what kinds of questions do you best
at answering and what do you find most challenging?
Which others compare with you?
So what you get from Claude here is interesting.
It pushes back and this ties to to anthropic strong views about the need for safety and alignment in
models.
Um, it says I aim to be direct and transparent whilst respecting my ethics.
I am not comfortable making comparative claims versus other AI models.
What it will then do is tell you about its own strengths and weaknesses.
It's a very interesting kind of answer.
By comparison, if we go back to GPT and ask it the same question, we'll see how GPT responds and what
you'll find there is it doesn't have the same kind of qualms about about responding.
You'll get something very clear about where it's strongest, the challenges and then complementary.
So ChatGPT with web browsing and code interpreter, which I think is its name for the canvas piece,
Claude.
It gives interestingly as a comparison point and then it says Barred by Google and it should really
say Gemini.
But it's interesting that it that it does give the main competitors and it talks about some of the differences.
And look at this.
Fascinatingly, it does mention that Claude has more thoughtful responses on broader socio ethical considerations,
which could complement my technical focus.
Fascinating that not only does GPT four have that kind of ability to compare, but it gives really well
considered answers to.
So I thought that was particularly interesting.
All right.
Anyway, that gives us our quick tour of some of the features of, uh, Claude.
It's also worth saying that Claude is really effective at coding and working with you on code.
Let's ask it for, uh, to give an example, let's say please, uh, give me some example code that
uses, uh, that, uh, some example Python that, uh, uses the open AI API.
Let's see how it handles this.
So what you'll see here is that it creates code in what it's called an artifact as a separate piece
of code over on the right.
Uh, and it then has produced quite a lot of code here.
I have to say, but you'll see that it's got client, which is what we called open AI and code chat
completions dot create and that the result is response dot choices, zero dot message content.
Hopefully that's that's a little bit familiar to you since we did that last time.
It's put it into a class.
It's got some examples.
And so it's written this really nicely in this thing that's called an artifact, which is it's not not
quite the same as the way that canvas works with GPT four.
It's a bit different, but but it allows you to see this this file, this artifact, you can then publish
it to share it with other people or download it and so on.
So using Claude with artifacts somewhat similar to to to canvases.
And it gives you this very powerful way to do it.
And as you interact it will produce more different artifacts rather than changing this one.
And it's sometimes useful to have that experience too, because you can tie back and see all the different
versions of the file as you worked together.
So that gives you a little tour of Claude.
What it's good at its sense of alignment and safety, and also the way that you can create artifacts.