From the course: Introduction to Large Language Models
Unlock the full course today
Join today to access over 24,900 courses taught by industry experts.
BERT
From the course: Introduction to Large Language Models
BERT
- [Narrator] If you're like me, the only time you watch dressage is every four years during the Summer Olympics. Now, whenever I've used Google search in the past, I've often only entered keywords such as dressage goal. It turns out that Google search uses BERT. BERT, which stands for bi-directional encoder representations from transformers is a large language model that was developed by Google. BERT is based on the transformer architecture and composed of transformer in coder layers which we looked at in a previous video. Since Google uses BERT, we get better language understanding. This means I don't just have to use keywords, but I can enter a question like, "What's the main objective of dressage?" And the answer back from Google doesn't just give me the most relevant page, but the answer to my question is highlighted. So the main objective of dressage is improving and facilitating the horse's performance of normal…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
(Locked)
BERT3m 16s
-
(Locked)
Scaling laws3m 30s
-
(Locked)
GPT-37m 41s
-
(Locked)
Chinchilla7m 54s
-
(Locked)
PaLM and PaLM 23m 59s
-
ChatGPT and GPT-45m 47s
-
(Locked)
Open LLMs5m 40s
-
(Locked)
Comparing LLMs3m 35s
-
(Locked)
GitHub Models: Comparing LLMs2m 52s
-
(Locked)
Accessing large language models using an API6m 25s
-
(Locked)
LLM trends4m 6s
-
(Locked)
-