From the course: Introduction to Large Language Models

Unlock the full course today

Join today to access over 24,900 courses taught by industry experts.

Open LLMs

Open LLMs

From the course: Introduction to Large Language Models

Start my 1-month free trial Buy for my team

Open LLMs

“

- [Narrator] We've looked at models that have all come from big tech firms like Google and OpenAI. But what about open community models? Now, although OpenAI made GPT-3 available via an API or the Playground, which is what we've seen so far, no access was given to the actual weight of the model. So if you had access to the weight of the model, you can tweak and experiment with the model to create new variations that might be better suited for a specific task. For example, you can try and create smaller versions of the model. Meta released OPT or Open Pre-trained Transformers. This is a couple of decode-only pre-trained transformers ranging from 125 million to 66 billion parameters which they shared with anyone. And interested researchers could also apply for access to the 175 billion parameter models. This effectively gave researchers access to a large language model that was very similar to GPT-3. The Meta team also…

Contents