From the course: AWS Certified AI Practitioner (AIF-C01) Cert Prep

Unlock this course with a free trial

Join today to access over 24,900 courses taught by industry experts.

Foundation model fine-tuning

Foundation model fine-tuning - Amazon Web Services (AWS) Tutorial

From the course: AWS Certified AI Practitioner (AIF-C01) Cert Prep

Start my 1-month free trial Buy for my team

Foundation model fine-tuning

“

- There are different ways to execute fine-tuning against an existing foundation model. And so let's take a look at some of these methods. We're going to look at instruction tuning, adapting models for specific domains, transfer learning and continuous pre-training. So let's start with instruction tuning. What exactly is this? This is just retraining a model on the data sets of prompts and desired outputs. So this would require a document, usually JSON or some structured format where you have a prompt and then the output that you want the model to return. And you do this for a lot of different scenarios and you end up training the model that way. And this is going to help to improve the model's ability to understand and execute commands. And it's really effective for interactive applications. And so let's take a look at an example. So when Amazon was putting together new capabilities for Alexa, they use instruction tuning and they train the model on a data set that is made up of…

Contents