From the course: AI Toolkit Essentials for Visual Studio Code
Join today to access over 24,900 courses taught by industry experts.
Testing your fine-tuned model - Visual Studio Code Tutorial
From the course: AI Toolkit Essentials for Visual Studio Code
Testing your fine-tuned model
- [Instructor] When the fine tuning process is over, we do have a way to test the models. And they also provide scripts that will show us the code needed to run the fine tune model in a Python environment. And we can find these scripts in the inference folder. And we'll close these up here. And here's the inference folder. There are scripts for two hosting environments that they give us, console and gradio. The console version is exactly as it sounds. It allows us to start a console command and it then allows us to send prompts and receive responses in the terminal. Unfortunately, both of these packages require some extra PIP installations to be made. And we're going to use gradio because it allows us to adjust some of the models parameters interactively. So the package we need to install is sse-starlette, and this package implements the server-side event standards and is used to send information to the browser without refreshing the page. And so we're going to go and install it now…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.