From the course: AI Orchestration: Validation and User Feedback and Performance Metrics

Unlock this course with a free trial

Join today to access over 24,900 courses taught by industry experts.

BLEURT

BLEURT

From the course: AI Orchestration: Validation and User Feedback and Performance Metrics

Start my 1-month free trial Buy for my team

BLEURT

“

- [Instructor] We'll now move on to the BLEURT technique for model-based evaluation. BLEURT is a learning-based evaluation metric that leverages the power of the BERT model, where BERT stands for Bidirectional Encoder Representations from Transformers. This is a pre-trained language model, and can be used to assess text similarity with a deeper understanding of semantics. Unlike traditional models that rely on exact word matches, BLEURT considers both lexical and contextual alignment between generated text and reference text. Here is a summary of what BLEURT is. A learning based evaluation metric that leverages BERT, a pre-trained language model, to assess tech similarity with a deeper understanding of semantics. Unlike traditional metrics, BLEURT evaluates both lexical and contextual alignment. Lexical alignment, because it checks whether the words in the generated text and reference texts are similar, and contextual alignment, because it looks beyond just words and assesses if the…

Contents