From the course: Advanced RAG Applications with Vector Databases
Unlock the full course today
Join today to access over 24,900 courses taught by industry experts.
Embedding examples
From the course: Advanced RAG Applications with Vector Databases
Embedding examples
- [Presenter] Let's look at some examples of how you can embed data. There are many ways to embed and there are many things that you can embed. The three primary methods we'll cover for embedding in this section are the basic embeddings, small to big, and big to small, and we'll also briefly discuss non-English examples. The most basic method of embedding is to just straight up embed the chunk. Sometimes this works for your most basic tasks. However, when it comes to advanced RAG use cases and putting things into production, you're going to need something a little more involved. Small to big is a term coined by former LlamaIndex head of TypeScript and Partnerships, Yi Ding, and he coined it at one of my first events in San Francisco. The idea behind small to big is that you embed a sentence, but you store the whole paragraph as text. Why would you do this? Well, it's good for increased context. Some texts have very short sentences, and it's helpful to retrieve not just the sentence or…
Contents
-
-
-
(Locked)
Introduction to preprocessing for RAG4m 57s
-
Chunking considerations5m 12s
-
(Locked)
Chunking examples4m 32s
-
(Locked)
Introduction to embeddings9m 50s
-
(Locked)
Embedding examples2m 57s
-
(Locked)
Metadata3m 12s
-
(Locked)
Demo: Chunking2m 32s
-
(Locked)
Demo: Metadata1m 23s
-
(Locked)
Demo: Embed and store2m
-
(Locked)
Demo: Querying1m 8s
-
(Locked)
Demo: Adding the LLM2m 1s
-
(Locked)
Challenge: Cite your document sources47s
-
(Locked)
Solution: Cite your document sources59s
-
(Locked)
Challenge: Change the chunk size44s
-
(Locked)
Solution: Change the chunk size55s
-
(Locked)
-
-
-