Introduction to Vector Databases and Generative AI
- Course Introduction
- Vector Databases The Definition
- Demo Ask Warren Anything You Want
- Vectors Made Simple
- Demo Visualization of Vectors in vectorDB
- Role of Vector Databases in GenAI
- Airline Chatbot Vector Database
- Vector Databases vs Relational and NoSQL Databases
- Demo Setting up a Vector Database
Vector Database Foundations
- What Does a Vector Database Store
- Vector Embeddings Numerical Representations of Data
- Querying Normal Database
- Querying Vector Database
- Demo Difference in querying a normal DB vs vectorDB
- Vector Quering Methods
- When to Use Which Query Method Part 1
- When to Use Which Query Method Part 2
From Data to Vectors: The Embedding Layer
- From Data to Vectors The Embedding Layer
- Embedding Models
- Text Embedding Models
- Demo Text Embedding with sentence transformer
- Image Embedding Models
- Demo Image Embedding
- Audio Embedding Models
- Video Embedding Models
- Choosing and Optimizing Embedding Models
Vector Similarity Explained
- Three Ways to Measure Similarity
- Cosine Similarity
- Euclidean Distance
- Dot Product Similarity
- Demo Vector Search Metrics in 2D
- Comparing Cosine Dot Product and Euclidean Similarity
- Fruit Emedding Similarity Metrics in Action
- How Similarity Results Can Differ
- Demo Setting up Vectors for Fruits
- Demo Query a New Fruit Across 3 Searches
Building Vector Storage on AWS S3
- S3 Vector Buckets
- Demo Creating an S3 Vector Bucket
- Demo Creating an IAM policy for S3 Vector Buckets
- Key Features of S3 Vector Buckets
- Demo Accessing the S3 Vector Buckets
- Demo Embedding and Accessing Vectors from S3 Vector Buckets
- S3 Vector Buckets vs Standard S3 Buckets
- S3 Vector Buckets vs Vector Databases
Vector Database Landscape
- Vector Database Landscape
- Pinecone Vector Database
- Weaviate Vector Database
- Milvus Vector Database
- Choosing Your Vector Database
- Vector Database Feature Comparison
- VectorDB Benchmark
Vector Database Internals
- Vector Database Internals
- Indexing in Vector Database
- Demo Understanding Indexing in Vector Database
- HNSW Multi Layered Graph Structure
- HNSW Construction and Adoption
- Quantization
- Real World Example of Quantization
- Demo Understand Binary Quantization
- Index Maintenance
- Strategy 1 Write First Index Later
- Strategy 2 Merge Small Pieces
- Strategy 3 Rebuild Sometimes
- Applying Index Maintenance Customer Care Chat Data