Introduction
Core Machine Learning and AI Knowledge
- RAG Architecture Components
- Python Package for Text Vectorization
- LLM Evaluation Metric for Factual Accuracy
- Selecting Embedding Models for RAG
- Primary Advantage of RAG vs Standalone LLM
- Purpose of Few Shot Examples in Prompting
- Ensuring Chatbot Uses Specific Documentation
- Preparing Datasets for RAG Systems
- Understanding Attention Mechanism in Transformers
- Prompt Engineering for Text Summarization
- Balancing Metrics for LLM Production Deployment
- Selecting Vector Databases for RAG
- Defining Foundation Models LLMs
- Advantage of LoRA vs Full Fine Tuning
- Python Package for Bag of Words Classification
Data Analysis
- Model Selection for Imbalanced Data Accuracy vs F1
- Visualizing Transformer Attention Weights
- Visualizing Demographic Bias in Training Data
- Evaluating Statistical Significance of Fine Tuning
- Visualizing Learned Concepts in LLM Representations
- Visualizing Correlations Between LLM Evaluation Metrics
- Visualizing Impact of Context Length on LLM Accuracy
Experimentation
- Evaluating LLM Quality Without Single Correct Answer
- Ensuring Validity in AB Testing LLM Prompts
- Rigorous Experimental Design for Zero Shot LLM Testing
- Reliable Methodology for Evaluating LLM Hallucinations
- Determining Optimal LLM Context Window Size
- Evaluating LLM Bias Across Demographic Groups
- Reliable Human Evaluation Protocol for LLM Outputs
- Robust Experimental Control for Measuring Fine Tuning Impact
- Isolating Impact of Training Dataset Size on LLM Performance
- Reliable Baseline for Evaluating LLM Task Performance
- Methodologically Sound Ablation Study Approach for LLMs
- Rigorous Statistical Comparison of Two LLM Models
Software Development
- Monitoring High Throughput LLM Production Performance
- Python Package for RAG Vector Database Implementation
- TensorRT Technique for Improving LLM Inference Latency
- Software Architecture for Variable LLM Workloads
- Ensuring Reliable Performance in Production LLM Deployments
- RAG Component for Determining Document Relevance
- Reducing LLM Memory Footprint During Deployment
- Effective Chunking Strategy for RAG Systems
- Python Library for Semantic Similarity Calculation LLM Eval
- Software Design Principle for Evolving LLM Applications
- Managing GPU Memory Constraints for LLMs in Python
- Failure Handling Pattern for High Availability LLM Deployment Python