NVIDIA Generative AI LLMs Associate Certification
Introductory course for NVIDIA Generative AI LLMs Associate certification covering LLM fundamentals, retrieval augmented generation, vector search, prompt engineering, deployment, trustworthy AI, and hands on labs.
Introduction
Core Machine Learning and AI Knowledge
- RAG Architecture Components
- Python Package for Text Vectorization
- LLM Evaluation Metric for Factual Accuracy
- Selecting Embedding Models for RAG
- Primary Advantage of RAG vs Standalone LLM
- Purpose of Few Shot Examples in Prompting
- Ensuring Chatbot Uses Specific Documentation
- Preparing Datasets for RAG Systems
- Understanding Attention Mechanism in Transformers
- Prompt Engineering for Text Summarization
- Balancing Metrics for LLM Production Deployment
- Selecting Vector Databases for RAG
- Defining Foundation Models LLMs
- Advantage of LoRA vs Full Fine Tuning
- Python Package for Bag of Words Classification
Data Analysis
- Model Selection for Imbalanced Data Accuracy vs F1
- Visualizing Transformer Attention Weights
- Visualizing Demographic Bias in Training Data
- Evaluating Statistical Significance of Fine Tuning
- Visualizing Learned Concepts in LLM Representations
- Visualizing Correlations Between LLM Evaluation Metrics
- Visualizing Impact of Context Length on LLM Accuracy
Experimentation
- Evaluating LLM Quality Without Single Correct Answer
- Ensuring Validity in AB Testing LLM Prompts
- Rigorous Experimental Design for Zero Shot LLM Testing
- Reliable Methodology for Evaluating LLM Hallucinations
- Determining Optimal LLM Context Window Size
- Evaluating LLM Bias Across Demographic Groups
- Reliable Human Evaluation Protocol for LLM Outputs
- Robust Experimental Control for Measuring Fine Tuning Impact
- Isolating Impact of Training Dataset Size on LLM Performance
- Reliable Baseline for Evaluating LLM Task Performance
- Methodologically Sound Ablation Study Approach for LLMs
- Rigorous Statistical Comparison of Two LLM Models
Software Development
- Monitoring High Throughput LLM Production Performance
- Python Package for RAG Vector Database Implementation
- TensorRT Technique for Improving LLM Inference Latency
- Software Architecture for Variable LLM Workloads
- Ensuring Reliable Performance in Production LLM Deployments
- RAG Component for Determining Document Relevance
- Reducing LLM Memory Footprint During Deployment
- Effective Chunking Strategy for RAG Systems
- Python Library for Semantic Similarity Calculation LLM Eval
- Software Design Principle for Evolving LLM Applications
- Managing GPU Memory Constraints for LLMs in Python
- Failure Handling Pattern for High Availability LLM Deployment Python