> ## Documentation Index
> Fetch the complete documentation index at: https://notes.kodekloud.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Module Introduction

> Introductory module on text analysis and NLP covering preprocessing, NER, PII detection, sentiment, Azure AI Language SDK and Microsoft Foundry integration for building automated analysis workflows

Welcome to this module: Getting Started with Text Analysis.

Earlier lessons covered generative AI topics such as deploying models, experimenting with them in the Microsoft Foundry Playground, and learning how prompts and model parameters shape outputs. In this module we pivot from generation to understanding: we will analyze text to extract structure and meaning.

Every day, organizations process vast amounts of text — customer reviews, support tickets, emails, survey responses, social media posts, and long-form documents. Computers do not automatically interpret human language the way people do. Natural language processing (NLP) provides the methods and tools to bridge that gap, turning unstructured text into structured signals you can act on.

In this module we will:

* Review NLP fundamentals and common business use cases (search, classification, extraction, summarization).
* Describe key stages of text preprocessing and why each step is important for analysis.
* Compare traditional text analysis techniques (rule-based or statistical) with modern large language models and foundation models.

Traditional approaches often rely on hand-engineered features, lexicons, or statistical models to detect patterns in text. Modern language models learn language patterns from large corpora and can generalize across many language tasks, enabling richer and more flexible analysis.

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/4HrJDvvNdgcJzo1X/images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Module-Introduction/nlp-learning-objectives-preprocessing-models.jpg?fit=max&auto=format&n=4HrJDvvNdgcJzo1X&q=85&s=3aa43ffaccb8a0befe13a1e446bc1083" alt="A presentation slide titled &#x22;Learning Objectives&#x22; with three numbered items. They list goals to explain core concepts of Natural Language Processing (NLP) and business uses, describe text preprocessing stages for AI, and differentiate traditional text analysis techniques from modern language models." width="1920" height="1080" data-path="images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Module-Introduction/nlp-learning-objectives-preprocessing-models.jpg" />
</Frame>

This module combines theory with hands-on examples using Microsoft Foundry and Azure AI services. You will see multiple approaches: using general-purpose foundation models or specialized Azure AI Language models for tasks such as language detection, named entity recognition (NER), and PII detection.

We focus on the Azure AI Language SDK because it provides a developer-friendly, programmatic way to send text to Azure’s language service and receive structured, actionable results. Rather than manually inspecting text, applications can call the SDK to run detection, extraction, and classification tasks at scale.

Key SDK capabilities covered in this module:

* Language detection
* Named entity recognition (NER)
* PII detection and redaction
* Sentiment analysis and key-phrase extraction
* Integration patterns for agents and automation

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/4HrJDvvNdgcJzo1X/images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Module-Introduction/learning-objectives-foundry-azure-ai-sdk.jpg?fit=max&auto=format&n=4HrJDvvNdgcJzo1X&q=85&s=dedf1f6f92bea5f478f71d5cac88e431" alt="A presentation slide titled &#x22;Learning Objectives&#x22; with a blue gradient left panel and three numbered objectives on the right. The objectives describe using Microsoft Foundry and Azure AI Language (foundation models, SDK features like language detection, NER, PII detection, and agent integration)." width="1920" height="1080" data-path="images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Module-Introduction/learning-objectives-foundry-azure-ai-sdk.jpg" />
</Frame>

By the end of this module you will understand:

* Core concepts behind text analysis and NLP workflows.
* How to prepare text (tokenization, normalization, cleaning) so models and pipelines perform reliably.
* How to call Azure AI Language from code using the SDK and interpret structured results.
* How to embed language capabilities into Microsoft Foundry Agents to include analysis steps in automated workflows.

<Callout icon="lightbulb" color="#1CB2FE">
  This module assumes a basic familiarity with cloud concepts. To follow the hands-on examples, you will need an Azure subscription and permissions to create or use Azure AI Language resources. For SDK references and setup guidance, see the Azure AI Language documentation linked in the Resources section below.
</Callout>

Module at-a-glance

| Topic | What you’ll learn | Typical business use cases |
| - | -: | - |
| NLP fundamentals | Definitions, tokenization, embeddings, modern model families | Search relevance, document classification |
| Text preprocessing | Normalization, tokenization, stopword handling, lemmatization | Improve model accuracy, reduce noise |
| Analysis techniques | Rule-based vs statistical vs LLMs | NER, PII detection, sentiment analysis |
| Azure AI Language SDK | How to call detection, extraction, and classification APIs | Automated pipelines, application integration |
| Agent integration | Connecting analysis to Foundry Agents and tool chains | End-to-end workflows that analyze and act on text |

Recommended next steps

* Read the Azure AI Language SDK quickstart and setup your credentials.
* Try a small sample: send a short text to the SDK for language detection and NER to compare results.
* Follow the module’s hands-on lab where we integrate Azure AI Language calls into a Foundry Agent chain.

References and further reading

* Azure AI Language documentation: [https://learn.microsoft.com/azure/ai-services/language/](https://learn.microsoft.com/azure/ai-services/language/)
* Introduction to Natural Language Processing: [https://en.wikipedia.org/wiki/Natural\_language\_processing](https://en.wikipedia.org/wiki/Natural_language_processing)
* Microsoft Foundry documentation: [https://learn.microsoft.com/microsoft-foundry/](https://learn.microsoft.com/microsoft-foundry/) (refer to your internal Foundry docs for agent integration details)

<Callout icon="warning" color="#FF6B6B">
  When working with PII or sensitive data, ensure compliance with your organization’s privacy policies and Azure data protection guidelines. Use data minimization, encryption, and access controls as required.
</Callout>

<CardGroup>
  <Card title="Watch Video" icon="video" cta="Learn more" href="https://learn.kodekloud.com/user/courses/ai-901-microsoft-azure-ai-fundamentals/module/623cf693-98db-46bd-b36b-b9f1d8ce4287/lesson/b4126550-d195-4dd3-b4b5-4568f73a3235" />
</CardGroup>


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.