> ## Documentation Index
> Fetch the complete documentation index at: https://notes.kodekloud.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Natural Language Processing Concepts Introduction

> Introduction to natural language processing concepts, tasks, applications, and examples including key phrase extraction, named entity recognition, text classification, and summarization

Natural language processing (NLP) is a core area of artificial intelligence that enables computers to read, interpret, and generate human language. Every day we use language to ask questions, give feedback, and describe problems; NLP provides the techniques and models that let software understand those words, extract structured information, analyze meaning, and generate useful responses. In short, NLP is the bridge between human language and computer systems.

This article introduces common NLP tasks, real-world applications, and a concrete example showing how multiple NLP capabilities can be applied to the same text.

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/4HrJDvvNdgcJzo1X/images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-introduction-human-language-functions.jpg?fit=max&auto=format&n=4HrJDvvNdgcJzo1X&q=85&s=b96569e0fd04556b679eee3c3dd467df" alt="A presentation slide titled &#x22;Natural Language Processing (NLP) – Introduction&#x22; showing speech bubbles labeled &#x22;Human Language&#x22; feeding into a central &#x22;NLP&#x22; circle. Arrows point to a list of NLP functions: Understand, Interpret, Analyze, and Generate." width="1920" height="1080" data-path="images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-introduction-human-language-functions.jpg" />
</Frame>

## Four common NLP tasks

1. Key phrase extraction\
   Identify the most important words or short phrases in text. Key phrases act as concise labels summarizing a document’s main concepts — useful for tagging, indexing, and speeding search across large document collections.

2. Named entity recognition (NER)\
   Detect and categorize entities such as people, organizations, locations, dates, or products. NER converts unstructured text into structured entity labels, enabling indexing and entity-based queries.

3. Text classification\
   Assign one or more predefined labels to a text sample. Common uses include spam detection, topic tagging, and sentiment analysis (positive/negative/neutral). Classification helps automate routing and filtering at scale.

4. Text summarization\
   Produce a shorter version of a longer document that preserves the essential facts and intent. Summaries help readers quickly grasp long documents, support triage, and reduce reading time.

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/4HrJDvvNdgcJzo1X/images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-intro-keyphrase-ner-classify-summarize.jpg?fit=max&auto=format&n=4HrJDvvNdgcJzo1X&q=85&s=cde7c963d596ac1f16f05d443d7fcc56" alt="A slide titled &#x22;Natural Language Processing (NLP) – Introduction.&#x22; It lists four common NLP tasks—Key Phrase Extraction, Named Entity Recognition, Text Classification, and Text Summarization—with short descriptions and icons." width="1920" height="1080" data-path="images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-intro-keyphrase-ner-classify-summarize.jpg" />
</Frame>

### Quick reference table

| Task | Purpose | Example |
| - | - | - |
| Key phrase extraction | Surface main topics and concepts | Extract `"wireless keyboard"`, `"battery life"` from a product review |
| Named entity recognition (NER) | Identify and label entities (Person, Date, Org, etc.) | Label `Emma` as `Person` and `March 5th` as `Date` |
| Text classification | Assign category labels like sentiment or topic | Classify a review as `Positive` or `Negative` |
| Text summarization | Produce a concise summary preserving key facts | Summarize a long support ticket into a one-line issue description |

## Common real-world use cases

* Document indexing and knowledge discovery\
  Extract terms and concepts from large repositories to improve search relevance and surface related content.

* PII detection and redaction\
  Detect personally identifiable information (PII) such as names, phone numbers, emails, credit card numbers, and Social Security numbers for masking or removal before sharing documents.

<Callout icon="warning" color="#FF6B6B">
  When using PII detection and redaction, be aware of privacy laws and organizational policies. Redaction decisions should be verified and logged to meet compliance requirements.
</Callout>

* Intent recognition for chatbots and virtual assistants\
  Detect user intent (e.g., “reset my password”) to route requests or trigger automated workflows.

* Spam and phishing detection\
  Analyze language patterns to flag suspicious or malicious emails and messages.

* Social media monitoring and sentiment analysis\
  Aggregate sentiment across thousands of comments to detect trends and public perception.

* Automatic categorization of content\
  Group customer feedback, support tickets, and articles into categories like billing, support, delivery, or product quality for faster triage.

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/4HrJDvvNdgcJzo1X/images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-introduction-use-cases.jpg?fit=max&auto=format&n=4HrJDvvNdgcJzo1X&q=85&s=935a7300d76f8679b6153e23548dd9d0" alt="A presentation slide titled &#x22;Natural Language Processing (NLP) – Introduction&#x22; showing common use cases. It lists examples like document indexing, PII detection/redaction, intent recognition for chatbots, email spam/phishing detection, social media sentiment monitoring, and automatic content categorization." width="1920" height="1080" data-path="images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-introduction-use-cases.jpg" />
</Frame>

NLP goes beyond chatbots — it is useful wherever software must understand, organize, search, or analyze human language.

## Concrete example: applying multiple NLP capabilities to the same text

Consider this passage:
"Emma ordered a wireless keyboard from an online store on March 5th. The package arrived two days late, but the product quality was excellent, and customer support quickly resolved the delivery issue. Overall, she was happy with the purchase."

Key phrase extraction\
An NLP system highlights the main topics: "wireless keyboard," "online store," "product quality," "customer support," and "delivery issue." These phrases succinctly represent the passage’s core subjects.

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/4HrJDvvNdgcJzo1X/images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-keyphrase-extraction-wireless-keyboard.jpg?fit=max&auto=format&n=4HrJDvvNdgcJzo1X&q=85&s=8d9521a8d5df40061ea33c0c2e7a1cc1" alt="A slide titled &#x22;Natural Language Processing (NLP) – Introduction&#x22; showing an example of key phrase extraction from a short text about Emma ordering a wireless keyboard. Highlighted key phrases include &#x22;wireless keyboard,&#x22; &#x22;online store,&#x22; &#x22;product quality,&#x22; &#x22;customer support,&#x22; and &#x22;delivery issue.&#x22;" width="1920" height="1080" data-path="images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-keyphrase-extraction-wireless-keyboard.jpg" />
</Frame>

Named entity recognition (NER)\
NER extracts named items and their types. From the passage, a model would likely identify `Emma` as a Person and `March 5th` as a Date. It may also label `wireless keyboard` as a Product or `online store` as an Organization depending on the model’s taxonomy.

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/4HrJDvvNdgcJzo1X/images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-ner-emma-march-5.jpg?fit=max&auto=format&n=4HrJDvvNdgcJzo1X&q=85&s=0731a926963075498fc49b4399e667e9" alt="A presentation slide titled &#x22;Natural Language Processing (NLP) – Introduction&#x22; showing a named-entity-recognition example sentence about Emma ordering a wireless keyboard on March 5th. It highlights the extracted entities &#x22;Emma&#x22; (Person) and &#x22;March 5th&#x22; (Date)." width="1920" height="1080" data-path="images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-ner-emma-march-5.jpg" />
</Frame>

Text classification (sentiment analysis)\
Classification looks at the entire passage to assign a label. Although there’s a delivery delay (negative event), the excellent product quality and effective customer support produce a positive overall sentiment. Sentiment analysis assesses context across all sentences rather than individual phrases.

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/4HrJDvvNdgcJzo1X/images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-intro-text-classification-keyboard-review.jpg?fit=max&auto=format&n=4HrJDvvNdgcJzo1X&q=85&s=1b69ca40aef4b0e483af972d244d36a9" alt="A slide titled &#x22;Natural Language Processing (NLP) – Introduction&#x22; showing tasks like key phrase extraction, named entity recognition, text classification (highlighted), and text summarization. A sample customer review about a wireless keyboard is displayed in a textbox with the sentiment labeled &#x22;Positive&#x22; on a green badge." width="1920" height="1080" data-path="images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-intro-text-classification-keyboard-review.jpg" />
</Frame>

Text summarization\
Summarization condenses the passage while preserving the essential facts: the package was delayed but product quality and support were excellent, leading to an overall positive experience. The summary reduces reading time but keeps the important points.

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/4HrJDvvNdgcJzo1X/images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-intro-keyphrase-ner-summary.jpg?fit=max&auto=format&n=4HrJDvvNdgcJzo1X&q=85&s=bf8a83f144d9cd2a2aba1a4ed50cb0cf" alt="A presentation slide titled &#x22;Natural Language Processing (NLP) – Introduction&#x22; listing steps like key phrase extraction, named entity recognition, text classification, and highlighted text summarization. The right side shows a sample about Emma’s delayed wireless keyboard delivery and a summary noting the good product quality and responsive customer support." width="1920" height="1080" data-path="images/AI-901-Microsoft-Azure-AI-Fundamentals/Getting-Started-With-Text-Analysis/Natural-Language-Processing-Concepts-Introduction/nlp-intro-keyphrase-ner-summary.jpg" />
</Frame>

## Recap

* Key phrase extraction surfaces the most important concepts for indexing and discovery.
* Named entity recognition identifies specific entities and their types for structured indexing.
* Text classification assigns categories such as sentiment, topic, or spam.
* Text summarization produces concise versions that preserve essential information.

<Callout icon="lightbulb" color="#1CB2FE">
  Choose the NLP capability (or combination of capabilities) that matches your business goal: indexing/search, compliance (PII), automation (intent or routing), or customer insights (sentiment/summarization).
</Callout>

These core NLP capabilities power practical language-processing solutions and are available through services such as [Azure AI Language](https://learn.microsoft.com/azure/ai-services/language/) and other AI platforms. With these fundamentals, you can begin designing pipelines to apply NLP to real datasets and production applications.

<CardGroup>
  <Card title="Watch Video" icon="video" cta="Learn more" href="https://learn.kodekloud.com/user/courses/ai-901-microsoft-azure-ai-fundamentals/module/623cf693-98db-46bd-b36b-b9f1d8ce4287/lesson/597fb749-921e-4100-b84b-3373377fac95" />
</CardGroup>


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.