> ## Documentation Index
> Fetch the complete documentation index at: https://notes.kodekloud.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Alerts

> Guidance on migrating, testing, and managing monitoring alerts to ensure telemetry availability, reduce noise, and validate notifications when moving to Datadog or replacing legacy alerting systems.

Alerts make monitoring manageable by continuously evaluating telemetry (metrics, logs, traces) and notifying the right teams when predefined conditions are met. Proper alerting reduces mean time to detection and enables controlled responses instead of frantic firefights.

What alerts do, in short:

* Continuously evaluate telemetry.
* Fire when a configured condition or threshold is met.
* Deliver notifications to your teams or channels so they can take action.

A concrete example

Your company processes payroll for multiple businesses. Payments execute at 1 a.m. on the last day of every month. If payroll jobs fail or are delayed, employees will likely contact support en masse. Without proactive alerting, you’ll wake up to dozens (or hundreds) of complaints and have to scramble to diagnose and remediate.

An alert that detects failed or delayed payroll jobs would notify the on-call team immediately, enabling a controlled investigation and remediation before employee outreach escalates.

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/FlhfcjbwznwHQ2c3/images/Migrating-to-Datadog/Migration-What-should-you-look-into/Alerts/person-desk-computer-bug-icons-alerts.jpg?fit=max&auto=format&n=FlhfcjbwznwHQ2c3&q=85&s=e76d6ded7ad7fd5eb2aa6160db766418" alt="The image shows a person sitting at a desk, working on a computer displaying bug icons, with a caption about alerts handling issues." width="1920" height="1080" data-path="images/Migrating-to-Datadog/Migration-What-should-you-look-into/Alerts/person-desk-computer-bug-icons-alerts.jpg" />
</Frame>

Use alerts to catch performance regressions early

Alerts aren’t only for failures. Track application latency, error rates, throughput, or resource saturation so you can detect regressions before customers notice. For example, a latency alert that triggers when p95 response time increases beyond a threshold lets you investigate before SLA breaches occur.

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/FlhfcjbwznwHQ2c3/images/Migrating-to-Datadog/Migration-What-should-you-look-into/Alerts/computer-issues-latency-alerts-discussion.jpg?fit=max&auto=format&n=FlhfcjbwznwHQ2c3&q=85&s=a16020113d4a97ce7f6fe5b61ef7395b" alt="The image illustrates a scenario where two people are discussing issues with a computer, emphasizing the importance of alerts in identifying latency problems before customers complain." width="1920" height="1080" data-path="images/Migrating-to-Datadog/Migration-What-should-you-look-into/Alerts/computer-issues-latency-alerts-discussion.jpg" />
</Frame>

Alert migration: a recommended sequence

When migrating alerts into a new monitoring system (for example, migrating to Datadog), follow a repeatable, low-risk sequence:

1. Ensure required data is available
   * Confirm collection of metrics, logs, and traces for the services you want to monitor.
   * Request any necessary changes to the Datadog Agent configuration from your DevOps/infra team: [https://docs.datadoghq.com/agent/](https://docs.datadoghq.com/agent/)

2. Confirm access to the monitoring console
   * Verify your team has permissions to create and manage monitors in Datadog: [https://docs.datadoghq.com/monitors/](https://docs.datadoghq.com/monitors/)

3. Validate notification targets
   * Ensure recipients (email groups, PagerDuty services, Slack channels, Microsoft Teams, etc.) are configured and reachable.

4. Test alerts
   * Simulate conditions or temporarily lower thresholds to confirm monitors fire and notifications are delivered.

5. Deactivate legacy alerts
   * After Datadog monitors are validated in production, disable the old alerts in Grafana, Alertmanager, Dynatrace, or other tools you’re replacing.

<Frame>
  <img src="https://mintcdn.com/kodekloud-c4ac6d9a/FlhfcjbwznwHQ2c3/images/Migrating-to-Datadog/Migration-What-should-you-look-into/Alerts/alert-migration-flowchart-steps.jpg?fit=max&auto=format&n=FlhfcjbwznwHQ2c3&q=85&s=184d13c8557b6d8411143a7e6ac7f3e4" alt="The image shows a flowchart outlining the steps for alert migration, which include listing data, accessing Datadog, verifying targets, testing alert rules, and deactivating legacy alerts." width="1920" height="1080" data-path="images/Migrating-to-Datadog/Migration-What-should-you-look-into/Alerts/alert-migration-flowchart-steps.jpg" />
</Frame>

Migration checklist (summary)

| Step                     | Purpose                                          | Example / Link                                                                                 |
| ------------------------ | ------------------------------------------------ | ---------------------------------------------------------------------------------------------- |
| Ensure telemetry         | Make sure metrics/logs/traces exist for services | Datadog Agent docs: [https://docs.datadoghq.com/agent/](https://docs.datadoghq.com/agent/)     |
| Console access           | Grant permissions to create/manage monitors      | Datadog Monitors: [https://docs.datadoghq.com/monitors/](https://docs.datadoghq.com/monitors/) |
| Notification targets     | Validate recipients and routing                  | PagerDuty, Slack, Teams, email groups                                                          |
| Test alerts              | Verify firing and delivery                       | Simulate incidents or lower thresholds                                                         |
| Deactivate legacy alerts | Avoid duplicate notifications once validated     | Grafana, Alertmanager, Dynatrace                                                               |

Common alert notification integrations

* Datadog mobile app
* Jira
* PagerDuty
* Slack
* Microsoft Teams
* ServiceNow

Best practices and tips

<Callout icon="lightbulb" color="#1CB2FE">
  Tune thresholds and use multi-condition monitors to reduce noise. Prefer cloud-native integrations (PagerDuty, Slack) for reliable on-call routing, and run repeatable tests for each alert before decommissioning legacy monitors.
</Callout>

When you disable legacy alerts, keep them active until you have validated the new monitors in production and verified notifications reach the intended recipients. Accidentally deactivating early can blind you to outages.

<Callout icon="warning" color="#FF6B6B">
  When disabling legacy alerts, keep them enabled until Datadog monitors are fully validated in production. Accidentally deactivating alerts too early can leave you blind to outages.
</Callout>

Further reading and references

* Datadog Agent: [https://docs.datadoghq.com/agent/](https://docs.datadoghq.com/agent/)
* Datadog Monitors: [https://docs.datadoghq.com/monitors/](https://docs.datadoghq.com/monitors/)
* Grafana: [https://grafana.com/](https://grafana.com/)
* Prometheus Alertmanager: [https://prometheus.io/docs/alerting/latest/alertmanager/](https://prometheus.io/docs/alerting/latest/alertmanager/)
* Dynatrace: [https://www.dynatrace.com/](https://www.dynatrace.com/)
* PagerDuty: [https://www.pagerduty.com/](https://www.pagerduty.com/)
* Slack: [https://slack.com/](https://slack.com/)
* Microsoft Teams: [https://www.microsoft.com/en-us/microsoft-teams/group-chat-software](https://www.microsoft.com/en-us/microsoft-teams/group-chat-software)
* ServiceNow: [https://www.servicenow.com/](https://www.servicenow.com/)

That’s it for this lesson—use the migration checklist, validate thoroughly, and iterate to keep alerting effective and actionable.

<CardGroup>
  <Card title="Watch Video" icon="video" cta="Learn more" href="https://learn.kodekloud.com/user/courses/migrating-to-datadog/module/d7aaa833-22da-4f94-af5c-5d196f04ab31/lesson/584aa954-f0c2-4747-a570-8204b915d0ab" />
</CardGroup>
