Skip to main content
All right — let’s move into our next section: Designing for Security. In this lesson we continue the conversation about security and storage, focusing on a class of services I call “storage manipulation.” These services do more than just store files — they replicate, manage, or transform data. Typical examples are backup orchestration, replication/disaster recovery, and gateway appliances that bridge on‑premises systems with AWS storage. We’ll cover each major service type, how it works, and the practical security controls you should consider when protecting data in these workflows.

AWS Backup

AWS Backup is a managed orchestration service that centralizes and automates backups across many AWS resources. A common pattern is to snapshot or backup resources (for example, EBS volumes), store them in an encrypted backup vault, and then copy those encrypted backups to another account and/or region for resilience. In cross-account, cross-region copy workflows you typically have:
  • Encrypted snapshots or volumes in the source account.
  • A customer-managed KMS key (CMK) protecting the source backups.
  • A backup vault in the source account with a cross-account copy job to a destination backup vault.
  • A destination CMK in the target account/region that re-encrypts the copied backups.
An AWS architecture diagram showing a cross-account, cross-region copy job that moves encrypted Amazon EBS snapshots from a source account/backup vault to a destination account/backup vault. It highlights use of customer-managed KMS keys (cmkSource and cmkTarget) for encryption.
Key backup security focus areas
  • Encrypt everything that goes into the backup vault. AWS Backup supports customer-managed KMS keys (CMKs) — choose the desired CMK in the backup plan/job encryption settings.
  • Beware of S3 default encryption semantics. AWS Backup can use a KMS CMK for backup encryption; the S3 default encryption option (SSE‑S3) uses Amazon S3–managed keys and does not invoke KMS.
  • Ensure KMS key policies and IAM policies grant the necessary permissions (Encrypt/Decrypt/Grant) to the backup service and any principals that need to restore.
  • Consider layered encryption if needed: encrypt data at the source, and then have AWS Backup re-encrypt the backup with a CMK. This double-encryption pattern can help meet stricter regulatory requirements.
When using customer-managed CMKs for backups, explicitly include AWS Backup (and any cross-account principals) in the CMK key policy. Without correct key policy permissions restores or cross-account copies will fail even if IAM permissions exist.
Question (example) A financial institution must ensure backups are encrypted using a specific customer-managed KMS key. What should they do?
  • Use AWS Backup’s encryption settings when creating the backup plan/job and select the required customer‑managed KMS CMK. Also ensure the CMK key policy grants AWS Backup and any required principals access.
AWS Backup supports two mechanisms to protect backups from deletion or modification for a retention period:
  • Vault Lock: applies to a single backup vault (analogous to S3 Object Lock with Governance and Compliance modes).
  • Legal Hold: can apply across multiple vaults/resources in AWS Backup to preserve backups for a compliance/legal preservation requirement.
When to use which:
  • Use Vault Lock to immutably lock contents of a single vault for a set retention policy.
  • Use Legal Hold when you must preserve a set of backups across multiple vaults or resources (for example, when a legal preservation notice spans many backups).
A screenshot of the AWS Backup "Create vault lock" configuration page showing options to choose a backup vault, select Governance or Compliance mode, and set minimum/maximum retention periods. The left-side text notes that AWS Backup Vault Lock offers Compliance and Governance options similar to S3.

Private connectivity to AWS Backup

For stricter privacy of both backup control plane and data plane traffic between your VPC and AWS Backup, use a VPC interface endpoint (AWS PrivateLink). Interface endpoints provision an ENI in your subnet so traffic remains on the AWS network and does not traverse the public internet.
Use a VPC interface endpoint (AWS PrivateLink) for AWS Backup to ensure backup traffic between your VPC and the service stays on the AWS network. Only S3 and DynamoDB support gateway endpoints; most other AWS services require interface endpoints.

Disaster recovery — AWS Elastic Disaster Recovery (CloudEndure)

AWS Elastic Disaster Recovery (formerly CloudEndure) provides continuous, block-level replication from on‑premises or other clouds into AWS. Core components:
  • Agents on source machines capture block changes and send them to replication servers.
  • Replication servers convert and stage replicated blocks into EBS volumes (staging area).
  • A staging area exists in your AWS account (staged EBS volumes inside your VPC).
  • Recovery instances (EC2) are launched from replicated/staged volumes during failover.
Replication is typically one-way (source → AWS) and is continuous. The service can perform lightweight transformation tasks during launch (for example, hostname changes or license adjustments).
A network architecture diagram showing on‑premises servers with AWS replication agents replicating data and control traffic to an AWS region. It illustrates components like replication servers, staging area subnets, EBS volumes, and recovery instances (EC2) plus S3 for replication downloads.
Security notes for Elastic Disaster Recovery
  • Data in transit between agents, replication servers, and AWS is encrypted (TLS).
  • For predictable bandwidth and private connectivity consider AWS Direct Connect. On the AWS side, ensure IAM and resource permissions are narrowly scoped and audited.
  • Automate, document and test recovery and failback procedures regularly — recoverability is validated by DR exercises, not by backups alone.
Terminology
  • Failover: activating the recovery environment (secondary).
  • Failback: returning operations from the recovery environment back to the primary after validation.

Storage Gateway family

AWS Storage Gateway provides several gateway types that bridge on‑premises environments with AWS storage services. The main modes are:

S3 File Gateway (File Gateway)

  • Exposes S3 buckets as file shares using NFS or SMB. Existing applications can read/write files as if on a traditional file system while objects are stored in S3.
  • Encryption in transit and at rest is supported and should be enabled.
  • Local caching can be configured for low-latency access to frequently used files.
Question (example) Would S3 File Gateway provide a file system mount on S3 and integrate with existing applications?
  • Yes — S3 File Gateway provides NFS/SMB mounts and integrates with existing applications. It supports encryption and local caching to optimize access.

FSx File Gateway

FSx File Gateway enables on‑premises clients to mount an FSx for Windows File Server share via a local gateway that caches data. Typical architecture includes SMB clients, Active Directory, DNS/NTP, a gateway VM (OS/metadata + cache), and FSx in the cloud.
A labeled architecture diagram titled "FSx File Gateway - How it Works" showing on-premises SMB clients, AD/DNS/NTP services, and an FSx File Gateway with OS/metadata and data caches. It shows connections to the AWS Cloud (FSx/storage gateway endpoint), control/data planes, required ports, and notes about low-latency SSD caches.
Security and deployment notes
  • FSx File Gateway typically requires Active Directory integration for authentication and access controls.
  • Use fast local SSDs in the gateway appliance to improve caching performance.
  • Traffic between the on‑prem gateway and AWS is encrypted; consider using VPC interface endpoints for control plane interactions where applicable.

Tape Gateway (Virtual Tape Library)

Tape Gateway provides a VTL interface to legacy backup applications. It exposes virtual tape drives and a media changer to backup software via iSCSI; the gateway stores virtual tapes in S3 and can archive them to S3 Glacier or Glacier Deep Archive based on lifecycle rules.
A labeled architecture diagram of an AWS Tape Gateway showing on-premises Gateway VMs exposing virtual tape drives and a media changer to backup applications over iSCSI. Cached storage and upload buffers send virtual tapes to Amazon S3, with older tapes archived to Amazon Glacier.
Key points
  • Tape Gateway allows reuse of existing tape-based backup software without changing workflows.
  • Virtual tapes are stored in S3 and can be archived to Glacier classes as required by retention policies.
  • Tape Gateway reduces the operational overhead of physical tape libraries while enabling lifecycle management.

Volume Gateway (Stored mode vs. Cached mode)

Volume Gateway presents cloud-backed iSCSI block storage to on‑premises applications. Two primary modes:
  • Stored Volumes: the entire dataset is kept locally on the gateway for fast local reads. Snapshots are taken and stored in AWS (EBS snapshots in S3).
  • Cached Volumes: the primary data resides in AWS while the gateway caches frequently accessed blocks locally for low-latency access. Useful where on‑premises capacity is limited and only “hot” data should be local.
A diagram showing AWS Volume Gateway in two modes (Stored Mode and Cache Mode). It depicts an on‑prem application server connecting via iSCSI to a volume gateway VM that talks over HTTPS to the AWS Storage Gateway, storing volumes in Amazon S3 and creating Amazon EBS snapshots.
Security and operational considerations
  • Data is encrypted in transit and at rest by default; validate encryption settings during deployment.
  • Select Stored mode when full local datasets and fast local reads are required; choose Cached mode to offload capacity to AWS while keeping performance-sensitive blocks locally.
  • Verify current limits (volume sizes, number of volumes, throughput) in the AWS Storage Gateway documentation as quotas can change.

Summary — practical checklist

This lesson focused on storage manipulation services: backup orchestration, replication/disaster recovery, and storage gateway variants. Newer AWS storage services generally enable encryption and logging by default, but your responsibilities include:
  • Choose appropriate KMS keys. Use customer-managed CMKs when policy or compliance requires it, and ensure the CMK key policy includes the necessary service and cross-account principals.
  • Configure retention and immutability controls (Vault Lock vs Legal Hold) according to legal/compliance requirements.
  • Ensure private connectivity when required (VPC interface endpoints or Direct Connect).
  • Limit and monitor who can perform backup/restore and recovery actions using least privilege IAM, and log all such actions in CloudTrail.
  • Detect and audit: enable CloudTrail, AWS Config, and CloudWatch. Use AWS Config rules and alerts to track changes to backup/restore configuration.
  • Validate recoverability: automate and run periodic restore/failover tests, and document failback procedures.
For more architecture and best practices: Thanks for following this walkthrough of storage manipulation services. A future lesson will cover compute.

Watch Video

Practice Lab