Design for data storage

In this article, we discuss Module 6: Design a Nonrelational Data Storage Solution, which covers both Storage Accounts and Cosmos DB. We'll begin by exploring the fundamentals of designing for data storage.

Types of Data

Selecting the right storage solution starts with understanding the varying types of data:

Structured Data

Structured data is organized in a relational database format using rows and columns with a shared schema. This type of data is commonly used for managing customer information and product catalogs on e-commerce websites.

Semi-Structured Data

Semi-structured data maintains some organizational tags or fields without adhering to a strict relational model. Formats such as JSON, YAML, and XML fall into this category, offering flexibility through embedded tags that facilitate data classification and filtering.

Unstructured Data

Unstructured data lacks a predefined model or format. This includes items like videos, Word documents, PDF files, and various media formats that require adaptable storage services to handle their diverse structures.

Azure Storage Services

Azure offers a comprehensive suite of storage services tailored to different data types and access patterns. Many of these services were also introduced in our previous AZ-104: Microsoft Azure Administrator course.

Blob Storage

Blob Storage is optimized for storing unstructured data such as documents, images, videos, and audio files. By using containers, you can efficiently organize and manage your blobs.

File Storage

Azure File Storage provides cloud-based file shares using SMB or NFS protocols. This service enables you to structure directories and store a variety of files (e.g., TXT, executables) that can be accessed across multiple systems by mounting the share.

Table Storage

Table Storage is a NoSQL database service designed for flexible schema management. It stores entities with properties like name, county, country, and state, making it suitable for applications that require rapid, scalable data management.

Queue Storage

Queue Storage offers a robust messaging solution that decouples application components for streamlined processing. For example, in a function-based architecture, a user action—like clicking on a resized image—can trigger a message that is queued for sequential processing, ensuring orderly and efficient workflow management.

These storage services are critical for designing comprehensive solutions for modern data storage. In the next section, we will focus on designing for Azure Storage Accounts, building on the principles discussed here to ensure robust cloud infrastructure implementation.