Concurrency

In this lesson, we explore the critical concept of concurrency, which is the eighth factor in the 12 Factor App methodology.

Up to now, we have containerized our application and executed it as a Docker container, running a single process capable of serving multiple users concurrently. While this setup works well under moderate demand, it has limitations under increased load.

Modern deployment strategies favor horizontal scaling, where additional servers are provisioned rapidly to run multiple instances of the application simultaneously. A load balancer then distributes incoming user requests across these instances, ensuring smooth performance even during peak demand.

For horizontal scaling to be effective, your application must be designed as an independent, stateless service. In line with the 12 Factor App principles, processes are treated as first-class citizens. Instead of scaling up a single instance with more resources, the application should scale out by running multiple instances concurrently.

In the next lesson, we will delve deeper into how these principles impact application processes and discuss practical strategies for designing applications that can scale horizontally.

For more information, explore:

• Kubernetes Basics
• Kubernetes Documentation
• Docker Hub
• Terraform Registry