Cloud Compute Options

Learn how the cloud runs your applications and how to choose the right way to do it. Compare virtual machines and their instance families, containers and managed Kubernetes, serverless containers and functions, and application hosting platforms. See how auto scaling adds and removes capacity, how load balancers spread traffic across healthy servers and availability zones, and how to recommend a compute option for a real business scenario, with examples from AWS, Microsoft Azure and Google Cloud.

BeginnerLesson 3 of 7 in Cloud Computing Fundamentals Course

What you will learn

  1. Explain what a cloud virtual machine is, what it needs to run and how its lifecycle affects cost, and choose an instance family and size that fit a workload.
    • Describe a cloud virtual machine and what it needs to run
      Explain how a provider turns physical servers into virtual machines, name the resources a VM needs, and describe its lifecycle and who manages what.
    • Choose an instance family and size
      Read instance type names, match the main instance families to workloads, size a VM from its needs and recognize interruptible Spot capacity.
  2. Explain scaling, elasticity and high availability, describe how auto scaling adds and removes instances, and explain how load balancers spread traffic across healthy instances.
    • Explain scaling, elasticity and high availability
      Distinguish vertical from horizontal scaling and scalability from elasticity, and explain how spreading instances across zones and fault domains keeps an application running.
    • Explain how auto scaling adds and removes instances
      Describe a scaling group's template, minimum, desired and maximum size, health checks and scaling policies, and work out how a target-tracking policy responds to load.
    • Explain how a load balancer spreads traffic
      Describe what a load balancer does, how health checks and distribution methods work, how layer 4 and layer 7 load balancers differ, and which service each provider offers.
  3. Compare containers with virtual machines, explain what managed Kubernetes does, and describe the container services that run containers without managing servers.
    • Compare containers with virtual machines
      Explain what a container, a container image and a registry are, how containers differ from VMs in size, speed and isolation, and why containers suit microservices.
    • Explain what managed Kubernetes does for you
      Describe the main parts of a Kubernetes cluster, how it keeps the desired state and scales, and what Amazon EKS, Azure Kubernetes Service and Google Kubernetes Engine manage for you.
    • Run containers without managing servers
      Describe Amazon ECS with AWS Fargate, Azure Container Instances, Azure Container Apps and Google Cloud Run, and decide when serverless containers fit.
  4. Explain how serverless functions run and are billed, when they fit, and how application hosting platforms run web apps while the provider manages the infrastructure.
    • Explain serverless functions and when they fit
      Describe the event-driven function model, its triggers, billing, limits and cold starts, and decide when functions fit a workload better than servers.
    • Host web applications on a managed platform
      Describe what application hosting platforms do for you, compare AWS Elastic Beanstalk, Azure App Service, Google App Engine and simpler hosting options, and know what you still manage.
  5. Compare virtual machines, containers, serverless functions and hosting platforms on control, responsibility, scaling, cost and portability, and recommend an option for a business scenario.
    • Compare compute options side by side
      Place the compute options on a spectrum from most control to least management, and compare who manages what, how each scales and is billed, and how portable each is.
    • Recommend a compute option for a business scenario
      Apply a short set of questions to real scenarios, justify a recommendation, and plan a move from lifting and shifting to modernizing.

Cloud Compute Options study guide

5 chapters

1

Run workloads on cloud virtual machines

A cloud VM gives you a familiar computer to configure, but its resources, lifecycle and maintenance still need decisions. Learn which choices launch an instance, which charges can remain after it stops, and who patches the operating system. Then use workload needs to choose a family and size, read the provider names, and distinguish short CPU bursts from capacity that can be taken back.

1.1 Launch and manage a virtual machine

A virtual machine (VM) is a computer defined in software. It has virtual processors, memory, disks, a network connection and its own operating system. A hypervisor divides a physical server among VMs and keeps them isolated. A running cloud VM is also called an instance.

Choose the resources

The core services are Amazon EC2, Azure Virtual Machines and Google Compute Engine. Each rents you infrastructure; you manage the operating system and application. This is infrastructure as a service (IaaS).

Launching a VM involves several connected choices:

  • Location: a region and, where offered, an availability zone.
  • Image: a template containing the operating system and preinstalled software. AWS calls it an Amazon Machine Image (AMI); Azure and Google offer public and custom images.
  • Size: the vCPUs, memory and related capacity. A vCPU is the processing unit assigned to the VM.
  • Disk: persistent storage from which the operating system boots.
  • Network: an interface in a subnet, plus traffic rules. A public IP address is optional.

AWS uses EBS volumes, VPC subnets and security groups. Azure uses managed disks, VNet subnets and network security groups. Google uses persistent disks, VPC subnets and firewall rules. The names differ, but the resources serve comparable roles.

Follow a launch decision

A team needs a Linux web server in Frankfurt. It selects the Europe (Frankfurt) Region, an Ubuntu AMI and m7g.large, with 2 vCPUs and 8 GiB of memory. It adds a 30 GiB EBS boot volume and connects the VM to a VPC subnet. Its security group allows HTTPS on port 443 from the internet and SSH on port 22 only from the office network. The image supplies the software starting point; the size supplies computing capacity; the traffic rules decide who can connect.

Track the lifecycle and the bill

A VM is created, runs, can be stopped and started, and is eventually deleted. Compute charges accrue while it is allocated for running, even if CPU use is near zero. Stopping normally ends compute charges, but retained disks and reserved public IP addresses can still cost money. On Azure, check for "Stopped (deallocated)": shutting down inside the guest operating system can leave the VM in "Stopped", with compute still billed.

Temporary local disks are different from persistent boot disks. AWS instance store, Azure temporary disks and Google Local SSD keep data on the physical host; stopping, moving or deallocating a VM can lose it. Put files that must survive in persistent storage. After deleting a VM, review retained billable resources. A security group alone has no standalone charge, while an undeleted disk can keep generating one.

Know who maintains it

The provider maintains the datacenter, physical hardware and hypervisor. You patch the guest operating system, update installed software, protect data and manage access and firewall settings. Renting a VM does not transfer guest patching to the provider.

A dedicated host reserves a physical server for your use, useful for licenses tied to physical cores. A bare-metal instance exposes hardware without a hypervisor layer. Azure Virtual Desktop and Amazon WorkSpaces instead stream cloud-hosted desktops to users' devices.

Key Takeaways

  • A VM gives you a guest operating system that you maintain.
  • An image supplies software; a size supplies vCPUs and memory.
  • Persistent disks and temporary local disks have different lifetimes.
  • Check Azure deallocation and retained resources when ending charges.
  • Dedicated hosts can satisfy physical-core licensing requirements.

1.2 Match a VM family and size to the workload

An instance family sets the balance of processing, memory, storage and accelerators. Its size sets how much of those resources you get. Choose the family from the workload's main need, then choose a size that meets all its requirements.

Recognize the main families
FamilyMain strengthTypical workExamples
General purposeBalanced CPU and memoryWeb and application serversAWS M, Azure D, Google E2/N2
Compute optimizedProcessing capacityEncoding, batch jobs, modelingAWS C, Azure F, Google C2/H3
Memory optimizedMore memory per vCPUCaches, in-memory databasesAWS R/X, Azure E/M, Google M
Storage optimizedFast local reads and writesHigh-I/O databasesAWS I, Azure L, Google Z3
AcceleratedGPUs or other acceleratorsTraining models, renderingAWS P/G, Azure N, Google A/G

Fast local storage does not make data persistent. A workload that uses storage-optimized instances still needs a plan for data that must survive host loss.

Read the name

In m7g.large, m means general purpose, 7 is the generation, g indicates AWS Graviton and large is the size. The same family grows from 2 vCPUs and 8 GiB at large to 4 vCPUs and 16 GiB at xlarge, then 8 vCPUs and 32 GiB at 2xlarge.

In Azure's Standard_D4s_v5, D is the family, 4 is the vCPU count, s indicates premium SSD support and v5 is the version. Google's e2-standard-4 names the E2 series, standard memory ratio and 4 vCPUs. A vCPU is often a hardware thread; on Graviton it is a whole core. Do not treat every provider's vCPU as an identical physical core.

Work through a sizing choice

An internal reporting app needs 2 vCPUs and 6 GiB at peak. Compare these AWS sizes:

  • c7g.large: 2 vCPUs and 4 GiB; memory is insufficient.
  • m7g.large: 2 vCPUs and 8 GiB; both requirements fit, with 2 GiB spare.
  • r7g.large: 2 vCPUs and 16 GiB; it supplies much more memory than this app needs.

The general-purpose size is the sensible starting point. Its memory per vCPU is 8÷2=4 GiB. The compute-optimized and memory-optimized choices provide 2 and 8 GiB per vCPU, respectively. Google's E2 highcpu, standard and highmem 4-vCPU types similarly vary memory: 4 GB, 16 GB and 32 GB.

Right-sizing means measuring real use and adjusting the choice. Inspect memory, disk and network use alongside CPU before downsizing. AWS Compute Optimizer, Azure Advisor and Google's machine type recommendations can help. Resizing an existing VM requires a stop or restart, so plan for interruption to a single-server app.

Distinguish bursts from interruption

Burstable AWS T, Azure B and shared-core Google E2 types suit quiet workloads with short peaks. AWS T and Azure B earn CPU credits below a baseline and spend them above it. When credits run out, Azure B and AWS T standard mode return to baseline; current AWS T types default to unlimited mode and can charge for surplus CPU.

Spot VMs use spare capacity that the provider can reclaim at short notice. They fit restartable batch work with saved progress. A single production database is a poor match. Google's older preemptible VMs also have a 24-hour maximum lifetime; that limit is not the defining rule for modern Spot VMs.

Key Takeaways

  • Choose the family by the scarce resource, then check the full size.
  • A vCPU is not always a whole physical core.
  • Right-size from measured CPU, memory, disk and network use.
  • Burstable capacity suits brief peaks; sustained CPU use can throttle or cost extra.
  • Spot workloads must tolerate interruption.
  • Resizing one VM can interrupt its application.
2

Keep applications available and responsive as demand changes

An application needs enough capacity for busy periods and enough healthy copies to survive failures. Learn how changing machine size differs from changing machine count, why shared state matters, and how zones reduce failure risk. Follow auto scaling from a template to a capacity decision, then see how load balancers direct requests to healthy targets while other systems handle repair.

2.1 Scale capacity and survive failures

A service faces two different problems: more work arriving, and equipment failing. Scaling changes capacity. High availability keeps the service usable when parts fail. A design can solve one problem while leaving the other unresolved.

Change size or change count

Vertical scaling changes one machine's size: for example, 2 vCPUs and 8 GiB become 8 vCPUs and 32 GiB. Scaling up adds resources; scaling down removes them. It is a direct way to give an existing application more capacity, but the machine must usually restart, the largest size is finite, and the machine remains one failure point.

Horizontal scaling changes the number of copies. Three web servers can become nine, then return to three. Scaling out adds instances; scaling in removes them. A load balancer shares web requests, while background workers can take jobs from a shared queue. The application must support multiple copies doing useful work together. A shared database can still limit throughput or fail even when many web servers remain healthy.

ChangeDirectionWhat changes?
Scale up/downVerticalResources in each machine
Scale out/inHorizontalNumber of machines

Scalability is the ability to handle more work by adding resources. Elasticity is automatic, timely growth and shrinkage as demand changes. A shop that automatically changes from 4 servers at night to 20 during a sale is elastic. A fixed fleet with spare capacity may be highly available without being elastic.

Make copies replaceable

A stateless application instance keeps no unique data needed by a later request. Store carts, sessions and uploaded files in a shared database, cache or storage service. Then a request can reach any instance, and scaling in can remove one without losing its users' carts.

For example, a cart held only in one web server's memory disappears when that server is terminated. Keeping the user on that server with a sticky session does not protect the cart from server failure. Moving the cart into shared storage changes what can safely be removed.

Keep enough capacity after a zone fails

Availability zones are separate locations within a region with independent power, cooling and networking. Spreading instances across zones protects against a whole zone failing. Several instances in one zone still share that zone's risk.

Suppose an application must retain the capacity of 4 instances after losing any one of 3 zones. The two surviving zones must each supply 2 instances:

4÷2=2

Run 2 instances in each zone, for 6 total. Losing any zone leaves 4. This is spare capacity for failure, not an increase in the workload's normal requirement. A load balancer directs requests to the survivors; any shared data service also needs suitable availability.

Recognize Azure availability sets

An availability set spreads VMs within one datacenter across hardware fault domains and maintenance update domains. A fault domain shares hardware such as power and network switches. Sets support up to 3 fault domains; update domains default to 5 and can reach 20. They reduce rack and planned-restart risks. Zones address the larger risk of an entire datacenter location becoming unavailable.

Key Takeaways

  • Vertical scaling changes size; horizontal scaling changes instance count.
  • Elasticity adds automatic growth and shrinkage to scalability.
  • Shared state lets application instances be removed safely.
  • Plan capacity for the surviving zones, not only for normal operation.
  • Availability sets spread rack and maintenance risk within a datacenter.

2.2 Follow an auto scaling decision

Auto scaling adds and removes instances as demand changes. Amazon EC2 Auto Scaling uses Auto Scaling groups, Azure uses Virtual Machine Scale Sets with autoscale rules, and Google uses managed instance groups with an autoscaler.

Start from a repeatable template

A new instance needs the same image, size, network settings and startup instructions as its peers. AWS uses a launch template, Azure a scale set VM model and Google an instance template. A change made by hand inside one running VM will disappear when that VM is replaced unless it is included in the repeatable setup.

The group has three capacity settings:

  • Minimum: the floor the group maintains.
  • Desired: the count it currently aims to run.
  • Maximum: the ceiling it must not exceed.

With minimum 2, desired 4 and maximum 10, the group aims for 4 instances. Policies can move desired capacity between 2 and 10. The maximum is permission to grow; setting it to 10 does not itself run or bill 10 VMs. It caps instance count, not every charge in the application.

Choose what drives a change

Target tracking tries to keep a metric near a target, such as average CPU use of 50%. Step or rule-based scaling changes capacity when a threshold is crossed, such as adding 2 instances after CPU stays above 70% for 5 minutes. Scheduled scaling sets capacity at known times. Predictive scaling forecasts demand from past patterns and prepares capacity ahead of it.

A daily rush at 08:00 favors preparing instances before 08:00. Waiting for a high-CPU alarm means the rush has already arrived while the extra VMs are still starting.

Work out target-tracking capacity

Four identical instances average 80% CPU, and the target is 50%. For a simplified constant-load estimate, first total the work in instance-percentage units:

4×80=320

Divide by the target per instance:

320÷50=6.4

Round up to 7 instances because 6 would leave the average above target. With 7, the estimate is 320÷7≈45.7%. If the group's maximum is 6, it stops there and averages about 53.3%.

Separate readiness from failure recovery

A VM needs time to boot, run its startup tasks and pass health checks. Warm-up prevents a new instance's incomplete measurements from distorting a scaling decision. A cooldown limits rapid back-and-forth changes.

Scaling groups can also replace failed VMs to restore desired capacity. Application-level checks and repair actions need configuration: a VM can be running while its web application is broken. On Azure a repair action can restart, reimage or replace; Google calls recovery autohealing. A load balancer can detect a broken app, but the scaling group must be configured to use that information for repair.

Scaling in removes instances. Keep logs centrally and lasting data outside their local files so removing a healthy copy does not remove unique information.

Key Takeaways

  • A template makes replacement instances repeatable.
  • Minimum, desired and maximum mean floor, current aim and ceiling.
  • Target tracking responds to a metric; schedules prepare known peaks.
  • Round capacity estimates up, then apply the maximum.
  • Readiness delays and application health checks affect recovery.
  • Scale-in requires replaceable instances and external lasting data.

2.3 Distribute requests across healthy servers

A load balancer gives clients one entry address and forwards incoming traffic to healthy servers. AWS calls the server pool a target group; Azure uses a backend pool; Google uses a backend service. Clients do not need a new address whenever the pool changes.

Route traffic and detect failures

A health check repeatedly tests a target, for example by requesting /health every 10 seconds. After enough failed checks, the target is marked unhealthy and receives no new traffic until it passes again. Detection takes time because the checks run at intervals.

Routing and repair are different jobs. The load balancer stops sending new requests to a failed target. A scaling group or operator repairs or replaces that server. Adding a load balancer alone adds no application processing capacity.

Round robin takes healthy targets in turn. Least connections or least outstanding requests favors the target with less work in progress. Hash-based routing maps connection details, including addresses and ports, to a target. One connection stays together, but a new connection from the same user can land elsewhere.

Session affinity, also called sticky sessions, keeps a user's requests on one server. It can support an application with local sessions, but makes traffic less even and leaves sessions exposed to that server's failure. Shared session storage lets other healthy servers continue the user's work.

Calculate the effect of losing a server

Three healthy servers share 900 requests per minute evenly. Each handles:

900÷3=300

One server fails its health checks. The same work now goes to two:

900÷2=450

If each can handle only 400 requests per minute, healthy routing still leaves an overload. The pool needs spare capacity or more instances. Auto scaling changes capacity; load balancing distributes it.

Pick the layer that fits the routing
TypeWhat it understandsUseful when
Layer 4Supported TCP/UDP connections, addresses and portsRouting network connections without HTTP rules
Layer 7HTTP/HTTPS hosts, paths and requestsSending /api/ and /images/ to different pools

A layer 7 service can also terminate TLS, decrypting HTTPS at the entry point, and can work with a web application firewall. A layer 4 service does not inspect an HTTP path to choose its backend. Check which transport protocols a particular product supports.

AWS Elastic Load Balancing offers Application Load Balancers at layer 7, Network Load Balancers at layer 4 and Gateway Load Balancers for network appliances, within a region. Azure Load Balancer is layer 4; Application Gateway is regional layer 7; Front Door provides a global layer 7 entry point. Google Cloud Load Balancing offers Application and Network Load Balancers in regional and global forms.

Join routing to scaling

With the integration configured, new group instances register as targets and receive traffic once healthy. During removal, connection draining allows active requests to finish before a target disappears. A multi-zone deployment routes to healthy zones during an outage, provided the survivors have enough capacity. Even two servers benefit from this shared entry point and health-based routing.

Key Takeaways

  • Health checks control routing; repair requires a scaling group or operator.
  • Load balancing shares existing capacity and cannot create more.
  • Layer 7 can route by HTTP host or path; layer 4 routes connections.
  • Connection draining gives active requests time to finish.
  • Healthy survivors still need enough capacity to carry the load.
3

Run applications in containers

Containers keep an application and its dependencies together so the same package can move from testing into production. Learn what they share with their host and what that means for speed, isolation and lasting data. Then compare Kubernetes orchestration with services that hide the host machines, using pod capacity, team skills and quiet-hours traffic to understand the choices.

3.1 Package an application in a container

A container runs an application and its dependencies as an isolated process on a host. Packaging its libraries and runtime makes the tested software repeatable in production.

Image, registry and running copy

An image is the read-only template; a registry stores and distributes images; a container is a running copy. Amazon ECR, Azure Container Registry and Google Artifact Registry provide registries. The Open Container Initiative defines standard image formats; Docker helped popularize their use.

For example, a team packages its Python orders API as orders-api:1.4, tests it, pushes it to a registry and starts 3 production containers from that image. Environment settings and access to external services still need configuration.

Share a kernel instead of booting a guest OS

Each VM carries a full guest operating system behind a hypervisor. Containers share the host's kernel, the operating-system core that manages resources and processes. They have less software to carry and start: images are often tens or hundreds of megabytes, and startup takes seconds or less. VM images are commonly gigabytes and boot in minutes. A host can therefore run more containers than full VMs.

Sharing also affects isolation. A host-kernel flaw can affect several containers, while separate guest kernels give VMs a stronger boundary. Linux containers need a Linux kernel; Windows containers need Windows. The image must also match the processor architecture, such as x86 or Arm. Containers often run on cloud VMs.

Replace software and preserve data

Update a container by building a corrected image and replacing old copies. A hand patch disappears on replacement and leaves other replicas unchanged.

The same applies to runtime files in the writable layer. An invoice generated there must be saved to a persistent volume or storage service before replacement. The image registry preserves application packages, not documents created by running containers.

Separate services when that helps

A monolith deploys as one unit. Microservices split an app into network-connected services that deploy and scale separately. A store can add payment-service containers without adding catalog-service copies.

An orchestrator places containers across hosts, restarts failed copies, scales them, rolls out versions and connects services. Kubernetes does this, as do simpler managed container services. Containers do not require Kubernetes.

Key Takeaways

  • An image is a template, a registry stores it and a container runs it.
  • Containers share a host kernel; VMs have their own guest kernels.
  • Image portability requires compatible operating systems and processors.
  • Replace containers with new images and keep lasting data externally.
  • Microservices can be deployed and scaled separately.
  • Orchestration coordinates containers across hosts.

3.2 Keep container workloads running with Kubernetes

Kubernetes deploys and manages containers across a group of machines called a cluster. It is open source, originated at Google and is maintained within the Cloud Native Computing Foundation. The same platform can run across clouds and private datacenters.

Understand the cluster's parts

The control plane stores configuration, schedules work and coordinates the cluster. Worker nodes, usually VMs, provide the processing and memory that containers consume.

A pod is the smallest unit Kubernetes schedules. It contains one or more containers that share a network address and stay together on one node. A pod is not a separate VM. Several pods can share the same worker node if their resource needs fit.

You declare a desired state: for example, 3 replicas of orders-api:1.4. Kubernetes works to keep 3 pods running. When a pod fails, it creates a replacement; after a node fails, replacement pods can run on surviving nodes with available capacity. A Kubernetes Service provides a stable name and address for reaching pods even as their individual addresses change.

Scale pods and machines separately

A horizontal pod autoscaler (HPA) changes pod count using metrics such as CPU demand. A cluster autoscaler changes node capacity when pods cannot fit or nodes become unnecessary. Adding pods without room to run them creates pending work, not more processing capacity.

Suppose each pod requests 0.5 vCPU and each node has 2 vCPUs available for pods. Ignore other resource limits for this example. One node can hold:

2÷0.5=4 pods

If the HPA raises the desired count to 10 pods, two nodes hold only 8. The requirement is:

10÷4=2.5 nodes

Round up to 3 nodes. The third node supplies room for the last 2 pods. Use capacity available for pods, because the node's operating system and Kubernetes components also need resources. In real scheduling, memory and placement rules matter alongside CPU.

Divide management responsibilities

Amazon Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS) and Google Kubernetes Engine (GKE) run managed control planes. The provider maintains that control plane, including its availability and updates. You manage images, application settings, access and workload resource requests. In many modes, you also manage worker-node choices and updates. Cluster fees can be separate from node charges.

GKE Standard leaves node choices with you and bills for the node VMs. GKE Autopilot provisions and manages nodes, generally charging for requested pod resources. EKS can run eligible pods on AWS Fargate so you do not manage the node VMs. These modes reduce operational work while limiting some host choices.

Decide whether the complexity helps

Kubernetes fits many independently deployed services and teams that need a common platform across providers. Its tools and workload definitions improve portability, though attached cloud databases, identity systems and networking can still require changes.

For one simple web app, a hosting platform or serverless container service can take less work. Managed Kubernetes does not fix a bug in your image or choose the right memory request for you. If an app repeatedly runs out of memory, the team must diagnose the app and its settings even when the control plane is fully managed.

Key Takeaways

  • The control plane coordinates; worker nodes run pods.
  • A pod is scheduled as a unit and can hold more than one container.
  • Desired state drives replacement of failed pods.
  • Pod scaling and node scaling solve different capacity problems.
  • Managed control planes leave application responsibility with the team.
  • Kubernetes portability must be weighed against its operational complexity.

3.3 Run containers with less server work

Serverless container services run your images on provider-managed hosts. You still select resources, maintain the image and configure the app. Scaling and billing depend on the service.

Separate orchestration from compute

Amazon ECS orchestrates containers as tasks. An ECS service maintains a desired task count, optionally behind a load balancer. Tasks run on EC2 hosts you manage or on Fargate compute.

Fargate also supports eligible EKS pods. You choose task or pod vCPUs and memory and pay while those resources run; you do not select, patch or scale the underlying EC2 hosts. ECS service autoscaling uses policies you configure. Fargate supplies compute, not the application's desired task count. ECS on EC2 retains more host and instance-family control, with more management work.

Compare Azure and Google services

Azure Container Instances (ACI) starts one container or a small group without a cluster and bills per second. It suits tests and simple finite tasks, but has no built-in autoscaling.

Azure Container Apps hides its underlying Kubernetes platform. Configured rules scale containerized apps on HTTP traffic or events, including down to zero for suitable workloads.

Google Cloud Run offers services for incoming requests and jobs that run to completion. Services can grow from zero and shrink again. Request-based compute billing covers request processing plus startup and shutdown. With no minimum instances and no running instances, idle compute costs nothing; databases and stored images can still incur charges. Cloud Run also hosts Cloud Run functions, which start from function code instead of a customer-supplied app image.

Trade idle savings for startup delay

An internal booking API is busy 08:00–18:00 on weekdays: 10 hours on 5 days, or 50 of the week's 168 hours. Occasional night requests also arrive. Cloud Run or Container Apps can run several copies at peak and reach zero between requests during quiet periods.

A request after idle time may wait for a cold start. Keeping one minimum instance warm reduces delay within its capacity and adds ongoing cost. A burst beyond that capacity can still start extra instances cold.

Choose the host control you need

These services restrict host access and impose resource and duration limits. You cannot install host agents or change the host kernel. VMs or suitable Kubernetes nodes fit those needs. For standard containerized APIs, simpler services can avoid the work of operating Kubernetes; ACI is a direct option for a simple container group.

Key Takeaways

  • Fargate supplies compute; ECS or EKS orchestrates workloads.
  • ACI has no built-in autoscaling.
  • Container Apps and Cloud Run can scale suitable services to zero.
  • A warm minimum trades ongoing cost for fewer idle-start delays.
  • Serverless containers leave images, app settings and resource limits with you.
4

Build with serverless functions and application hosting platforms

Functions run small pieces of code when events arrive; hosting platforms run complete web applications with deployment and management tools. Learn how triggers, state, duration limits and cold starts shape function workloads, and calculate an illustrative usage bill. Compare the main hosting platforms, including which infrastructure the provider maintains and which settings and costs remain yours.

4.1 Run short tasks when events arrive

A serverless function is code that runs when a matching event arrives. The provider manages the servers and managed runtime. AWS Lambda, Azure Functions and Google Cloud Run functions offer this functions as a service (FaaS) model.

Connect a trigger to an invocation

A trigger starts one execution, called an invocation. Triggers include HTTP requests, uploaded files, queue messages, database changes and timers. A photo upload can trigger a function that creates a 200-pixel thumbnail and saves it in storage. With no uploads, an on-demand deployment can have no function compute running.

The provider scales execution as events arrive, within concurrency and service limits. Many simultaneous functions can open many database connections. The function layer may have room to scale even when the database does not. Limit concurrency to what connected systems can handle.

Functions are stateless across invocations. A later invocation may use a new environment, so it cannot depend on an earlier call's memory or temporary files. Store counters, sessions and lasting results in a database, cache or object storage. A warm environment may be reused, but that reuse is not a persistence contract.

Calculate consumption-style usage

Lambda's standard on-demand billing combines invocation count and GB-seconds (GB-s): allocated memory in GB multiplied by running seconds. For an illustrative calculation, assume each of 3,000,000 invocations runs for 0.2 seconds with 0.5 GB of memory. Ignore free allowances and all other services.

3,000,000×0.2=600,000 seconds 600,000×0.5=300,000 GB-s

At assumed prices of $0.0000167 per GB-s and $0.20 per million requests, compute costs $5.01 and requests cost $0.60, totaling $5.61. These are assumed prices for learning the model. Cloud Run functions also meter CPU; Azure plans may charge for ready or allocated instances.

At 100,000,000 otherwise identical invocations, usage is 10,000,000 GB-s: $167 compute plus $20 requests at those assumed rates. A VM priced at an assumed $0.04 per hour costs $29.20 for 730 hours, but a fair comparison also checks whether it can process the same work and includes its operating effort. Spiky demand favors avoiding idle capacity; steady load can favor always-on compute.

Check execution limits and startup delay

Lambda default compute allows at most 15 minutes per invocation and up to 10,240 MB of memory. A 40-minute conversion cannot fit that invocation. A container job, VM or shorter steps can fit; timeout rules differ for other plans and compute modes.

A cold start occurs when a new execution environment must be prepared, after idle time or during scale-out. Reused warm environments start faster. Lambda provisioned concurrency, always-ready instances on Azure Premium or Flex Consumption, and Cloud Run minimum instances reduce startup delays at extra cost.

The provider maintains servers and the managed runtime. You still fix your code and included libraries, protect secrets, configure permissions and secure data. Serverless removes server administration, not application ownership.

Key Takeaways

  • A trigger causes one function invocation.
  • Keep lasting state outside function memory and temporary files.
  • GB-seconds multiply allocated memory by execution time.
  • Billing and timeout rules belong to a specific service and plan.
  • Cold starts can occur after idle time and during scale-out.
  • Concurrency must fit downstream systems as well as the function service.
  • You retain code, library, data and access responsibilities.

4.2 Deploy a web app to a hosting platform

An application hosting platform takes your code or container image and provides the infrastructure for running it. It is platform as a service (PaaS): deployment, health monitoring, server operation and scaling are provided through the platform, while you build the application.

Compare the main platforms

AWS Elastic Beanstalk creates ordinary AWS resources for your app, commonly EC2 instances in an Auto Scaling group behind an Elastic Load Balancer. It handles deployments and health monitoring. Beanstalk itself has no extra service fee; you pay for the resources it creates. Those resources remain visible in your account, and you can customize their configuration.

Azure App Service hosts web apps, APIs and mobile back ends from code or containers. An App Service plan sets the region, instance size and count. Apps in that plan share those instances. Dedicated tiers bill for the plan even when the apps are quiet. Features such as autoscale and deployment slots depend on the chosen tier.

Google App Engine has standard and flexible environments. Standard uses supported runtimes in a sandbox and can scale to zero with suitable automatic scaling. Flexible runs containers on Compute Engine VMs, permits more customization and keeps at least one instance running. Cloud Run is another route for hosting an app already packaged in a container.

PlatformInfrastructure relationshipCost reminder
Elastic BeanstalkCreates visible AWS resourcesPay for those resources
App ServiceApps share a hosting planDedicated plans bill while idle
App EngineStandard or flexible environmentFlexible keeps a minimum instance
Release a new version safely

A two-person store team uses an App Service tier with deployment slots. It runs 2 instances and deploys a new version into a staging slot, a separate place to test the release before customers use it. After testing, it swaps staging and production. The old version remains available in the other slot for a possible rollback.

During a sale, its configured autoscale rule raises the plan to 5 instances after average CPU remains above 70%, then returns to 2 as demand falls. The platform carries out the scaling, but the team still selects the plan, rules and limits. It never installs the host operating system or web server.

Retain the right responsibilities

You maintain code, included libraries, settings, secrets, data and access in every platform. App Service and App Engine maintain their host operating system and managed runtime. Beanstalk permits more EC2 customization; AWS publishes platform updates, and you apply them or enable managed platform updates. Extra software you install also needs care.

A platform is different from SaaS. With PaaS, you deploy the app you build; with SaaS, you use someone else's finished application, such as an email suite. Platform-specific settings and service integrations can also make a later provider move harder.

Fit simpler hosting needs

Amazon Lightsail bundles a virtual private server, storage and data transfer for a predictable monthly package. It suits small websites but still involves VM responsibilities. A static site consists of files such as HTML, CSS, JavaScript and images. AWS Amplify Hosting, Azure Static Web Apps and Firebase Hosting can serve those files globally without a web server for you to maintain. An app requiring full host operating-system control belongs on VMs.

Key Takeaways

  • PaaS hosts the application you build; SaaS provides a finished application.
  • Beanstalk creates billable AWS resources and needs a platform-update choice.
  • App Service apps share a plan; dedicated capacity costs money while idle.
  • App Engine standard and flexible have different minimum-capacity behavior.
  • Deployment slots separate testing a release from exposing it to users.
5

Choose the right compute option for a workload

The useful compute choice is the one that fits the work and the team running it. Compare control, maintenance, startup, duration, billing and portability across VMs, containers, platforms and functions. Then turn business requirements into a justified recommendation, checking hard constraints before price and seeing how a move can progress from rehosting to modernization.

5.1 Compare control, effort and cost

Compare compute models against the same workload. Check control, operating effort, startup, billing, limits and portability.

Who maintains what?
ModelProvider maintainsCustomer maintains
VMsHardware and hypervisorGuest OS, runtime and app
Managed KubernetesControl planeImages, workloads and often nodes
Serverless containersHosts and host OSImage, app settings and limits
Hosting platformsDeployment platform and much of the hostApp, configuration and plan choices
FunctionsServers and managed runtimeCode, dependencies and permissions

Data and access remain the customer's responsibility throughout. Elastic Beanstalk also requires choosing how platform updates are applied.

Compare traffic and usable capacity

A VM usually needs a minute or more to boot and pass checks; a container often starts in seconds; a warm function can begin work in milliseconds. A new environment can add cold-start delay. Warm capacity reduces that delay at an ongoing cost.

A directory quiet overnight can benefit from scale to zero; steady demand can favor allocated compute. Compare equivalent throughput, memory and concurrency before monthly totals: one cheap VM may not serve the same work as many simultaneous function invocations. Include operating effort too.

VMs and dedicated hosting plans bill for allocated time, busy or idle. Lambda standard on-demand billing combines requests and GB-seconds; other function plans use different meters. Zero instances removes idle compute charges only when no paid minimum remains. Storage and databases can still bill.

Check limits and movement between platforms

Long-lived processes fit VMs or suitable containers. One Lambda default-compute invocation is limited to 15 minutes, so an uninterrupted two-hour job needs another compatible execution option. Functions cannot depend on local state surviving calls; disposable containers and scaling-group VMs also need external lasting data.

Full guest OS control, kernel changes and specialized licensed software favor VMs. Many independently deployed services can justify Kubernetes. Standard web apps often fit hosting platforms; short event tasks fit functions.

Container images move between compatible hosts, and Kubernetes offers common deployment tools across clouds. Databases, identity and networking can still need changes. VM migration depends on provider formats and tools; functions and platforms tie more closely to provider settings and triggers. Different components can use different models.

Key Takeaways

  • More host control brings more responsibility for operating it.
  • Compare costs for equivalent workload capacity and traffic.
  • Cold starts trade latency against the cost of warm capacity.
  • Portability includes dependencies beyond the image or deployment file.
  • Different components can use different compute models.

5.2 Choose compute from a business requirement

First check the requirements that could rule an option out. Then compare traffic, cost and team skills.

Find the decisive constraint
  1. Check guest operating-system access, special software, hardware and licensing.
  2. For short event-triggered work, check function duration, state and concurrency.
  3. For containerized apps, compare Kubernetes control with simpler managed services.
  4. For standard web apps deployed as code, consider a hosting platform.
  5. Check startup delay, traffic patterns, resource limits and total operating cost.
Match the business cases

A vendor supports an accounting app only on Windows Server, with a core-based license. VMs preserve that environment; use a dedicated host if physical-core licensing requires it. Multi-zone copies need a compatible app and data design. Moving largely unchanged is rehosting, or lift and shift, and retains guest maintenance.

Photo uploads rise from a few at night to thousands per minute. Short independent thumbnail tasks fit functions triggered by uploads. They scale with arrivals; check cold starts, duration limits and the capacity of downstream services.

A retailer has 30 microservices, 6 teams and a two-cloud platform requirement. Managed Kubernetes supplies common orchestration tools. A start-up with 3 services and no Kubernetes experience can use Cloud Run, Container Apps or ECS with Fargate, retaining image and app responsibilities without host work.

A museum's agency builds a ticketing website but has no operations staff. A hosting platform supplies deployment tools and scaling for opening days. App Service and App Engine maintain hosts; Beanstalk needs a platform-update choice, such as managed updates.

A two-hour nightly report fits a container job or VM with a suitable execution limit, not one Lambda default-compute invocation. Spot can reduce cost if the job saves progress and resumes after interruption.

Multi-day GPU training needs accelerated VMs or suitable Kubernetes GPU nodes. Persisted checkpoints make Spot practical by limiting lost progress.

Explain a staged choice

A company can rehost first to leave its datacenter quickly, then modernize selected components with containers, hosting platforms or functions. Rehosting alone keeps the old operating model.

For example: "Use Cloud Run because the API is already containerized, traffic stops at night and the team has no server administrator; allow for a cold start after idle time."

Key Takeaways

  • Check hard software, hardware and duration requirements first.
  • Match container-platform complexity to team skills and portability needs.
  • Use Spot only when interruption and recovery are acceptable.
  • Rehosting moves an app largely unchanged; modernization changes how it runs.
  • Justify the choice with a workload need and its main trade-off.

Cloud Compute Options examples

5 Walkthroughs

1

Choose a VM and follow its lifecycle

13 steps
Launch a server, separate image from capacity, and choose a size using workload measurements.
  1. 1
    IntroductionA computer you configure

    A cloud VM gives you a guest operating system to configure. You choose its software, capacity, storage and networking, then maintain the guest. Follow a server launch, check which charges survive shutdown, and use a reporting app's resource needs to choose a size.

  2. 2
    ExplanationChoose software and capacity

    An image supplies the operating system and preinstalled software. A size supplies vCPUs and memory.

    AWS calls these an AMI and instance type; Azure uses an image and VM size; Google uses an image and machine type. Choosing Linux does not choose the amount of RAM.

  3. 3
    ExampleConnect the VM

    The Frankfurt web server uses a 30 GiB persistent boot disk, a subnet and traffic rules. HTTPS on port 443 is open to internet users; SSH on port 22 is allowed only from the office network.

    These are separate choices: the disk holds data, the network interface connects the VM, and firewall rules control traffic. A public IP address is optional when the application can be reached through another entry point.

  4. 4
    Key InsightFollow a shutdown

    An Azure administrator shuts down the guest operating system. The console shows "Stopped," so the VM may still have allocated compute and continue incurring compute charges.

    Deallocating changes the state to "Stopped (deallocated)." That releases compute allocation, but a retained disk or reserved public IP address may keep billing. Deleting one resource does not delete every supporting resource.

  5. 5
    ChallengeCheck what survives

    A team stores its only sales records on a VM's temporary local disk, then deallocates the VM. What storage choice should it have made?

    ---reveal---

    The records belong on persistent disks or a storage service. A temporary local disk can lose data when the VM is stopped, moved or deallocated. It is suitable for disposable scratch work, not the only copy of lasting business records.

  6. 6
    TipKeep the patching boundary clear

    The provider maintains the hypervisor and physical host. The customer patches the guest OS, maintains the app and controls login access.

    A dedicated host reserves a physical server, for example for core-based licensing. It changes hardware allocation, not application ownership.

  7. 7
    ExampleStart with the scarce resource

    A reporting app needs 2 vCPUs and 6 GiB at peak. Compare CPU and memory together before choosing a family.

    A compute-optimized VM has more processing per unit of memory; a memory-optimized one has more RAM per vCPU. General-purpose types balance both. GPU types fit accelerated work such as model training, while storage-optimized types target high local-disk read and write rates.

  8. 8
    ExampleEliminate sizes that cannot fit

    The three candidates each have 2 vCPUs. The c7g.large has 4 GiB, m7g.large has 8 GiB and r7g.large has 16 GiB.

    The 4 GiB choice cannot meet the app's 6 GiB need. The 8 GiB choice fits with 2 GiB spare. The 16 GiB choice leaves 10 GiB beyond that need. The general-purpose size is a reasonable starting point to measure in real use.

  9. 9
    TipRead a size name

    In Azure Standard_D4s_v5, D identifies the family, 4 the vCPU count, s premium SSD support and v5 the version.

    AWS m7g.large uses a named size; Google e2-standard-4 ends with the vCPU count. Read the full specification before comparing resources.

  10. 10
    ConnectionCheck a credit-based choice

    A quiet development VM has brief bursts above its CPU baseline, so a burstable type may fit. A simulation that stays CPU-bound for hours is different.

    AWS T standard mode and Azure B spend earned CPU credits and return to baseline when credits run out. AWS T unlimited can continue bursting with surplus charges. Choose with the sustained workload in mind, not just its average over quiet days.

  11. 11
    ChallengeChoose a family from measurements

    A service needs 4 vCPUs and 25 GiB of RAM. A general-purpose size has 4 vCPUs and 16 GiB; a memory-optimized size has 4 vCPUs and 32 GiB. What fits, and why?

    ---reveal---

    The memory-optimized size meets both requirements. The general-purpose one lacks 9 GiB even though its CPU count is sufficient. After deployment, measure actual demand before changing the size again.

  12. 12
    ChallengeCombine fit with lifecycle

    A nightly rendering job can save progress and resume after interruption. Its chosen VM supplies enough CPU and memory. Would Spot be reasonable, and what must survive VM loss?

    ---reveal---

    Spot is reasonable because the job can tolerate reclamation and resume. Its checkpoints and finished outputs must be stored persistently. A low price cannot compensate for losing all progress each time spare capacity is taken back.

  13. 13
    RecapUse the right resource for each job

    Images supply software; sizes supply capacity. Persistent storage preserves lasting files, while retained resources can keep billing after compute stops.

    Choose a family from the limiting resource and measure real demand. Burstable types suit brief peaks; Spot needs interruption tolerance. Guest maintenance remains yours.

2

Keep a service running as load changes

16 steps
Work through scaling, zone capacity, target tracking and routing after a server failure.

Save this lesson to follow every Walkthrough step by step.

  1. 1
    IntroductionTwo reasons to need more capacity
  2. 2
    ExplanationChange size or change count
  3. 3
    Key InsightMove carts out of local memory
  4. 4
    ExampleCount the surviving zones
  5. 5
    ChallengeCheck availability and elasticity
  6. 6
    ExplanationSet floor, aim and ceiling
  7. 7
    ExampleFind the amount of work
  8. 8
    ExampleDivide by the target
  9. 9
    TipAllow time for readiness
  10. 10
    ChallengeEstimate and apply a ceiling
  11. 11
    ExplanationShare one entry point
  12. 12
    ExampleLose one target
  13. 13
    ChallengeConnect detection to repair
  14. 14
    TipPlan a safe removal
  15. 15
    ChallengeCombine zones, routing and capacity
  16. 16
    RecapSeparate the jobs
3

Choose how to run a containerized API

14 steps
Trace an image into production, size a Kubernetes cluster and compare services that hide the hosts.

Save this lesson to follow every Walkthrough step by step.

  1. 1
    IntroductionFollow the package into production
  2. 2
    ExampleImage, registry, container
  3. 3
    ExplanationShare the host kernel
  4. 4
    ChallengeReplace the package
  5. 5
    ExplanationDeclare what should run
  6. 6
    ExampleCalculate room per node
  7. 7
    ExampleRound up to whole nodes
  8. 8
    ChallengeCheck both scaling levels
  9. 9
    Key InsightKeep application ownership
  10. 10
    ExplanationUse a simpler host service
  11. 11
    ExampleLet quiet periods reach zero
  12. 12
    ChallengeDecide about a warm minimum
  13. 13
    ChallengeMatch control to the team
  14. 14
    RecapChoose the layer you need
4

Estimate function use and deploy a web app

13 steps
Follow an event-triggered function, calculate usage charges and compare managed application platforms.

Save this lesson to follow every Walkthrough step by step.

  1. 1
    IntroductionTwo ways to reduce server work
  2. 2
    ExampleStart from an event
  3. 3
    ExplanationKeep lasting results elsewhere
  4. 4
    ExampleCount running seconds
  5. 5
    ExampleMultiply runtime by memory
  6. 6
    ChallengeCheck memory-time reasoning
  7. 7
    TipRespect duration and startup
  8. 8
    ExplanationDeploy the application you build
  9. 9
    ConnectionUnderstand allocated platforms
  10. 10
    ExampleTest before the release
  11. 11
    ChallengeChoose the platform responsibility
  12. 12
    ChallengeCompare billing for quiet traffic
  13. 13
    RecapCheck the execution and the plan
5

Turn workload needs into a recommendation

10 steps
Compare requirements, operating effort and trade-offs through concrete business decisions.

Save this lesson to follow every Walkthrough step by step.

  1. 1
    IntroductionMake the choice explainable
  2. 2
    ExplanationCompare what the team keeps
  3. 3
    Key InsightCompare equivalent work
  4. 4
    ChallengeCheck the meaning of portability
  5. 5
    ExampleLet a hard requirement lead
  6. 6
    ConnectionUse the existing package and skills
  7. 7
    ExplanationChoose a home for long work
  8. 8
    ChallengeRecommend and name the trade-off
  9. 9
    ChallengeChoose the next migration step
  10. 10
    RecapLink the need to the choice

Cloud Compute Options practice questions

40 Practice Questions in 4 sets

Set 1: Connect capacity, state and responsibility10 Practice Questions

Question 1 of 10

A team moves its server to a standard cloud VM. Who is responsible for applying security patches to its guest operating system?
  1. The hypervisor service provider.
  2. The provider's datacenter team.
  3. The VM image publisher alone.
  4. The customer operating the VM.
Show answerHide answer
Answer: D
The customer patches a VM's guest OS; the provider maintains the physical host and hypervisor. An updated launch image does not keep every running guest patched afterward.

Question 2 of 10

A simulation uses most of its CPU continuously. A cheaper burstable VM in standard credit mode has a low baseline. Why might that VM slow down during the simulation?
  1. Its CPU credits can run out, returning it to baseline.
  2. Its Spot allocation must end after every CPU burst.
  3. Its credit balance reduces the installed memory.
  4. Its hypervisor turns CPU demand into storage traffic.
Show answerHide answer
Answer: A
Standard-mode bursts spend CPU credits and fall back to baseline when those credits run out. Spot reclamation is a separate capacity rule, not the result of exhausting CPU credits.

Question 3 of 10

An application needs six identical VMs of capacity after losing any one of three zones. VMs are evenly distributed, and replacement VMs cannot start during the outage. What is the smallest suitable deployment?
  1. 2 VMs per zone, 6 total.
  2. 4 VMs per zone, 12 total.
  3. 3 VMs per zone, 9 total.
  4. 6 VMs per zone, 18 total.
Show answerHide answer
Answer: C
After one zone fails, two zones must still provide six VMs, so each needs three. Nine total is the smallest even deployment that meets that condition. Six total supplies normal demand but leaves only four after a zone loss; waiting for replacement capacity is excluded here.

Question 4 of 10

A group of five equal VMs averages 72% CPU. Work stays constant and shares evenly. Ignoring policy timing, what total count meets a target of at most 45% CPU?
  1. 7 VMs.
  2. 8 VMs.
  3. 9 VMs.
  4. 6 VMs.
Show answerHide answer
Answer: B
The total work is 5 × 72 = 360 instance-percentage units; dividing by 45 gives eight VMs. Seven would average about 51.4%, still above target. This simplified estimate holds work constant and spreads it evenly; actual autoscaling also waits for measurements and instance readiness.

Question 5 of 10

A Linux container image built only for Arm is sent to an x86-only host without emulation. What compatibility problem must the team resolve?
  1. The registry stores an immutable image.
  2. The container has no separate guest kernel.
  3. The processor architecture does not match.
  4. The application is packaged with libraries.
Show answerHide answer
Answer: C
The Arm-only image requires a compatible processor environment. Linux compatibility alone is insufficient, and packaging libraries together does not convert their processor instructions to x86.

Question 6 of 10

Each node has 3 vCPUs and 5 GiB available for pods. Each pod requests 0.75 vCPU and 2 GiB. Six replicas must run, with no other placement restrictions. How many nodes are needed?
  1. 3 nodes.
  2. 2 nodes.
  3. 4 nodes.
  4. 6 nodes.
Show answerHide answer
Answer: A
CPU would allow four pods per node, but 5 GiB of available memory holds only two 2 GiB pods. Six replicas therefore need three nodes. Using the CPU result alone gives two nodes and leaves pods unschedulable because memory, not CPU, is the binding limit.

Question 7 of 10

A function runs 2,400,000 times, for 0.25 seconds each, with 0.5 GB allocated. What is its total memory-time usage?
  1. 600,000 GB-s.
  2. 300,000 GB-s.
  3. 1,200,000 GB-s.
  4. 150,000 GB-s.
Show answerHide answer
Answer: B
Multiply invocation count by duration to get 600,000 seconds, then by 0.5 GB to get 300,000 GB-s. The tempting 600,000 figure is total running seconds before accounting for memory. GB-seconds measure allocated memory over time, not request count or memory alone.

Question 8 of 10

Two low-traffic apps share an Azure App Service dedicated plan with two allocated instances. Why can the compute bill continue overnight with no requests?
  1. Each request reserves a month of compute.
  2. The staging slot runs the apps as VMs.
  3. Idle hours pause the plan's memory billing.
  4. The plan bills for allocated instances.
Show answerHide answer
Answer: D
A dedicated App Service plan charges for allocated instance capacity, including quiet hours. Apps sharing the plan share that capacity, not a guarantee of per-request billing. Scale-to-zero behavior on some serverless services should not be transferred to every hosting plan.

Question 9 of 10

A team moves an API from VMs to serverless containers. What maintenance responsibility most directly moves to the provider?
  1. Fixing vulnerable libraries inside its app image.
  2. Choosing which users may read application data.
  3. Patching the underlying host operating system.
  4. Correcting errors in the API business logic.
Show answerHide answer
Answer: C
The provider patches serverless-container hosts. Libraries inside the app image remain the customer's responsibility, along with code and data-access decisions.

Question 10 of 10

A team must run 24 independently deployed services on two clouds using the same orchestration tools. It has Kubernetes experience and accepts platform management work. What choice best fits, and why?
  1. Independent container platforms with cloud-specific tools.
  2. A code hosting platform with separate provider settings.
  3. VM deployments with scripts tailored to each provider.
  4. Managed Kubernetes with a common orchestration platform.
Show answerHide answer
Answer: D
Managed Kubernetes gives the team a common orchestration platform across clouds and fits many independently deployed services. Their existing skills make its operating work realistic. Provider functions would tie triggers and settings to each cloud rather than meet the stated orchestration requirement.
Set 2: Choose and operate cloud compute10 Practice Questions

Save this lesson to see every answer and practice every set.

Question 1 of 10

A group has minimum 2, desired 5 and maximum 9. It has five healthy VMs, and no policy changes desired capacity. How many VMs does it aim to keep?
  1. 2 VMs.
  2. 9 VMs.
  3. 7 VMs.
  4. 5 VMs.
Show answerHide answer

Save this lesson to see this answer.

Question 2 of 10

An Azure VM is shut down from inside Windows and shows "Stopped". What action ends its compute allocation?
  1. Delete its network security group.
  2. Remove the guest login account.
  3. Deallocate the VM through Azure.
  4. Detach its persistent data disk.
Show answerHide answer

Save this lesson to see this answer.

Question 3 of 10

A cache needs 4 vCPUs and 28 GiB of memory. Available sizes are general purpose (4 vCPUs, 16 GiB), compute optimized (8 vCPUs, 16 GiB), memory optimized (4 vCPUs, 32 GiB), and accelerated (4 vCPUs, 16 GiB plus a GPU). What fits both stated needs?
  1. The compute-optimized size.
  2. The memory-optimized size.
  3. The general-purpose size.
  4. The accelerated GPU size.
Show answerHide answer

Save this lesson to see this answer.

Question 4 of 10

A web application changes from two equal-sized VMs to five. What scaling direction is this?
  1. Horizontal scaling out.
  2. Vertical scaling up.
  3. Horizontal scaling in.
  4. Vertical scaling down.
Show answerHide answer

Save this lesson to see this answer.

Question 5 of 10

A website must send requests for /orders/ to one server pool and /help/ to another. What load balancer capability does it need?
  1. Layer 4 port-based routing.
  2. Layer 7 HTTP path routing.
  3. Layer 4 connection hashing.
  4. Layer 7 session affinity.
Show answerHide answer

Save this lesson to see this answer.

Question 6 of 10

A team wants production to run the same application and library versions that passed testing. What artifact should it deploy?
  1. A patched running container.
  2. The registry access settings.
  3. The tested container image.
  4. A larger host system disk.
Show answerHide answer

Save this lesson to see this answer.

Question 7 of 10

A VM is running, but its web app has failed. The load balancer excludes it, yet the scaling group does not repair it. What configuration should the team check?
  1. Application health checks and automatic repairs.
  2. The image registry retention policy.
  3. The number of deployment slots.
  4. The DNS name used by clients.
Show answerHide answer

Save this lesson to see this answer.

Question 8 of 10

A team uses ECS and wants to stop choosing and patching its container hosts. What compute option meets that goal?
  1. Run ECS tasks on EC2 hosts.
  2. Store ECS images in ECR.
  3. Raise the ECS task count.
  4. Run ECS tasks on Fargate.
Show answerHide answer

Save this lesson to see this answer.

Question 9 of 10

A function stores a running total only in memory. Later, a new execution environment reports zero. Where should the lasting total be kept?
  1. In the function's temporary directory.
  2. In a shared database or storage service.
  3. In a larger copy of the same memory.
  4. In the next invocation's local variables.
Show answerHide answer

Save this lesson to see this answer.

Question 10 of 10

A distributor must move a vendor-supported Linux application unchanged within a month. The vendor requires guest kernel changes. Requests are steady, and the team can patch Linux. What is the strongest first choice and trade-off?
  1. Cloud VMs with customer-maintained guest software.
  2. Managed Kubernetes with standard Linux container images.
  3. A code hosting platform with provider-maintained hosts.
  4. Serverless containers with provider-maintained hosts.
Show answerHide answer

Save this lesson to see this answer.

Set 3: Diagnose scaling and service choices10 Practice Questions

Save this lesson to see every answer and practice every set.

Question 1 of 10

A VM is deleted, but its retained boot disk remains. The team sees a continuing storage charge. What action addresses that charge once its data is no longer needed?
  1. Remove an unused security group.
  2. Delete the retained boot disk.
  3. Reduce the deleted VM's CPU size.
  4. Disable the old guest login account.
Show answerHide answer

Save this lesson to see this answer.

Question 2 of 10

A shop scales in from six web instances to three. Some users lose carts stored only in removed instances' memory. What change lets any surviving instance continue those carts?
  1. Use a larger VM for each server.
  2. Keep instances in one availability zone.
  3. Use sticky sessions with in-memory carts.
  4. Keep carts in a shared data service.
Show answerHide answer

Save this lesson to see this answer.

Question 3 of 10

Six identical VMs average 75% CPU at constant total load. The target is 50%, but maximum capacity is eight. Ignoring timing, what happens at that ceiling?
  1. 8 VMs average about 56.3% CPU.
  2. 8 VMs average exactly 50% CPU.
  3. 9 VMs average exactly 50% CPU.
  4. 6 VMs average about 56.3% CPU.
Show answerHide answer

Save this lesson to see this answer.

Question 4 of 10

Four servers evenly share 1,440 requests per minute. Each supports 400 per minute. One fails; no scaling repair is configured. What should the operator expect after health checks exclude it?
  1. Three receive 360 each; the balancer retains spare capacity.
  2. Four receive 360 each; health checks restart the failed app.
  3. Three receive 480 each; a repair or capacity action is needed.
  4. Three receive 400 each; the balancer rejects the extra 240.
Show answerHide answer

Save this lesson to see this answer.

Question 5 of 10

A managed Kubernetes app repeatedly crashes because of a bug in its container image. The control plane is healthy. Who must fix the cause?
  1. The provider that maintains the control plane.
  2. The provider that publishes Kubernetes releases.
  3. The registry that stores the application image.
  4. The team that maintains the application image.
Show answerHide answer

Save this lesson to see this answer.

Question 6 of 10

A developer needs a short Azure container test without a cluster. Automatic scaling is unnecessary. What service is a direct fit?
  1. Azure Container Instances.
  2. Azure Kubernetes Service.
  3. Azure Virtual Desktop.
  4. Azure App Service deployment slots.
Show answerHide answer

Save this lesson to see this answer.

Question 7 of 10

Training requires GPUs, takes three days, and may replay at most 10 minutes of work after interruption. The team wants reclaimable capacity. What design meets these needs?
  1. Accelerated Spot VMs; persistent checkpoints every 30 minutes.
  2. Accelerated Spot VMs; persistent checkpoints every 5 minutes.
  3. Accelerated Spot VMs; temporary-local checkpoints every 5 minutes.
  4. CPU-only Spot VMs; persistent checkpoints every 5 minutes.
Show answerHide answer

Save this lesson to see this answer.

Question 8 of 10

An agency wants customers to keep using the current App Service release while it tests a new release on a tier with deployment slots. What deployment approach fits?
  1. Test in staging, then swap staging and production.
  2. Replace production first, then test its new behavior.
  3. Create a larger plan, then upload directly to production.
  4. Stop both slots, then copy staging files to production.
Show answerHide answer

Save this lesson to see this answer.

Question 9 of 10

An API has no requests for long overnight periods and can tolerate startup delay. What cost-latency trade-off favors a service that scales to zero?
  1. Lower idle compute cost with guaranteed warm starts.
  2. Fixed idle capacity with per-request guest patching.
  3. Lower idle compute cost with possible cold starts.
  4. Fixed idle capacity with no application responsibility.
Show answerHide answer

Save this lesson to see this answer.

Question 10 of 10

A batch conversion runs for 110 minutes, needs no special host access, and cannot be split into shorter invocations. The team wants no server administration and uses Lambda default compute today. What is a sound next choice?
  1. One Lambda default-compute function with a 110-minute timeout.
  2. A managed container job with a limit covering 110 minutes.
  3. A container request with a fixed 60-minute execution timeout.
  4. A managed container job with a fixed 90-minute execution limit.
Show answerHide answer

Save this lesson to see this answer.

Set 4: Evaluate designs and trade-offs10 Practice Questions

Save this lesson to see every answer and practice every set.

Question 1 of 10

A VM averages 12% CPU but repeatedly runs out of memory. A proposal halves both its CPU count and memory to save money. What is the better next step?
  1. Measure memory demand and choose a size that meets it.
  2. Halve CPU and RAM to match the low average CPU demand.
  3. Double the vCPU count but keep the same memory limit.
  4. Move to burstable CPU but keep the same memory limit.
Show answerHide answer

Save this lesson to see this answer.

Question 2 of 10

A service predictably becomes busy at 09:00. New VMs need four minutes to boot and pass checks. CPU-based scaling reacts only after 09:00, when delays begin. What change best addresses this delay?
  1. Raise the reactive threshold so it tracks only the largest peak.
  2. Lengthen cooldown so the first new VMs stay allocated longer.
  3. Schedule enough capacity to finish health checks before 09:00.
  4. Raise desired capacity at 09:00 while keeping readiness checks.
Show answerHide answer

Save this lesson to see this answer.

Question 3 of 10

An API is removing a healthy server from its target pool while that server finishes several requests. What load balancer behavior helps those requests complete?
  1. Keep round robin active until immediate VM termination.
  2. Use sticky sessions while preventing any new user sessions.
  3. Stop health checks and remove the VM after a fixed delay.
  4. Stop new routing and drain active requests before removal.
Show answerHide answer

Save this lesson to see this answer.

Question 4 of 10

An invoice container is replaced with a patched image. Generated PDFs existed only in the old container's writable layer. The image registry still has both image versions. Why are the PDFs unavailable, and what prevents a repeat?
  1. The new tag hid the documents; redeploy the previous image tag.
  2. Replacement lost runtime files; save them in persistent storage.
  3. The image lacks runtime changes; retain older image versions.
  4. The registry holds the files; restore its original access settings.
Show answerHide answer

Save this lesson to see this answer.

Question 5 of 10

A Cloud Run API has minimum instances set to zero. A proposal keeps one instance warm to reduce the first-request delay after quiet periods. Traffic can also jump beyond one instance's capacity. What should the team expect?
  1. An ongoing warm-instance cost and possible burst cold starts.
  2. No ongoing compute cost and no cold starts during any burst.
  3. An ongoing warm-instance cost and a fixed one-instance ceiling.
  4. No idle latency change and only image-registry charges.
Show answerHide answer

Save this lesson to see this answer.

Question 6 of 10

A queue-triggered function scales rapidly, and database connection limits are exceeded. What setting most directly protects the database while preserving event processing?
  1. Raise function concurrency to clear events sooner.
  2. Keep a separate connection total in each local memory.
  3. Cap function concurrency to a supported level.
  4. Increase the database timeout without limiting arrivals.
Show answerHide answer

Save this lesson to see this answer.

Question 7 of 10

A team deploys the web application it wrote to a provider-managed hosting platform. What service model describes that arrangement?
  1. Software as a service.
  2. Platform as a service.
  3. Infrastructure as a service.
  4. Desktop as a service.
Show answerHide answer

Save this lesson to see this answer.

Question 8 of 10

A team moves a Kubernetes application to another cloud. The container images run there, but it still needs to change provider-specific database access and identity settings. How should this result be interpreted?
  1. The running images show all cloud dependencies are portable.
  2. The failed integrations show the images cannot be portable.
  3. The common Kubernetes API guarantees matching identity settings.
  4. Packaging is portable, but external integrations still need work.
Show answerHide answer

Save this lesson to see this answer.

Question 9 of 10

A Lambda-style usage estimate assumes $0.00002 per GB-s and $0.30 per million requests, with no allowances or other charges. Four million invocations use 0.5 GB for 0.15 seconds each. What is the total?
  1. $6.00.
  2. $7.20.
  3. $13.20.
  4. $4.80.
Show answerHide answer

Save this lesson to see this answer.

Question 10 of 10

A pod autoscaler requests ten replicas. Each node has 2.5 vCPUs available for pods, and each pod requests 0.9 vCPU. Memory is sufficient and there are no other placement restrictions. What node count supports all replicas?
  1. 4 nodes.
  2. 6 nodes.
  3. 5 nodes.
  4. 3 nodes.
Show answerHide answer

Save this lesson to see this answer.

Stuck on your own question? Homework Help

Key Terms

83 Key Terms, each with its definition

A

App Service plan
An App Service plan defines the region, instance size and count shared by its Azure-hosted apps; dedicated plans charge for allocated capacity.
Two small apps share the same plan instances, so their combined demand matters when selecting capacity.
Application hosting platform
An application hosting platform runs customer-deployed code or images with tools for deployment, server management, health monitoring and scaling.
A small agency deploys its ticketing app without installing the host operating system or web server.

B

Bare-metal instance
A bare-metal instance gives direct access to physical hardware without a hypervisor layer.
A workload needing direct hardware access uses a bare-metal option instead of an ordinary shared-host VM.
Burstable instance
A burstable instance provides a low CPU baseline with temporary access to higher processing performance, subject to its service rules.
A quiet test server can use burst capacity for short peaks without needing sustained full CPU use.

C

Checkpoint
A checkpoint saves processing progress so work can resume from that point after an interruption.
A training job resumes from its latest saved model state after the provider interrupts its Spot instance.
Cluster autoscaler
A cluster autoscaler adjusts worker-node capacity when requested pods cannot be scheduled or when nodes can be removed safely.
Pending pods that need more room cause another node to be added rather than simply another replica.
Cold start
A cold start is the extra delay needed to prepare a fresh execution environment before it can run work.
The first request after a quiet night waits for a new function environment to be initialized.
Concurrency
Concurrency is the amount of work executing at once, such as simultaneous function invocations.
The team caps concurrent function executions so the database connection limit is not exceeded.
Connection draining
Connection draining stops new traffic reaching a departing target while giving its active requests time to finish before removal.
A planned scale-in waits for in-progress requests instead of immediately terminating a busy target.
Consumption billing
Consumption billing charges according to measured usage, such as execution time and requests, with the exact meters set by the service and plan.
Quiet periods reduce an on-demand function's compute use while a dedicated hosting plan stays allocated.
Container
A container runs an application and its packaged dependencies as an isolated process, sharing the operating-system kernel of its host.
Several containerized services can share a VM while each uses its own packaged application libraries.
Container image
A container image is a read-only application template containing code, libraries and runtime files from which running containers are created.
The team deploys the tested inventory-api image to keep production on the same application version.
Container job
A container job runs a packaged workload to completion instead of continually serving requests.
A nightly data export uses a container job with a duration limit long enough to finish the report.
Container registry
A container registry stores and distributes images for deployment tools and execution services.
The deployment service pulls a versioned image from Artifact Registry before starting new containers.
Control plane
A control plane stores a Kubernetes cluster's desired configuration and coordinates scheduling and other actions that keep workloads running.
A managed Kubernetes provider maintains the control plane while the application team fixes its own code.
Cooldown
A cooldown is a delay used to limit rapid back-and-forth scaling decisions while the effect of an earlier capacity change settles.
A cooldown helps prevent adding and removing instances repeatedly before the earlier change can be assessed.
CPU credits
CPU credits track earned and spent access to above-baseline processing on credit-based burstable VMs such as AWS T and Azure B.
A sustained CPU job exhausts standard-mode credits and then runs at the VM's lower baseline.

D

Deallocation
Deallocation releases an Azure VM's allocated compute, ending its compute allocation charges.
After shutting down Windows, an administrator deallocates the VM and checks its displayed status.
Dedicated host
A dedicated host is a whole physical server reserved for one customer, including its core allocation.
A software license tied to physical cores leads the team to review dedicated-host requirements.
Deployment slot
A deployment slot is a separate hosting environment for an App Service app, supporting release testing before a swap with production on suitable tiers.
The team checks a staging release while customers continue using the current production version.
Desired capacity
Desired capacity is a scaling group's current target instance count, bounded by its minimum and maximum.
A group with desired capacity five replaces a failed VM to return to five healthy instances.
Desired state
Desired state is the declared workload configuration Kubernetes works to maintain, such as a particular image running with three replicas.
After a pod fails, the cluster creates another copy to restore the declared replica count.
Desktop virtualization
Desktop virtualization runs desktops remotely and streams their interface to users' devices.
Employees open cloud-hosted desktops through Azure Virtual Desktop instead of running everything locally.

E

ECS task
An ECS task is a running unit of containers defined for Amazon ECS, using either customer-managed EC2 hosts or Fargate compute.
An ECS service keeps the desired number of tasks running while a load balancer distributes web requests.
Elasticity
Elasticity automatically adds and removes resources promptly so capacity follows workload demand.
The service grows during a sale and shrinks overnight without an administrator changing the count.

F

Fargate
Fargate is AWS-managed compute for ECS tasks and eligible EKS pods, removing the need for customers to select and maintain host VMs.
The team chooses task CPU and memory on Fargate while ECS provides the application orchestration.
Fault domain
A fault domain is a group of hardware sharing failure risks such as power and network switches, which Azure availability sets spread VMs across.
Placing VMs across fault domains reduces the chance that one failed rack takes down every copy.

G

GB-second
A GB-second measures allocated memory over running time: one GB for one second, used in Lambda-style function consumption billing.
A function using 0.5 GB for two seconds consumes one GB-second before request charges are added.

H

Health check
A health check is a repeated test of a target's ability to serve work, used to remove failed targets from new traffic or trigger configured repair.
Several failed responses from the app's health endpoint cause the balancer to stop routing new requests there.
High availability
High availability is the ability to keep a service usable for a high proportion of time despite failures of individual components.
Instances in separate zones continue serving traffic after one zone loses power and connectivity.
Horizontal pod autoscaler
A horizontal pod autoscaler adjusts the number of pod replicas using workload metrics, such as average CPU use across the pods.
The API gains pod replicas during a busy period, using spare capacity already available on its nodes.
Horizontal scaling
Horizontal scaling changes the number of instances sharing work, adding copies when scaling out and removing copies when scaling in.
More web server copies handle a busy period while a load balancer distributes incoming requests.
Hypervisor
A hypervisor is software that divides a physical host into isolated virtual machines and controls their access to the host hardware.
Several customer VMs can share a physical server while keeping separate guest operating systems.

I

Instance
An instance is one provisioned copy of a cloud resource, such as a single VM in a VM service.
The team launches a second instance from the same image to provide another copy of its web server.
Instance family
An instance family groups VM types with a similar balance of processing, memory, storage or accelerators for particular workload needs.
The team chooses a memory-optimized family before selecting a size large enough for its cache.
Instance size
An instance size specifies the vCPUs, memory and related capacity supplied by a particular VM type.
Moving from m7g.large to m7g.xlarge doubles vCPUs and memory while keeping the same family.
Invocation
An invocation is one execution of a function, started by a matching event in a fresh or warm environment.
A burst of independent file events can create many simultaneous invocations, subject to service limits.

K

Kernel
A kernel is the core part of an operating system that manages hardware resources and processes; ordinary containers share their host's kernel.
Linux containers need a Linux kernel even when their application packages contain different libraries.
Kubernetes cluster
A Kubernetes cluster is a group of machines with a control plane that coordinates container workloads running in pods on worker nodes.
A cluster maintains several app replicas across its nodes instead of leaving placement to each team.
Kubernetes Service
A Kubernetes Service supplies a stable name and address for accessing a changing set of pods, separating clients from pod addresses.
Clients continue reaching the orders service while replacement pods receive different network addresses.

L

Launch template
A launch template defines an AWS VM's repeatable starting configuration, including its image, size, network settings and startup instructions.
Replacement instances recover the intended setup from the template instead of relying on hand edits.
Layer 4 load balancing
Layer 4 load balancing chooses targets from transport-level connection details, such as IP addresses and ports, for supported protocols.
A TCP service needs connection routing but does not need rules that inspect an HTTP URL path.
Layer 7 load balancing
Layer 7 load balancing understands HTTP requests and can choose targets from application details such as the requested host or path.
Requests for /api/ go to the API pool while requests for /images/ go to a different pool.
Load balancer
A load balancer presents one entry address and distributes incoming traffic among healthy targets according to configured routing rules.
Users keep the same website address while the backend server count changes during a busy period.

M

Machine image
A machine image is a template of the operating system and preinstalled software for a new VM.
An Ubuntu image supplies the Linux software, while the selected instance size supplies CPU and memory.
Maximum capacity
Maximum capacity caps a scaling group's instance count without immediately allocating that capacity.
Raising the maximum from eight to twelve does not by itself launch or charge for four more VMs.
Memory per vCPU
Memory per vCPU measures the RAM supplied per processing unit, helping compare VM resource balance.
An 8 GiB VM with 2 vCPUs supplies 4 GiB per vCPU, which helps the team compare families.
Microservices
Microservices are network-connected app services that can be deployed and scaled independently.
The payment service gains replicas during a sale without adding copies of the email service.
Modernization
Modernization changes how an application is built or run to use cloud capabilities, such as managed platforms, containers or event-driven components.
After rehosting, the team moves a new upload-processing feature to functions to avoid another always-on VM.
Monolith
A monolith is an application built and deployed as one combined unit rather than separate services.
For a store built as one application package, updating one feature requires releasing that whole package rather than one small service.

O

Operational responsibility
Operational responsibility is the maintenance work retained by a team, including app updates, data protection and access even on managed compute.
Moving to serverless containers removes host patching but leaves vulnerable application libraries to fix.
Orchestration
Orchestration coordinates container placement, failure recovery, scaling, service connections and version rollout across computing hosts.
An orchestrator starts replacement containers when a host fails and other hosts have enough capacity.

P

Persistent disk
A persistent disk retains data beyond a VM's running session unless deletion settings remove it.
A retained boot disk can preserve files after VM deletion and continue to generate storage charges.
Platform as a service
Platform as a service supplies a managed environment for applications you build and deploy, reducing infrastructure work while limiting host control.
The team uses App Service for its own code instead of renting a VM and configuring the web server.
Pod
A pod is Kubernetes' smallest scheduled unit, containing one or more containers that share a network address and run together on one node.
Two tightly connected containers share one pod, so the scheduler places both on the same worker node.
Portability
Portability is how readily an application and its deployment can move between environments, including the work needed to reconnect dependencies.
A container image runs on another cloud, but its database identity and networking settings still need changes.
Predictive scaling
Predictive scaling forecasts future capacity needs from historical demand patterns and prepares resources before the predicted load arrives.
Past traffic patterns help the scaling service prepare for a recurring peak instead of reacting late.
Provisioned concurrency
Provisioned concurrency keeps Lambda execution environments ready for a configured level of demand, reducing cold-start delay at extra cost.
A latency-sensitive API pays for ready capacity instead of relying entirely on new environments at arrival.

R

Rehosting
Rehosting moves an application largely unchanged onto cloud infrastructure, often VMs, while retaining much of its existing operating model.
A business leaves its datacenter quickly by moving a supported server app to equivalent cloud VMs.
Right-sizing
Right-sizing matches a VM's family and size to measured CPU, memory, storage and network needs without paying for unnecessary capacity.
Low CPU use prompts a review, but high memory use prevents the team from blindly choosing a smaller VM.
Round robin
Round robin sends work to available targets in turn, without selecting by their current workload.
With equal requests and three healthy targets, each receives about one third of the incoming traffic.

S

Scalability
Scalability is a system's ability to handle a larger workload by adding resources, within the limits of its application and dependencies.
Adding web servers helps until a shared database becomes the next limit on application throughput.
Scale to zero
Scale to zero reduces a service's running instance count to none during idle periods, saving idle compute when its billing model permits.
A quiet internal API reaches zero instances overnight and starts a new instance for the next request.
Scheduled scaling
Scheduled scaling changes capacity at configured times, allowing instances to be ready for predictable busy periods before demand arrives.
The service begins launching extra VMs before its regular morning rush so health checks finish in time.
Serverless containers
Serverless containers run customer-supplied images on provider-managed hosts, leaving application configuration and image maintenance to the customer.
A small team deploys its API image without choosing host VMs or applying host operating-system patches.
Serverless function
A serverless function is code run in response to events on provider-managed infrastructure, with behavior and charges defined by its hosting plan.
A new file in object storage triggers a function that extracts metadata and saves it in a database.
Session affinity
Session affinity keeps a user's requests on the same target, helping local sessions while risking uneven load and dependence on that server.
A sticky session cannot recover a cart stored only in memory when its assigned server is terminated.
Software as a service
Software as a service provides a finished application operated by its supplier, so customers use the software instead of deploying their own code.
An organization uses a hosted office suite rather than building and maintaining its own document editor.
Spot capacity
Spot capacity is discounted spare compute that the provider may reclaim at short notice, requiring interruption-tolerant workloads.
A rendering job saves completed frames so a Spot interruption does not erase all finished work.
Stateless instance
A stateless instance keeps no unique local information required by later requests, allowing other instances to continue the same work.
A shared cart database lets the next request reach a different web instance without losing the cart.
Static hosting
Static hosting serves web files such as HTML, CSS, JavaScript and images without a customer-managed application server for those files.
A documentation site uses Firebase Hosting to deliver its files through a global serving network.

T

Target tracking
Target tracking adjusts capacity to keep a workload metric near a chosen value, such as 50% CPU.
The group adds instances when distributing the same work over more VMs is needed to lower average CPU.
Temporary local disk
A temporary local disk holds data on the host that can be lost when the VM stops, moves or deallocates.
The app writes disposable scratch files locally and saves finished records in persistent storage.
TLS termination
TLS termination decrypts HTTPS at an entry point so it can inspect and route application requests.
An application load balancer terminates HTTPS before selecting a backend using the request path.
Trigger
A trigger is an event that starts a function run, such as a request, upload, message or timer.
A timer starts a housekeeping function at 02:00 without anyone launching a server manually.

U

Update domain
An update domain groups Azure VMs that may restart together for planned maintenance, allowing other groups to remain available.
A deployment spread across update domains avoids having all its VMs restarted in the same maintenance step.

V

vCPU
A vCPU is a processing unit assigned to a VM, often one hardware thread of a core and, for some processor types, a whole core.
A size with enough vCPUs can still fail to run a cache if its memory allocation is too small.
Vendor lock-in
Vendor lock-in is dependence on provider-specific services or settings that makes moving a workload to another platform more difficult.
A function tightly coupled to one provider's triggers needs adaptation before it can run elsewhere.
Vertical scaling
Vertical scaling changes the resources in one machine, scaling up to a larger size or down to a smaller one, usually with a restart.
The database VM moves to a size with more memory, so the team plans a brief service interruption.
Virtual machine
A virtual machine is a software-defined computer with its own guest operating system, virtual processors, memory, storage and networking.
A team rents a VM to run a vendor-supported server application and patches its guest operating system.

W

Warm-up period
A warm-up period allows a new instance to initialize before its measurements are treated as representative in scaling decisions.
A VM still starting its application should not distort the group's next estimate of useful capacity.
Worker node
A worker node is a machine, usually a VM, that supplies resources for Kubernetes pods and containers.
When existing nodes cannot fit the requested pods, node autoscaling can add another worker machine.
Workload requirement
A workload requirement is a need the compute choice must meet, such as duration, hardware, host access, traffic or operating support.
A required kernel change rules out a standard hosting platform before the team compares monthly costs.

About this lesson

By StudeliReport a mistake

Make your own Study Materials

Turn your notes, slides and documents into Study Guides, Practice Questions, Flashcards and 6 more tools.

Get Started