Scalability on demand How to implement

[taaaaahktnntriimh@]

Also, the principle of “Infrastructure on demand” can be considered implemented. the scalability on demand principle? By using EMR’s built-in auto-scaling feature. Attaching an auto-scaling policy to an EMR cluster, enables it to scale depending on the needs. The auto-scaling policy should have at least two rules but can have more than that.


One rule should tell the cluster when to grow and another to tell it japan whatsapp list when to shrink. The scale-out rule could be something like: “if available cluster memory becomes less than 15% and stays like that for more than 5 minutes, this cluster should grow one of its task instance groups by 5 instances”.


A scale in the rule could be something like: “if available cluster memory becomes more than 75% and stays like that for more than 3 minutes, this cluster should shrink the same task instance group by 3 instances”. A proper auto-scaling policy definition for an EMR cluster can be seen below.