A Machine Learning Specialist wants to determine the appropriate SageMakerVariantInvocationsPerInstance setting for an endpoint automatic scaling configuration. The Specialist has performed a load test on a single instance and determined that peak requests per second (RPS) without service degradation is about 20 RPS. As this is the first deployment, the Specialist intends to set the invocation safety factor to 0.5. Based on the stated parameters and given that the invocations per instance setting is measured on a per-minute basis, what should the Specialist set as the setting?
A) 10
B) 30
C) 600
D) 2,400

Question

Quizplus · Accepted Answer

The peak RPS is 20, so per minute it is 20 * 60 = 1,200. With a safety factor of 0.5, the setting should be 1,200 * 0.5 = 600.

A Machine Learning Specialist Wants to Determine the Appropriate SageMakerVariantInvocationsPerInstance