NORMALIZED CONCURRENCY LIMITS FOR THROTTLING AND FAULT ISOLATION IN A ROUTING SERVICE

Abstract

The processing capabilities of the machines in a routing service are evaluated and traffic patterns indicative of how calls are made to different dependency services are identified. The capabilities of the routing service and the traffic patterns are used to generate a dynamic limit model that dynamically limits the number of calls made to each dependency service. When the capabilities of the routing service change, the dynamic limit model automatically adjusts the limit corresponding to each dependency service.

CPC Classifications