Posts related to snippet

Snippet: Benefits of Leastconn Loadbalancing

Most of the time, randomly balancing requests across hosts is good enough. Every so often though, there is an edge case which benefits from another method of choosing a host. For example, the following graph shows the request latency of hosts that handle requests that were not all born equal. Requests happened on a recurring period so a longer request had a tendency to end up on the same host again and again, eventually compounding to increase request latency and slow down other requests that reached that host.

read more