I’m trying to figure out how to get the best pool size and count for a connection pool ({scheme, host, port}). Suppose I’m making 1000 req/sec and most requests take less than a second, but 10% of those requests take 10+ seconds. What method do you use to determine pool size and count?

Little's law In mathematical queueing theory, Little's law (also result, theorem, lemma, or formula) is a theorem by John Little which states that the long-term average number of customers (L) in a stationary system is equal to the long-term average effective arrival rate (λ) multiplied b…

Finch: How to calculate pool size/count

Questions & Help Questions

tj0 July 26, 2022, 12:10am 2

Also, if you know which ones are going to be slow, you can have a separate pool for them.