Discussion about this post

User's avatar
Piyush's avatar

I have question on the topic of Queueing requests. Can you give a general idea how can we implement this? More specifically, how the other requests will know that there was already a request which misses the cache and trying to fill it and now we have to wait till that happen?

Expand full comment
Andy Wiranata's avatar

I have question but bit out of topic,

How do you manage burst traffic without impacted to p99 latency ?

from my experienece, spin off new instance tooks time due to "cold start"

Expand full comment
2 more comments...

No posts