How Re2 Shattered My Bottleneck
One pleasant morning I got to work, thinking this day couldn't get any better. But as Murphy would have it, there was my boss walking frantically toward me.
It turned out that almost over night one of the main data pipeline systems had become a major bottleneck for the company, and a solution was needed, Fast!
Usually in a startup, let alone a company moving as fast as Taboola, these things can occur on a weekly basis.
I needed to find some quick wins to relieve some of the bottlenecks inside the system.
Luckily Re2 was there to the rescue – in this post I will share how to find the bottlenecks using Gprof2dot beautiful image rendering, and of course, what Re2 is and how to use it.
* Note that this article addresses a pain I had in a Python framework, but because there are Re2 implementations to all major languages you should still find value reading this article.
The strategy to relieve bottlenecks is pretty straightforward
Step one: Recognize were it hurts the most
Step two: Reduce the pain
Step three: Iterate back to step one until you get the desired result
Read full article from How Re2 Shattered My Bottleneck
No comments:
Post a Comment