Above: Twitter's logo featured in the lobby of its San Francisco headquarters. Image Credit: Ken Yeung/VentureBeat Twitter is today releasing its Heron real-time stream processing engine under an open-source Apache license on GitHub . Twitter first published a paper documenting Heron last year , but the software has been proprietary, until now. Written in C++, Java, and Python, Heron is a successor to the Storm stream-processing engine that Twitter built and then open-sourced in 2011. Heron offers considerable performance gains relative to Storm. "Heron is a streaming system that was born out of the challenges we faced due to increases in volume and diversity of data being processed, as well as the number of use cases for real-time analytics," Twitter engineering manager Karthik Ramasamy wrote in a blog post . "We needed a system that scaled better, was easier to debug, had better performance, was easier to deploy and manage, and worked in a shared multi-tenant cluster environment.
Read full article from Twitter open-sources Heron, its real-time stream-processing engine | VentureBeat | Dev | by Jordan Novet
No comments:
Post a Comment