This is the 3rd post in the Stream Processing focus series. Last week, we had a look at how stream processing could help us compute mathematical approximations using Hazelcast Jet. We described the Pipeline API, and mentioned that it drew from a source and drained to a sink. This week, I’d like to detail those concepts, what out-of-the-box sinks and sources are available in Jet, and how to create your own should the need be.
This is the 1st post in the Stream Processing focus series. If software is eating the world, data is the new oil. Those who are able to best manage the huge mass of data will emerge out on top. The state-of-the-art way to refine this oil is stream processing. In this post, I’d like to describe what is stream processing, and why it’s necessary in this day and age.