Red Hat Research Days: The Future of Big Data: Massive Real-Time Data Streams
The first Research Days event of 2021 will take place on March 2nd from 15:30 to 17:00 IST (08:30 EST, 14:30 CET). The agenda for this session includes a talk titled “The Future of Big Data: Massive Real-Time Data Streams” by Dr. Ilya Kolchinsky and a subsequent interactive discussion led by Oren Oichman addressing questions, concerns, and advanced aspects of the topic.
About the Talk:
As we enter the era of Big Data, a large number of data-driven systems and applications have become an integral part of our daily lives, and this trend is accelerating dramatically. It is estimated that 1.7MB of data is created every second for every person on Earth, for a total of over 2.5 quintillion bytes of new data every day, reaching 163 zettabytes by 2025. In addition to the growing volume, velocity, and variety of continuously generated data, novel technological trends such as edge processing, IoT, 5G, and federated AI bring new requirements for faster processing and deeper, more computationally heavy data analysis. Therefore, we can no longer rely on the “old school” data processing mechanisms, and a new paradigm is needed.
In this talk, we will explore this new paradigm, which we call Big Data Stream Processing (BDSP). BDSP comprises a variety of methods for scalable and efficient data processing that do not rely on traditional databases for storing and processing the data. We will cover examples of real-life applications that can greatly benefit from incorporating BDSP capabilities.
In particular, we will cover:
– On-the-fly detection of complex patterns in streaming data
– Stream-oriented machine learning and data mining
The talk will be given in English.
Speaker: Ilya Kolchinsky, Senior Software Engineer at Red Hat
Conversation Leader: Oren Oichman, Senior Cloud Consultant at Red Hat
Session recording