Speaker
Dalibor Ječmenica
Principal DWH/BI Engineer
Telesign
Talk
From an hour to a few seconds: real-time stream data processing with fully managed AWS Kinesis services
Biography
Principal DWH/BI engineer at Telesign with 10 years of experience designing and implementing data and analytics solutions including data lakes, data warehouses, near real-time data systems, and business intelligence systems using cloud services and on-premise tools. Enthusiastic abouT data and technology.
Excerpt
To process data in real-time to derive insights and act upon it quickly, an enterprise needs to build an end-to-end real-time data processing system from data acquisition, data ingestion, data processing, and building platform to serving and sharing the results. In this talk, we will describe the use case we were trying to solve at Telesign. We will present the overall architecture of our scalable cloud solution and share how we leveraged AWS fully managed services Kinesis Data Stream and Kinesis Data Analytics (based on Apache Flink) to build real-time exactly-once stream data processing system.