Streaming Data Pipeline with Apache Flink

At QuadX, we are big fan of Kafka Consumers in Apache Kafka data ingestion. Recently, we looked into Apache Flink as Streaming Data Pipeline and ETL platform, Apache Kafka as Source and Google BigQuery as Sink.

What is Apache Flink? Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams. Flink has been designed to run in all common cluster environments, perform computations at in-memory speed and at any scale. - https://flink.apache.org/