Hands on course - Real Time Data Streaming Pipeline using Confluent Kafka, GCP & Looker from scratch

What you'll learn
- Able to build Enterprise Grade, scalable data pipeline using Confluent Kafka & Google Cloud Platforms
- Configure, use and trouble shoot setting up of Google cloud Platform services like Buckets, Cloud Data Fusion
- Configure, use and trouble shoot setting up of Confluent Cluster, Topic, Keys etc
- Configure, use and trouble shoot setting up of Confluent managed Sink & Source Connectors
- Configure, use and trouble shoot setting up of Google cloud Platform reporting services like Looker

Requirements
- No programming experience needed
- Able to create free confluent kafka account to follow along
- Able to create free GCP - Google Cloud Platform account to follow along

Description
Course Overview

In this hands-on course, participants will follow a step-by-step approach to build areal-time streaming analytics data pipelinethat integrates Confluent Kafka with Google Cloud Platform services. Learners will design a pipeline that streams data from Kafka into Google Cloud Storage, processes it with Dataflow, stores it in BigQuery, and finally visualizes operational insights using Looker Studio. This practical journey ensures participants not only grasp the concepts but also apply them directly in a cloud-native environment.

Google Cloud Platform Experience

On the GCP side, participants will gain exposure to key services includingCloud Storage, Dataflow, BigQuery, and Looker Studio. They will also learn essential skills inlogging, monitoring, troubleshooting, and configuration, which are critical for building secure, scalable, and reliable streaming applications in the cloud.

Confluent Kafka Experience

On the Kafka side, learners will set up afully managed Kafka cluster, create topics for message streaming, configure a DatagenSource Connectorto simulate real-world data ingestion, and integrate with GCP Storage Sink Connector. This provides valuable hands-on experience with enterprise-grade Kafka infrastructure—without the complexity of managing it manually.

Learning Outcomes

By the end of the course, participants will have:

Built aworking, scalable streaming analytics pipeline.

Gained insights intocloud-native architecturesand streaming design patterns.

Acquiredhands-on skillsdirectly applicable to real-world projects and professional roles.

Who Should Attend

This course is ideal forCloud Engineers, Data Engineers, Product Owners, Product Managers, Scrum Masters, and Technology Leadersseeking practical experience in buildingreal-time streaming analytics pipelineswith Confluent Kafka and Google Cloud.

Who this course is for:
- Entry Level Data Engineers who want to learn about building Data pipelines using Confluent Kafka & Google Cloud Platforms
- Entry Level Cloud Engineers who want to learn about building Data pipelines using Confluent Kafka & Google Cloud Platforms
- Mid to Sr. Level Data Engineers who want to get exposure on building Data pipelines using Confluent Kafka & Google Cloud Platforms
- Product Managers/Product Owners who want to get exposure on building Data pipelines using Confluent Kafka & Google Cloud Platforms
- Technology Leaders who want to get exposure on building Data pipelines using Confluent Kafka & Google Cloud Platforms
More Info