Udemy - Kafka Flink End-to-end Streaming pipeline - python Handso...

Kafka Flink End-to-end Streaming pipeline: python Handson



https://DevCourseWeb.com

Published 5/2023
Created by Big Data Landscape
MP4 | Video: h264, 1280x720 | Audio: AAC, 44.1 KHz, 2 Ch
Genre: eLearning | Language: English | Duration: 15 Lectures ( 1h 19m ) | Size: 564 MB

Python Big Data Internship Program: Real Time Streaming pipeline with Kafka, Flink, Hadoop HDFS, Elasticsearch & Kibana

What you'll learn
Kafka fundamentals: Master the key concepts and functionalities of Apache Kafka for efficient data ingestion and streaming.
Flink for real-time processing: Learn how to leverage Apache Flink for real-time data processing and analytics in streaming pipelines.
Elasticsearch for indexing and search: Explore the capabilities of Elasticsearch for indexing and querying large volumes of streaming data in real time.
Visualization with Kibana: Use Kibana to create interactive visualizations and dashboards that provide insights into your streaming data pipeline.
Integrating Kafka and HDFS: Learn how to integrate Kafka with HDFS using Python to store streaming data efficiently and reliably.
Hands-on implementation: Get hands-on experience by building a Python-based solution that consumes Kafka data streams and stores them in HDFS
PyFlink for real-time processing: Utilize PyFlink for real-time data processing.
Pydoop for HDFS integration: Integrate HDFS with Python using Pydoop.
Kafka-Python for Kafka integration: Connect to Kafka and process streaming data using Kafka-Python.

Requirements
This course is designed to be beginner-friendly
Basic familiarity with Python programming language would be helpful
You will be guided through practical exercises that focus on building an end-to-end streaming pipeline using Python
Basic Knowledge on Kafka, Flink, Hadoop, Elasticsearch and Kibana