Apache Kafka for Python Programmers Training Course

This instructor-led, live training in China (online or onsite) is aimed at data engineers, data scientists, and programmers who wish to use Spark Streaming features in processing and analyzing real-time data.

By the end of this training, participants will be able to use Spark Streaming to process live data streams for use in databases, filesystems, and live dashboards.

This instructor-led, live training in China (online or onsite) is aimed at developers who wish to implement Apache Kafka stream processing without writing code.

By the end of this training, participants will be able to:

• Install and configure Confluent KSQL.
• Set up a stream processing pipeline using only SQL commands (no Java or Python coding).
• Carry out data filtering, transformations, aggregations, joins, windowing, and sessionization entirely in SQL.
• Design and deploy interactive, continuous queries for streaming ETL and real-time analytics.

This instructor-led, live training in China (online or onsite) is aimed at developers who wish to learn the principles behind persistent and pure in-memory storage as they step through the creation of a sample in-memory computing project.

By the end of this training, participants will be able to:

• Use Ignite for in-memory, on-disk persistence as well as a purely distributed in-memory database.
• Achieve persistence without syncing data back to a relational database.
• Use Ignite to carry out SQL and distributed joins.
• Improve performance by moving data closer to the CPU, using RAM as a storage.
• Spread data sets across a cluster to achieve horizontal scalability.
• Integrate Ignite with RDBMS, NoSQL, Hadoop and machine learning processors.

Apache Beam is an open source, unified programming model for defining and executing parallel data processing pipelines. It's power lies in its ability to run both batch and streaming pipelines, with execution being carried out by one of Beam's supported distributed processing back-ends: Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow. Apache Beam is useful for ETL (Extract, Transform, and Load) tasks such as moving data between different storage media and data sources, transforming data into a more desirable format, and loading data onto a new system.

In this instructor-led, live training (onsite or remote), participants will learn how to implement the Apache Beam SDKs in a Java or Python application that defines a data processing pipeline for decomposing a big data set into smaller chunks for independent, parallel processing.

By the end of this training, participants will be able to:

• Install and configure Apache Beam.
• Use a single programming model to carry out both batch and stream processing from withing their Java or Python application.
• Execute pipelines across multiple environments.

Format of the Course

• Part lecture, part discussion, exercises and heavy hands-on practice

Note

• This course will be available Scala in the future. Please contact us to arrange.

Apache Apex is a YARN-native platform that unifies stream and batch processing. It processes big data-in-motion in a way that is scalable, performant, fault-tolerant, stateful, secure, distributed, and easily operable.

This instructor-led, live training introduces Apache Apex's unified stream processing architecture, and walks participants through the creation of a distributed application using Apex on Hadoop.

By the end of this training, participants will be able to:

• Understand data processing pipeline concepts such as connectors for sources and sinks, common data transformations, etc.
• Build, scale and optimize an Apex application
• Process real-time data streams reliably and with minimum latency
• Use Apex Core and the Apex Malhar library to enable rapid application development
• Use the Apex API to write and re-use existing Java code
• Integrate Apex into other applications as a processing engine
• Tune, test and scale Apex applications

Format of the Course

• Interactive lecture and discussion.
• Lots of exercises and practice.
• Hands-on implementation in a live-lab environment.

Course Customization Options

• To request a customized training for this course, please contact us to arrange.

Apache Storm is a distributed, real-time computation engine used for enabling real-time business intelligence. It does so by enabling applications to reliably process unbounded streams of data (a.k.a. stream processing).

"Storm is for real-time processing what Hadoop is for batch processing!"

In this instructor-led live training, participants will learn how to install and configure Apache Storm, then develop and deploy an Apache Storm application for processing big data in real-time.

Some of the topics included in this training include:

• Apache Storm in the context of Hadoop
• Working with unbounded data
• Continuous computation
• Real-time analytics
• Distributed RPC and ETL processing

Request this course now!

Audience

• Software and ETL developers
• Mainframe professionals
• Data scientists
• Big data analysts
• Hadoop professionals

Format of the course

•     Part lecture, part discussion, exercises and heavy hands-on practice

In this instructor-led, live training in China (onsite or remote), participants will learn how to deploy and manage Apache NiFi in a live lab environment.

By the end of this training, participants will be able to:

• Install and configure Apachi NiFi.
• Source, transform and manage data from disparate, distributed data sources, including databases and big data lakes.
• Automate dataflows.
• Enable streaming analytics.
• Apply various approaches for data ingestion.
• Transform Big Data and into business insights.

In this instructor-led, live training in China, participants will learn the fundamentals of flow-based programming as they develop a number of demo extensions, components and processors using Apache NiFi.

By the end of this training, participants will be able to:

• Understand NiFi's architecture and dataflow concepts.
• Develop extensions using NiFi and third-party APIs.
• Custom develop their own Apache Nifi processor.
• Ingest and process real-time data from disparate and uncommon file formats and data sources.

This instructor-led, live training in China (online or onsite) introduces the principles and approaches behind distributed stream and batch data processing, and walks participants through the creation of a real-time, data streaming application in Apache Flink.

By the end of this training, participants will be able to:

• Set up an environment for developing data analysis applications.
• Understand how Apache Flink's graph-processing library (Gelly) works.
• Package, execute, and monitor Flink-based, fault-tolerant, data streaming applications.
• Manage diverse workloads.
• Perform advanced analytics.
• Set up a multi-node Flink cluster.
• Measure and optimize performance.
• Integrate Flink with different Big Data systems.
• Compare Flink capabilities with those of other big data processing frameworks.

This instructor-led, live training in China (online or onsite) is aimed at intermediate-level Python developers and data analysts who wish to enhance their skills in data analysis and manipulation using Pandas and NumPy.

By the end of this training, participants will be able to:

• Set up a development environment that includes Python, Pandas, and NumPy.
• Create a data analysis application using Pandas and NumPy.
• Perform advanced data wrangling, sorting, and filtering operations.
• Conduct aggregate operations and analyze time series data.
• Visualize data using Matplotlib and other visualization libraries.
• Debug and optimize their data analysis code.

This instructor-led, live training in China (online or onsite) is aimed at data scientists and developers who wish to use Modin to build and implement parallel computations with Pandas for faster data analysis.

By the end of this training, participants will be able to:

• Set up the necessary environment to start developing Pandas workflows at scale with Modin.
• Understand the features, architecture, and advantages of Modin.
• Know the differences between Modin, Dask, and Ray.
• Perform Pandas operations faster with Modin.
• Implement the entire Pandas API and functions.

This instructor-led, live training in China (online or onsite) is aimed at data scientists who wish to use Pandas to preform predictive analysis with machine learning.

By the end of this training, participants will be able to:

• Perform data wrangling in Python.
• Conduct ETL operations for machine learning.
• Create data visualizations with Pandas

This instructor-led, live training in China (online or onsite) is aimed at data scientists and software engineers who wish to use Dask with the Python ecosystem to build, scale, and analyze large datasets.

By the end of this training, participants will be able to:

• Set up the environment to start building big data processing with Dask and Python.
• Explore the features, libraries, tools, and APIs available in Dask.
• Understand how Dask accelerates parallel computing in Python.
• Learn how to scale the Python ecosystem (Numpy, SciPy, and Pandas) using Dask.
• Optimize the Dask environment to maintain high performance in handling large datasets.

This instructor-led, live training in (online or onsite) is aimed at developers who wish to use the FARM (FastAPI, React, and MongoDB) stack to build dynamic, high-performance, and scalable web applications.

By the end of this training, participants will be able to:

• Set up the necessary development environment that integrates FastAPI, React, and MongoDB.
• Understand the key concepts, features, and benefits of the FARM stack.
• Learn how to build REST APIs with FastAPI.
• Learn how to design interactive applications with React.
• Develop, test, and deploy applications (front end and back end) using the FARM stack.

This instructor-led, live training in China (online or onsite) is aimed at developers who wish to use FastAPI with Python to build, test, and deploy RESTful APIs easier and faster.

By the end of this training, participants will be able to:

• Set up the necessary development environment to develop APIs with Python and FastAPI.
• Create APIs quicker and easier using the FastAPI library.
• Learn how to create data models and schemas based on Pydantic and OpenAPI.
• Connect APIs to a database using SQLAlchemy.
• Implement security and authentication in APIs using the FastAPI tools.
• Build container images and deploy web APIs to a cloud server.