PySpark for Big Data

SpiralTrain BV

In the course PySpark for Big Data participants learn to use Apache Spark from Python.

Price

from €2,550

Level

Not specified

Kind

Training

Subject

Automation and IT, Training and education

More information and registration at SpiralTrain BV

Description

Spark Architecture The course PySpark for Big Data discusses the architecture of Spark, the Spark Cluster Manager and the difference between Batch and Stream Processing. Hadoop After a discussion of the Hadoop Distributed File System, parallel operations and working with RDDs, Resilient Distributed Datasets are discussed in the course PySpark for Big Data. The configuration of PySpark applications via SparkConf and SparkContext is also explained. MapReduce en SQL Extensive consideration is given to the possible operations on RDDs, including map and reduce. The use of SQL in Spark is also discussed. The GraphX library is discussed and DataFrames is discussed. Iterative algorithms are also treated. Mlib library Finally the course PySpark for Big Data pays attention to machine learning with the Mlib library. Audience PySpark for Big Data The course PySpark for Big Data is intended for developers and upcoming Data Analysts who want to learn how to use Apache Spark from Python. Prerequisites training PySpark for Big Data To participate in this course, some experience with programming is beneficial for understanding.