PySpark for Big Data

SpiralTrain BV

In the course PySpark for Big Data participants learn to use Apache Spark from Python.

Prijs

vanaf € 2.550

Niveau

Niet opgegeven

Soort

Training

Thema

Automatisering en ICT, Opleiden en onderwijs

Meer informatie en aanmelden bij SpiralTrain BV

Beschrijving

Spark Architecture The course PySpark for Big Data discusses the architecture of Spark, the Spark Cluster Manager and the difference between Batch and Stream Processing. Hadoop After a discussion of the Hadoop Distributed File System, parallel operations and working with RDDs, Resilient Distributed Datasets are discussed in the course PySpark for Big Data. The configuration of PySpark applications via SparkConf and SparkContext is also explained. MapReduce en SQL Extensive consideration is given to the possible operations on RDDs, including map and reduce. The use of SQL in Spark is also discussed. The GraphX library is discussed and DataFrames is discussed. Iterative algorithms are also treated. Mlib library Finally the course PySpark for Big Data pays attention to machine learning with the Mlib library. Audience PySpark for Big Data The course PySpark for Big Data is intended for developers and upcoming Data Analysts who want to learn how to use Apache Spark from Python. Prerequisites training PySpark for Big Data To participate in this course, some experience with programming is beneficial for understanding.