Tag: Spark

• Day 9

  Spark (Con’t) Execution step Tutorial 9 Tutorial 10

  Kim Ng

  April 22, 2023

  Master, Module – BDAT

  Spark, Tutorial

• Day 8

  Spark Cluster computing framework, processing framework using memory. To overcome map reduce performance issue. Cluster manager resource allocation base on job (request). Spark create Resilient Distributed Datasets (RDD) :: partition once it receive the data. Once RDD is ready, it uses graph transformation (Directed Acyclic Graph DAG) Consists of 2 phases: Transformation and Action **…

  Kim Ng

  April 21, 2023

  Master, Module – BDAT

  Spark, Tutorial