Machine Learning with PySpark - Review

Main Authors: Raswitha Bandi, J. Amudhavel, R. Karthik
Format: Article Journal
Terbitan: , 2018
Subjects:
Online Access: https://zenodo.org/record/4311005
Daftar Isi:
  • A reasonable distributed memory-based Computing system for machine learning is Apache Spark. Spark is being superior in computing when compared with Hadoop. Apache Spark is a quick, simple to use for handling big data that has worked in modules of Machine Learning, streaming SQL, and graph processing. We can apply machine learning algorithms to big data easily, which makes it simple by using Spark and its machine learning library MLlib, even this can be made simpler by using the Python API PySpark. This paper presents the study on how to develop machine learning algorithms in PySpark.