Write For Us

Spark Tutorial For Beginners | What is Spark | Apache Spark Training | Edureka

E-Commerce Solutions SEO Solutions Marketing Solutions
140 Views

  • Thanks! Share it with your friends!

    You disliked this video. Thanks for the feedback!

ava
Published
( Apache Spark Training - https://www.edureka.co/apache-spark-scala-training )
Apache Spark Blog Series: https://goo.gl/WrEKX9

Apache Spark, developed by Apache Software Foundation, is an open-source big data processing and advanced analytics engine. It allows developers to develop applications in Scala, Python and Java. This video provides detailed knowledge about various features of this high-speed cluster-computing framework and also Scala, the language in which Spark has been written.

Course Objectives

After completing the Apache Spark & Scala course, you will be able to:
1) Understand Scala and its implementation
2) Apply Control Structures, Loops, Collection, and more.
3) Master the concepts of Traits and OOPS in Scala
4) Understand functional programming in Scala
5) Get an insight into the big data challenges
6) Learn how Spark acts as a solution to these challenges
7) Install Spark and implement Spark operations on Spark Shell
8) Understand the role of RDDs in Spark
9) Implement Spark applications on YARN (Hadoop)
10) Stream data using Spark Streaming API
11) Implement machine learning algorithms in Spark using MLlib API
12) Analyze Hive and Spark SQL architecture
13) Implement SparkSQL queries to perform several computations
14) Understand GraphX API and implement graph algorithms
15) Implement Broadcast variable and Accumulators for performance tuning

Project Work

Project #1: Design a system to replay the real time replay of transactions in HDFS using Spark.
Technologies Used:
1. Spark Streaming
2. Kafka (for messaging)
3. HDFS (for storage)
4. Core Spark API (for aggregation)

Project #2: Drop-page of signal during Roaming
Industry: Telecom Industry
Problem Statement: You will be given a CDR (Call Details Record) file, you need to find out top 10 customers facing frequent call drops in Roaming. This is a very important report which telecom companies use to prevent customer churn out, by calling them back and at the same time contacting their roaming partners to improve the connectivity issues in specific areas.

For more information, please write back to us at [email protected]
Call us at US : 1800 275 9730 (toll free) or India : +91-8880862004
Category
शिक्षा - Education
Sign in or sign up to post comments.
Be the first to comment