Course Details
Topic 1: Overview of Apache Spark
- Understanding Apache Spark
- History of Apache Spark
- Apache Spark Architecture
- Install Apache Spark on Local Computers
- Databricks
Topic 2: Exploring Data
- Data Interface
- RDD Basic Operations
- Import Data
- Actions and Transformations
- Saving Results
Topic 3: Analyzing Data
- Select and FIlter Data
- Aggregate Data
- Save Data
Topic 4: SparkSQL
- Creating Tables
- Querying Data
- Visualizing Data
Topic 5: Machine Learning
- ML or MLlib Module
- Preprocessing Data
- Linear Regression
- Classification
Topic 6: Spark Streaming
- Streaming Setup
- Querying Streaming Data
Course Info
Prerequisite
This is an intermediate course. Participants should have basic knowledge on the following subjects:
- Python
- Apache Spark
Software Requirement
Download and unzip Apache Spark https://spark.apache.org/downloads.html.
Job Roles
- Data Scientist
- Big Data Engineer
- Data Analyst
- Machine Learning Engineer
- Business Intelligence Developer
- Research Analyst
- Software Engineer
- Back-end Developer
- Data Architect
- Full Stack Developer
- System Analyst
- Cloud Architect
- IT Manager
- Database Administrator
- DevOps Engineer
Trainers
Agus Salim : I am professional with more than 10 years of experience in Project Management, IT Solutions Management, and Systems Integration both in waterfall and agile methodology. He started out his career as a Web Developer before moving on to Business Analyst/Project Manager. He has strong leadership and the capability of leading a team with a proven ability to deliver projects with tight timelines. Besides his experiences in managing projects, he has good knowledge in Cybersecurity and hands-on experience in Next Generation Firewall such as Check Point. During his free time, he likes to explore Cloud Technology, especially on Microsoft Azure. Agus Salam is AWS cloud practitioner certified. I am also ACLP certied trainer.
Quah Chee Yong : Start-up experience in the field of Data Analytics and Digital Assistant/Chatbot. Blockchain Enthusiast. Lead Trainer (ACLP) in the field of AI/Data Science. General Management experience in Sales, Marketing, Business Development, Technical Services, Shipping/Marine & Supply Chain, HSSE/Risk Management and Support Functions Combination of Commercial, Operational and Technical background in MNCs covering the Asia Pacific region Staff/Stakeholders Management in a virtual matrix organizational setup spanning diverse cultures globally. I have obtained AWS certification.
Customer Reviews (25)
- will recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - might recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - might recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - Very diverse sharing, Dr Alvin is very knowledgeable in many areas. Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - will recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - will recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - will recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - will recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - will recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - will recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - will recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - might recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment
The other participant having issues with Zoom chat because he cant download attachments within the Zoom chat. This hampered a little on the session flow. (Posted on 4/27/2020) - might recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - will recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - Will Recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment
It was an excellent course. The coverage of Apache Spark was wonderful and complete. I felt that the trainer is a master and very passionate about the topic. I would like to commend the trainer Siva for being patient and answering queries very intelligently. Truly, he is also a fantastic teacher. (Posted on 3/24/2019) - Will Recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - Will Recommend Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - Might Recomemnd Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - Might Recomemnd Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment - Trainer was very knowledgeable but deviated from course objectives. Review by Course Participant/Trainee
-
1. Do you find the course meet your expectation? 2. Do you find the trainer knowledgeable in this subject? 3. How do you find the training environment