My Tech Journal
-
Spark Tutorial Part 3: Apache Spark Architecture
In the previous post we have installed Spark development environment up and running. Now I’ll explain the Apache Spark basic concepts. These concepts will provide insight into how Spark works. Spark Architecture Spark application consist of a driver process and a set of executor processes. Driver program is the one...
-
Spark Tutorial Part 2: Setting up Spark Development Environment
Now that you know What is Spark, we’ll see how to set up and test a Spark development environment on Windows, Linux (Ubuntu), and macOS X — whatever common operating system you are using, this article should give you what you need to be able to start developing Spark applications....
-
Spark Tutorial Part 1: Apache Spark Introduction
In this first Spark article, I’ll try to answer the question “What is Spark?” and give you an in-depth overview of what makes it special. I’ll outline the main features, including some of the advanced functionality. I’ll also show you some of the main building blocks. What is Spark? Apache...