From the course: Cloud Hadoop: Scaling Apache Spark

Unlock the full course today

Join today to access over 24,900 courses taught by industry experts.

Run WordCount of Spark with Scala

Run WordCount of Spark with Scala - Apache Spark Tutorial

From the course: Cloud Hadoop: Scaling Apache Spark

Start my 1-month free trial Buy for my team

Run WordCount of Spark with Scala

“

- [Instructor] All right, let's bring in our next notebook. Let's go to our workspace. Click here. Import. Make this a little smaller. Go over here. Let's bring the Scala notebook, just to see what that looks like. Import, maximize. Notice up top says Scala, we've got Scala code, we don't have to have the percent sign Scala because the default execution environment is Scala. Now, I can ya how to do class without word count, so I'm going to do it a little bit differently because word count is the Hello World of Hadoop and it's always fun to put a little bit different flavor on it when showing it. So for those of you who are newer to Hadoop, the reason word count is the Hello World is because of course the whole Hadoop ecosystem derived out of technologies that were originally more than 10 years ago and rented at Google to solve the problem of indexing all of the text available in the public internet. So…

Contents