Monthly Archives: January 2016

Spark-shell on yarn resource manager: Basic steps to create hadoop cluster and run spark on it

Knoldus Blogs In this blog we will install and configure hdfs and yarn with minimal configuration to create a local machine cluster. After that we will try to submit job to yarn cluster with the help of spark-shell, So lets … Continue reading

Posted in Scala | Leave a comment

Congregating Spark files on S3

Knoldus Blogs We all know that Apache Spark is a fast and general engine for large-scale data processing and it is because of its speed that Spark was able to become one of the most popular frameworks in the world of big data. … Continue reading

Posted in Scala | Leave a comment

Fundamentals of eXtreme Programming

Knoldus Blogs The term Extreme Programming (XP) was coined by Kent Beck, in late 1990s.  The purpose behind inventing XP was to find a way to deliver high quality software, developed by small teams, and to keep up with the changing requirements … Continue reading

Posted in Scala | Leave a comment