Monthly Archives: June 2015

Spark Streaming Gnip :- An Apache Spark Utility to pull Tweets from Gnip in realtime

Knoldus Blogs We all are familiar with Gnip, Inc. which provides data from dozens of social media websites via a single API. It is also known as the Grand Central Station for social media web. One of its popular API … Continue reading

Posted in Scala | Leave a comment

Start/Deploy Apache Spark application programmatically using spark launcher

Knoldus Blogs Sometimes we need to start our spark application from the another scala/java application. So we can use SparkLauncher. we have an example in which we make spark application and run it with another scala application. Let see our … Continue reading

Posted in Scala | Leave a comment

Stateful transformation on Dstream in apache spark with example of wordcount

Knoldus Blogs Sometimes we have a use-case in which we need to maintain state of paired Dstream to use it in next Dstream . So we are taking a example of stateful wordcount in socketTextStreaming. Like in wordcount example if … Continue reading

Posted in Scala | Leave a comment

Apache spark + cassandra: Basic steps to install and configure cassandra and use it with apache spark with example

Knoldus Blogs To build an application using apache spark and cassandra you can use the datastax spark-cassandra-connector to communicate with spark. Before we are going to communicate with spark using connector we should know how to configure cassandra. So following … Continue reading

Posted in Scala | Leave a comment

Easiest Way to connect with Couchbase using Scala

Knoldus Blogs In this blog, we have explained¬†how easily we can connect with Couchbase, store and fetch data ¬†using scala through an example. Tools and technologies used : SBT 0.13.8 Scala 2.11.6 Couchbase Server 4.0 Beta Eclipse JDK 1.7 Please … Continue reading

Posted in Scala | Leave a comment

Play 2.4.X : Microservice Architecture using Play and Scala

Knoldus Blogs Playing-Microservices This blog describes a basic Microservice architecture design using Play 2.4.X and Scala. The big idea behind microservices is to architect large, complex and long-lived applications as a set of cohesive services that evolve over time. The … Continue reading

Posted in Scala | Leave a comment