Apache spark:- Maximum temperature in a file using scala

HI, in this blog I will explain how to find the maximum temperature in a text file     We need to configure eclipse with spark first which is already described in earlier blog     Sample input:- 91    67    Agra  Uttar Pradesh     33    19 90    67    Allahabad   Uttar Pradesh     32    19 87    60    Amritsar   … Read More Apache spark:- Maximum temperature in a file using scala

Spark Streaming :- Word Counts in a folder for text files

Hi,   In this blog i will write a program for spark streaming which will read textfiles in a folder on regular basis and print the word counts program as follows imp :- i use maven in this( u can find mavan dependency in my previous post) import org.apache.spark.SparkConf import org.apache.spark.storage.StorageLevel import org.apache.spark.streaming._ import org.apache.spark.streaming.StreamingContext._… Read More Spark Streaming :- Word Counts in a folder for text files

Apache Spark :- Configure Spark on Windows with Eclipse

Hi Guys , in this post i am going to write about integration of spark with eclipse using Maven in Windows   Open eclipse and install scala IDE using eclipse marketplace Help ->eclipse marketplace Now let’s create a scala program with spark by following below steps:   Create new project (scala project) Change this project… Read More Apache Spark :- Configure Spark on Windows with Eclipse

Scala : Map function example using eclipse

For integration of scala with eclipse please refer blog :- https://haritbigdata.wordpress.com/2016/01/15/add-scala-ide-with-eclipse/ As we Know Map works by applying a function to each element in the list.   Following program will help you :-   object helloworld1 extends App{ //System.out.print(“hello”); val lines = Array(“hello”,”hw are you”,”hw you there”); val count = lines.length; println(count); //val filter1=lines.filter(_.contains(“hw”)); val… Read More Scala : Map function example using eclipse