top of page

The Big Data Blog
Optimization of spark job
In This blog post I will guide you on how can you improve the performance of spark job
Jun 301 min read


Create Spark DataFrame from string column
how to create spark Data Frame from a string value in java can be done in few steps like below Here are some code in java programming to...
Jun 16, 20211 min read


Parsing the nested XML fields in Spark
processing XML data is challenging which can be solved in spark using udf and xpath Here we are putting some practical code which can be...
Jun 16, 20211 min read


Apache Cassandra in GCP (Google Cloud Platform)
Deployment of Apache Cassandra NoSql database on GCP and use cassandra query language on cloud shell. Let's start instead going with...
May 16, 20212 min read


ThingsBoard IOT customization
As most of us already know that IOT getting popular day by day and it's giving good opportunity to make business more stable and...
Oct 25, 20201 min read


net::ERR_CONNECTION_REFUSED ionic
web page not able to load http://localhost/ ionic issue If you are reading this means i assume you already know about IONIC platform and...
Oct 11, 20202 min read


Common ERROR on spark in Scala, Java or python
ImportError: cannot import name SparkSession java.io.EOFException database not found , table not found. Hello, today we are going to...
Jul 1, 20202 min read


Pyspark example to process CSV file
Pyspark is combination of 2 part: Spark Python Spark is open source distributed processing framework which do in-memory processing which...
Jun 30, 20202 min read
bottom of page