In the other blog, we saw how to read a hive table in Spark. In this blog, we will see how to read data from Oracle This will load the data from the Oracle table to the data frame. After that, we can perform any operation as per the program needs We need to pass… Read More »
In this post, we will see how to read the data from the hive table using Spark. Spark with its in-memory computation will help to perform the data processing much faster compared to the classical Map Reduce program. The above program will get the count of a hive table and print the same Also read… Read More »
There are different modes in which we can execute a spark program. This is can be done while running the Spark-submit command to Yarn in the Hadoop cluster Mode 1 – Local In this mode, both the driver and executor program will run in the same machine. Whatever logs that are added to both the… Read More »