Answer by G.V. Sridhar for Spark Streaming failing on YARN Cluster

I was able to solve this by providing the driver memory and executor memory at run time.

spark-submit --driver-memory 1g --executor-memory 1g --class com.package.App --master yarn --deploy-mode cluster /home/spark.jar