Skip to content Skip to sidebar Skip to footer
Showing posts with the label Apache Spark 2.0

Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table

I have Hortonworks HDP 2.6.3 running Spark2 (v2.2). My test case is very simple: Create a Hive tab… Read more Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table

Pyspark : Keyerror When Converting A Dataframe Column Of String Type To Double

I'm trying to learn machine learning with PySpark. I have a dataset that has a couple of String… Read more Pyspark : Keyerror When Converting A Dataframe Column Of String Type To Double