Details
-
Bug
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
0.8.2
-
None
-
Amazon Elastic Map Reduce
Zeppelin 0.8.2
Description
Zeppelin table display is converting strings that appear to be scientific notation into a numeric. In this case, these are value codes, not numeric values. This is causing data to be displayed incorrectly. This also effects the data if exported from the result set.
%pyspark data = [["Test1", "10E00"], ["Test2", "12E10"], ["Test3", "10E00000"], ["Test4", "10EAA"], ["Test5", "12E01"], ["Test6", "12E00"]] columns = ["Name", "Value"] df = spark.createDataFrame(data, columns) df.show() z.show(df)
+-----+--------+ | Name| Value| +-----+--------+ |Test1| 10E00| |Test2| 10E10| |Test3|10E00000| |Test4| 10EAA| |Test5| 12E01| |Test6| 12E00| +-----+--------+
Name | Value |
---|---|
Test1 | 10 |
Test2 | 10000000000 |
Test3 | 10 |
Test4 | 10EAA |
Test5 | 120 |
Test6 | 12 |