Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-5275

Pyspark interpreter missing java imports

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.9.1, 0.10.0
    • pySpark
    • None

    Description

      The pyspark bootstrap scripts are missing some of the `java_imports` that are in the native spark java gateway: https://github.com/apache/spark/blob/master/python/pyspark/java_gateway.py#L152

       

      Most obvious thing that doesn't work is using df.explain() from pyspark.

      Attachments

        Activity

          People

            kimahriman Adam Binford
            kimahriman Adam Binford
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 50m
                50m