Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-4094

Pyspark on Windows missing PYTHONPATH

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.8.1
    • None
    • Interpreters, pySpark
    • None

    Description

      Using default setup will result in exception when starting local pyspark remoteinterpreter due to pyspark module not found.

      In interpreter.cmd there is a set command for PYTHONPATH to include %ZEPPLIN_HOME%\interpreter\spark\pyspark\pyspark.zip and proper %ZEPPLIN_HOME%\interpreter\spark\pyspark\py4j-*.zip, which does work (verified by debug output), but somehow the spawned python process does not inherit it.

      Workaround: Set PYTHONPATH in windows enviroment variables to include both files.

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            carsten.braess Carsten Braess
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: