Uploaded image for project: 'Apache DataLab (Retired)'
  1. Apache DataLab (Retired)
  2. DATALAB-2428

[GCP][Investigation][Dataproc][Apache Standalone cluster] Often Flights_data_Preparation/Visualisation_R playbooks fail

ResolvedReopenedClosedVerifiedBlockedon hold
    XMLWordPrintableJSON

Details

    Description

      Preconditions:

      1. Dataproc is running on Jupyter

      Steps to reproduce:

      1. Run Flights_data_Preparation/Visualisation_R on Dataproc

      Actual result:

      1. Flights_data_Preparation/Visualisation_R running fails

      Dataproc:

      An error was encountered:
      Spark package found in SPARK_HOME: /usr/lib/spark
      [1] "Error in writeJobj(con, object): invalid jobj 1"
      

      Apache Standalone cluster:

      An error was encountered:
      Spark package found in SPARK_HOME: /opt/spark
      [1] "Error in writeJobj(con, object): invalid jobj 1"
      

      Expected result:

      1. Flights_data_Preparation/Visualisation_R running is running succesfully

       

      Attachments

        1. Dataproc R.png
          97 kB
          Vira Vitanska

        Activity

          People

            lfrolov Leonid Frolov
            vvitanska Vira Vitanska
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: