Uploaded image for project: 'TinkerPop'
  1. TinkerPop
  2. TINKERPOP-1525

Plug VertexProgram iteration leak on empty Spark RDD partitions

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.2.3
    • 3.2.4
    • hadoop
    • None

    Description

      If SparkExecutor gets an RDD with empty partitions, it can invoke VertexProgram.workerIterationStart without ever invoking VertexProgram.workerIterationEnd.

      For vertex programs that allocate and release meaningful resources in the start/end methods, this can lead to resource leaks.

      I already tested a fix that I made against the 3.2 series. I will submit PRs momentarily.

      Attachments

        Activity

          People

            Unassigned Unassigned
            dalaro Dan LaRocque
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: