Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-800

One-one edge with parallelism -1 fails if source vertex parallelism is not -1 as well

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.3.0
    • 0.5.0
    • None
    • None
    • Reviewed

    Description

      // no input initializers. At this moment, only other case is 1-1 edge
      // with uninitialized sources
      boolean hasOneToOneUninitedSource = false;
      for (Map.Entry<Vertex, Edge> entry : vertex.sourceVertices.entrySet()) {
      if (entry.getValue().getEdgeProperty().getDataMovementType() ==
      DataMovementType.ONE_TO_ONE) {
      if (entry.getKey().getTotalTasks() == -1)

      { hasOneToOneUninitedSource = true; break; }

      }
      }

      This checks for the source vertex which has the 1-1 edge to also have -1 parallelism.

      Attachments

        1. TEZ-800.2.patch
          15 kB
          Bikas Saha
        2. TEZ-800.1.patch
          13 kB
          Bikas Saha

        Issue Links

          Activity

            People

              bikassaha Bikas Saha
              rohini Rohini Palaniswamy
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: