Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3981

UnorderedPartitionedKVWriter.getInitialMemoryRequirement may return negative memory

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.9.1
    • 0.9.2, 0.10.0
    • None
    • None

    Description

      The reason for this is because here first we shift the int, and then we assign it to the long, therefore if the int is bigger than 2^12 when shifting 20 it becomes a negative value. We should cast to long and then do the shift.

      Attachments

        1. TEZ-3981.1.patch
          1 kB
          Jaume M

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. TEZ-4262 Integer overflow in unordered.output.buffer.size-mb

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. TEZ-4262 Integer overflow in unordered.output.buffer.size-mb

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link GitHub Pull Request #31

          Activity

            People

              jmarhuen Jaume M
              jmarhuen Jaume M
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: