XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.2.0
    • 0.19.0
    • None
    • None

    Description

      Currently we return a null String array to the MR framework to use a random node for MR job assignment.

      class: org.apache.hadoop.hbase.mapred.tableSplit
      function getLocations()

      We should be able to query the meta now for the current host name of the server hosting the region in question.
      This will help with scaling as there will be less cross server communication removing bandwidth as a bottleneck.

      The side effect of fixing this will help from overloading region servers with lots of MR clients all pulling from the same region server while theres work local for them to do.

      Attachments

        1. hbase-675-v1.patch
          2 kB
          Jean-Daniel Cryans
        2. arthur.patch
          15 kB
          Michael Stack
        3. 675-v2.patch
          13 kB
          Michael Stack
        4. network.png
          110 kB
          Michael Stack

        Issue Links

          Activity

            People

              stack Michael Stack
              viper799 Billy Pearson
              Votes:
              2 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: