Uploaded image for project: 'Apache Whirr (retired)'
  1. Apache Whirr (retired)
  2. WHIRR-506

Support elastic mapreduce in whirr

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • cli, core

    Description

      This is to be an umbrella issue in the path towards having multicloud EMR with whirr.

      Some of the things that must happen towards multicloud EMR (as discussed in IRC):

      • Hadoop deployment must be "rock solid"
      • Submitting and monitoring an hadoop mapreduce job through whirr
      • distcp from blobstore to hadoop/hbase cluster
      • cli component for job submission and monitoring.

      Some of the things that would be nice to have additionally:

      • pig service
      • hive service
      • sqoop service
      • regular+spot instances in EMR
      • multistage provisioning (different cluster sizes for different phases)

      Attachments

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. WHIRR-214 Add/Remove nodes to/from running clusters

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. WHIRR-567 Implement distcp in whirr

          • Major - Major loss of function.
          • Open
          is related to

          New Feature - A new feature of the product, which has yet to be developed. WHIRR-529 GSoC 2012: Add new services to Apache Whirr

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              dr-alves David Alves
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: