Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-220

Transparent archival and restore of files from HDFS

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • None
    • None

    Description

      There should be a facility to migrate old files away from a production cluster. Access to those files from applications should continue to work transparently, without changing application code, but maybe with reduced performance. The policy engine that does this could be layered on HDFS rather than being built into HDFS itself.

      Attachments

        1. archival.pdf
          77 kB
          Dhruba Borthakur
        2. dfscron.txt
          7 kB
          Rodrigo Schmidt
        3. migrator.txt
          6 kB
          Dhruba Borthakur

        Issue Links

          depends upon

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-1869 access times of HDFS files

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HDFS-245 Create symbolic links in HDFS

          • Major - Major loss of function.
          • Closed
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-642 distcp could have an option to preserve the full source path

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-5620 discp can preserve modification times of files

          • Major - Major loss of function.
          • Closed

          Activity

            People

              dhruba Dhruba Borthakur
              dhruba Dhruba Borthakur
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: