Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-980

Investigate if we should close() the FileSystems in MapRed task implementations.

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • sprint-5
    • sprint-7
    • hadoop
    • None

    Description

      Search for usages of org.apache.ignite.internal.processors.hadoop.HadoopUtils#fileSystemForMrUser and see if returned Fs should be closed.
      Now the policy is straightforward: if we take the Fs with caching, we don't close it. If we take it w/o caching, we close it.
      We also may add closing of all the cached instances upon Ignite node stop.

      Attachments

        1. IGNITE-980--a.patch
          30 kB
          Ivan Veselovsky
        2. IGNITE-980--b.patch
          62 kB
          Ivan Veselovsky
        3. IGNITE-980--c.patch
          63 kB
          Ivan Veselovsky

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. IGNITE-1044 HadoopJob#dispose(bool) should be called for each HadoopJob instance in any case

          • Major - Major loss of function.
          • Closed

          Activity

            People

              iveselovskiy Ivan Veselovsky
              iveselovskiy Ivan Veselovsky
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: