Description
The getPathSize computation in SourceTargetHelper currently makes unnecessary listStatus calls when recursing over a directory, which can cause performance issues when the filesystem is an object store such as S3. The performance can be improved with the addition of a private method to use for the getPathSize recursion that takes a known FIleStatus object as a parameter.
Attachments
Issue Links
- is related to
-
CRUNCH-658 Add a way to skip the getSize checks for Sources from object stores
- Open
- links to