Details
-
Sub-task
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
3.0.0-alpha4
-
None
-
Reviewed
Description
You can pass a negative number into S3AFileSystem.putObjectDirect, which means "put until the end of the stream". S3guard has been using this len argument: it needs to be using the actual number of bytes uploaded. Also relevant with client side encryption, when the amount of data put > the amount of data in the file or stream.
Noted in the committer branch after I added some more assertions, I've changed it there so making changes to S3AFS.putObjectDirect to pull the content length to pass in to finishedWrite() from the PutObjectResult instead. This can be picked into the s3guard branch
Attachments
Attachments
Issue Links
- depends upon
-
HADOOP-13998 Merge initial S3guard release into trunk
- Resolved
- Is contained by
-
HADOOP-13786 Add S3A committers for zero-rename commits to S3 endpoints
- Resolved