Details
-
Bug
-
Status: Resolved
-
P2
-
Resolution: Fixed
-
None
-
None
Description
When a BigQuery load job fails, we only say that it failed, but don't show the error message.
https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2339 doesn't put the jobStatus in the exception, and https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java#L2332 doesn't even log it.
User who hit the issue: http://stackoverflow.com/questions/41406891/bigquery-loads-manually-but-not-through-the-java-sdk (though this is using the Dataflow SDK so it'll need to be backported from Beam to Dataflow, or the user will need to use Beam once the issue is fixed)
Attachments
Issue Links
- links to