Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-14039

WriteToBigQuery doesn't propagate ignore_unknown_columns parameter

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • P1
    • Resolution: Fixed
    • 2.36.0, 2.37.0
    • 2.38.0
    • io-py-gcp
    • None

    Description

      A new parameter, ignore_unknown_columns was added to WriteToBigQuery in https://issues.apache.org/jira/browse/BEAM-9706. We found out that setting this parameter to True doesn't have any effect right now because it's not passed to _StreamToBigQuery under the hood. 

      Attachments

        Issue Links

          links to

          Web Link GitHub Pull Request #16999

          Activity

            People

              jkukul Jakub Kukul
              jkukul Jakub Kukul
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 20m
                  2h 20m