Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-34903

Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables

    XMLWordPrintableJSON

Details

    • [features] Add mysql-pipeline-connector with tables.exclude option to exclude unnecessary tables
    • Patch

    Description

          When using the MySQL Pipeline connector for whole-database synchronization, users currently cannot exclude unnecessary tables. Taking reference from Debezium's parameters, specifically the table.exclude.list, if the table.include.list is declared, then the table.exclude.list parameter will not take effect. However, the tables specified in the tables parameter of the MySQL Pipeline connector are effectively added to the table.include.list in Debezium's context.

      debezium opthion  desc

          In summary, it is necessary to introduce an externally-exposed table.exclude.list parameter within the MySQL Pipeline connector to facilitate the exclusion of tables. This is because the current setup does not allow for excluding unnecessary tables when including others through the tables parameter.

      Attachments

        1. screenshot-3.png
          275 kB
          Thorne
        2. screenshot-2.png
          44 kB
          Thorne
        3. screenshot-1.png
          95 kB
          Thorne

        Issue Links

          Activity

            People

              fffy Thorne
              fffy Thorne
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 72h
                  72h
                  Remaining:
                  Remaining Estimate - 72h
                  72h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified