Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-5574

Build model failed if any of the source table schema had been changed, saying deleted unrelated columns.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 5.0-alpha
    • 5.0-beta
    • Modeling
    • None

    Description

      How the error occurred?

      During building a model, KE will construct a new SELECT sql from KE's table metadata, to read data from source tables. But if the user had deleted some unused columns from any source table, KE's metadata will be different with Hive's metastore, as a consequence, `SparkSession::sql` will throws validation exceptions because of the mismatched columns found in the SELECT sql.

      How to solve it?

      Using the intersection between KE's columns and Hive metastore's.

      Attachments

        Activity

          People

            newboy Guangyuan Feng
            newboy Guangyuan Feng
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: