Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4883

Cannot sync Hive partitioned table - Ooops.. Cannot get Hive TableMeta

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • v3.1.0
    • None
    • None
    • Ubuntu 20.4
      hadoop 3.2.1
      hbase 2.2.6
      hive 3.1.2
      kylin 3.1.0

    Description

      Dear Kylini team,

      I have started working with Kylin in October 2020. All good until I read to partition the fact table in Hive to match partition column in Kylin.

      Tried to do that and I fail when I try to sync the new defined table containing any kind of partioned column type. I tried int, date, etc.

      I think I've read anything available on internet about this and I probably tried all configurations possible.

      I have a working environment in general except this sync in Kylin of a partioned table. To avoid this I created a view over the partitioned fact table but I understood this is not very helpful as Hive would be forced to full scan the underlying table.

      I have a working HCatalog I think and it should be fine in my opinion.

      I do not know what else to do. And the table started to get some volume as 400 milion rows and the time to load the data from Hive started to get large enough.

       

      Please help.

       

      Thank you,

      Iosiv

       

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            iosivp Iosiv Popescu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: