Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-27021

Drop table should not be success on purge enabled tables if underlying HDFS data delete fails

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      User A has drop privs for a table, but does not have delete privs on table HDFS path & table purge is enabled. When User A fires drop table command, HMS metadata is removed but HDFS files are left as-is & drop is reported successful leaving stale files.

      For example, the drop table query is completed successfully. 

      0: jdbc:hive2://> drop table testtb_ex1
      INFO  : Semantic Analysis Completed (retrial = false)
      INFO  : Created Hive schema: Schema(fieldSchemas:null, properties:null)
      INFO  : Completed compiling command(queryId=hive_20221213121153_67cc8de3-9bd1-47c5-b2ec-13f6a0cd5125); Time taken: 0.032 seconds
      INFO  : Executing command(queryId=hive_20221213121153_67cc8de3-9bd1-47c5-b2ec-13f6a0cd5125): drop table testtb_ex1
      INFO  : Starting task [Stage-0:DDL] in serial mode
      INFO  : Completed executing command(queryId=hive_20221213121153_67cc8de3-9bd1-47c5-b2ec-13f6a0cd5125); Time taken: 0.413 seconds
      INFO  : OK
      No rows affected (0.516 seconds) 

      However, the table HDFS data deletion fails

      2022-12-13 12:11:53,700 ERROR org.apache.hadoop.hive.metastore.utils.MetaStoreUtils: [pool-6-thread-73]: Got exception: org.apache.hadoop.security.AccessControlException Permission denied by sticky bit: user
      =oozie, path="/warehouse/tablespace/external/hive/testtb_ex1":hive:hive:drwxr-xr-x, parent="/warehouse/tablespace/external/hive":hive:hive:drwxrwxrwt

      Attachments

        Activity

          People

            Unassigned Unassigned
            ibenny iBenny
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: