Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5245

hive create table as select(CTAS) can not work(not support) with join on operator

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • 0.11.0
    • None
    • HiveServer2
    • Incompatible change
    • hive CTAS

    Description

      hello everyone, recently i came across one hive problem as below:
      hive (test)> create table test_09 as
      > select a.* from test_01 a
      > join test_02 b
      > on (a.id=b.id);
      Automatically selecting local only mode for query
      Total MapReduce jobs = 2
      setting HADOOP_USER_NAME hadoop
      13/09/09 17:22:36 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10008/jobconf.xml:a attempt to override final parameter: mapred.system.dir; Ignoring.
      13/09/09 17:22:36 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10008/jobconf.xml:a attempt to override final parameter: mapred.local.dir; Ignoring.
      Execution log at: /tmp/hadoop/.log
      2013-09-09 05:22:36 Starting to launch local task to process map join; maximum memory = 932118528
      2013-09-09 05:22:37 Processing rows: 4 Hashtable size: 4 Memory usage: 113068056 rate: 0.121
      2013-09-09 05:22:37 Dump the hashtable into file: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10005/HashTable-Stage-6/MapJoin-mapfile90--.hashtable
      2013-09-09 05:22:37 Upload 1 File to: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10005/HashTable-Stage-6/MapJoin-mapfile90--.hashtable File size: 788
      2013-09-09 05:22:37 End of local task; Time Taken: 0.444 sec.
      Execution completed successfully
      Mapred Local Task Succeeded . Convert the Join into MapJoin
      Mapred Local Task Succeeded . Convert the Join into MapJoin
      Launching Job 1 out of 2
      Number of reduce tasks is set to 0 since there's no reduce operator
      13/09/09 17:22:38 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10009/jobconf.xml:a attempt to override final parameter: mapred.system.dir; Ignoring.
      13/09/09 17:22:38 WARN conf.Configuration: file:/tmp/hadoop/hive_2013-09-09_17-22-34_848_1629553341892012305/-local-10009/jobconf.xml:a attempt to override final parameter: mapred.local.dir; Ignoring.
      Execution log at: /tmp/hadoop/.log
      Job running in-process (local Hadoop)
      Hadoop job information for null: number of mappers: 0; number of reducers: 0
      2013-09-09 17:22:41,807 null map = 0%, reduce = 0%
      2013-09-09 17:22:44,814 null map = 100%, reduce = 0%
      Ended Job = job_local_0001
      Execution completed successfully
      Mapred Local Task Succeeded . Convert the Join into MapJoin
      Stage-7 is filtered out by condition resolver.
      OK
      Time taken: 13.138 seconds
      hive (test)> select * from test_09;
      FAILED: SemanticException [Error 10001]: Line 1:14 Table not found 'test_09'
      hive (test)>
      Problem:
      I can't get the created table, namely this CTAS is nonavailable, and this table is not created by this hql sentence at all.who can explain for me.Thanks.

      Attachments

        Activity

          People

            Unassigned Unassigned
            jeff_little jeff little
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 96h
                96h
                Remaining:
                Remaining Estimate - 96h
                96h
                Logged:
                Time Spent - Not Specified
                Not Specified