Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-3345

Presto query in Carbondata-streaming failed

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 1.5.2
    • None
    • presto-integration

    Description

      I use streaming for saving switch' s syslog, here' s my table ddl

      CREATE TABLE IF NOT EXISTS syslog(id LONG, device_id LONG, ip STRING, message STRING, level SHORT, message_type CHAR(1), port_index INT, area_id LONG, createdon TIMESTAMP) STORED AS carbondata TBLPROPERTIES ('INVERTED_INDEX'='device_id,level,area_id','SORT_COLUMNS'='device_id,level,area_id,id','streaming'='true')

       

      Here' s a record example

       I mock ten thousand switchs,each one produced a record every 10 seconds on a day.

      On the early time, the presto' s query is normally.

      However, when the data growing, the presto query result is diffent from the spark sql.

       

       

       

       

       

       

       

      I am looking forward to resolving it, thanks !

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              zjy zjy
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 10m
                  3h 10m