Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-4324

TPCDS Table load failure

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.3.0
    • None
    • core
    • None

    Description

      While creating TPCDS tables for 500GB data test, loading fails with below exception. The tables are partitioned with local sort enabled.

      Caused by: java.lang.ClassCastException: java.lang.Long cannot be cast to java.lang.Integer
              at org.apache.carbondata.core.util.comparator.IntSerializableComparator.compare(IntSerializableComparator.java:30)
              at org.apache.carbondata.processing.sort.sortdata.FileMergeSortComparator.compare(FileMergeSortComparator.java:90)
              at org.apache.carbondata.processing.sort.sortdata.FileMergeSortComparator.compare(FileMergeSortComparator.java:28)
              at org.apache.carbondata.processing.loading.sort.unsafe.holder.UnsafeSortTempFileChunkHolder.compareTo(UnsafeSortTempFileChunkHolder.java:295)
              at org.apache.carbondata.processing.loading.sort.unsafe.holder.UnsafeSortTempFileChunkHolder.compareTo(UnsafeSortTempFileChunkHolder.java:46)
              at java.util.PriorityQueue.siftUpComparable(PriorityQueue.java:656)
              at java.util.PriorityQueue.siftUp(PriorityQueue.java:647)
              at java.util.PriorityQueue.offer(PriorityQueue.java:344)
              at java.util.PriorityQueue.add(PriorityQueue.java:321)
              at org.apache.carbondata.processing.loading.sort.unsafe.merger.UnsafeSingleThreadFinalSortFilesMerger.startSorting(UnsafeSingleThreadFinalSortFilesMerger.java:152)
              ... 12 more

      Attachments

        1. createtable.txt
          6 kB
          Pradeep Shetty

        Activity

          People

            Unassigned Unassigned
            ShettyPradeep Pradeep Shetty
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: