Uploaded image for project: 'Tajo (Retired)'
  1. Tajo (Retired)
  2. TAJO-1925

Improve hive compatibility with TIMESTAMP partition column.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 0.11.0, 0.12.0
    • 0.13.0
    • Catalog, Physical Operator
    • None

    Description

      Currently, Tajo allow to use TIMESTAMP column as a partition key. But if users use TIMESTAMP partition column, Tajo doesn't keep the original TIMESTAMP values. Actually, Tajo automatically converts TIMESTAMP values to STRING literals which are accepted in the format YYYY-MM-DD HH:MM:SS. As a result, Tajo can't keep mills of second and can't provide right hive compatibility

      We need to support hive compatibility for all partition column types. But when using TIMESTAMP partition column, users might not get correct partitions occasionally because tajo partition name is different from hive partition name. Actually, Tajo automatically converts TIMESTAMP values to STRING literals which are accepted in the format YYYY-MM-DD HH:MM:SS. But Hive automatically converts it to STRING literals which are accepted in the format YYYY-MM-DD HH:MM:SS.MS.

      Attachments

        1. TAJO-1925.patch
          25 kB
          JaeHwa Jung
        2. TAJO-1925_3.patch
          43 kB
          JaeHwa Jung
        3. TAJO-1925_2.patch
          42 kB
          JaeHwa Jung

        Issue Links

          Activity

            People

              hyunsik Hyunsik Choi
              blrunner JaeHwa Jung
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: