Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-5945

metadata refactor

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 5.0-alpha
    • 5.0.0
    • Metadata
    • None

    Description

      Kylin's metadata has some architectural issues, such as: 
      1. The metadata adopts a key-value structure. The JSON block contains a lot of content, which will grow with the growth of customer business, resulting in excessive network IO when updating metadata.

      2. The design of epoch and project lock ensures that transactions within the project are executed serially, resulting in single-point bottlenecks and concurrency problems.

      Attachments

        1. 1.PNG
          457 kB
          Zhiting Guo
        2. 2.PNG
          315 kB
          Zhiting Guo
        3. 3.png
          1.10 MB
          Zhiting Guo
        4. 4.png
          913 kB
          Zhiting Guo
        5. metadata (3).pdf
          163 kB
          Zhiting Guo
        6. Metadata deep dive (en).pdf
          1.13 MB
          Zhiting Guo

        Activity

          People

            guozhiting Zhiting Guo
            pfzhan Pengfei Zhan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: