Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-12666

Provide cluster performance profiling tool

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.10
    • None
    • Docs Required, Release Notes Required

    Description

      For now, Ignite has not build-in profiling tool for user's operations and internal processes. Such a tool will be able to collect performance statistics and create a human-readable report. It will help to analyze workload and to tune configuration and applications.

      Example of similar tools in other products: AWR [1] [2] [3] (Oracle) ; pgbadger [4], pgmetrics [5], powa [6] (PostgresSQL). Example of html report: powa.

      Attachments

        1. benchmark_get_put.zip
          1.21 MB
          Nikita Amelchev
        2. Tracing benchmarks.docx
          989 kB
          Nikita Amelchev

        Issue Links

          1.
          Provide the ability to profile only specific operations Sub-task Open Nikita Amelchev  
          2.
          Provide the ability to cache strings Sub-task Resolved Nikita Amelchev  
          3.
          Provide the ability to set up default performance statistics properties Sub-task Resolved Nikita Amelchev  
          4.
          Create a new performance statistics file instead of deleting the existing Sub-task Resolved Nikita Amelchev  
          5.
          Add documentation for the cluster performance profiling tool Sub-task Resolved Nikita Amelchev

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 40m
          6.
          Provide the tool to build cluster performance report Sub-task Resolved Nikita Amelchev  
          7.
          Add logical/physical reads checks to existing tests Sub-task Open Nikita Amelchev  
          8.
          Provide the utility to output performance statistics operations to the console Sub-task Resolved Nikita Amelchev  
          9.
          Remove web-resources from the source of the performance report Sub-task Open Unassigned  
          10.
          Remove zip-file with web-resources from the jar Sub-task Open Unassigned  
          11.
          Provide the ability to configure performance report Sub-task Open Unassigned  
          12.
          Improve log message of start/stop performance statistics collection Sub-task Open Unassigned  
          13.
          Optimize memory usage on export performance statistics to JSON Sub-task Open Unassigned  
          14.
          Provide the ability to collect CQ performance statistics Sub-task Open Nikita Amelchev

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          15.
          Provide the ability to collect Services performance statistics Sub-task Open Nikita Amelchev  
          16.
          Added the ability to rotate collecting performance statistics Sub-task Resolved Sergei Ryzhov

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 5h 10m
          17.
          Add checkpoint information to the performance statistics. Sub-task Resolved Sergei Ryzhov

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 8h 20m
          18.
          Add information about checkpoints to the graphs of the performance statistics report Sub-task Open Unassigned  
          19.
          Add rebalance information to the performance statistics Sub-task Patch Available Sergei Ryzhov

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          20.
          Update the documentation for the cluster performance profiling tool Sub-task Resolved Sergei Ryzhov

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m
          21.
          Provide the ability to rollover performance staticstics files Sub-task Resolved Nikolay Izhikov  

          Activity

            People

              NSAmelchev Nikita Amelchev
              NSAmelchev Nikita Amelchev
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 48.5h
                  48.5h