Uploaded image for project: 'ORC'
  1. ORC
  2. ORC-913

Support data/format/compress options in Spark benchmark

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.7.0, 1.8.0
    • 1.7.0, 1.8.0
    • Java

    Description

      Currently, Spark benchmark jar supports the JMH options.

      $ java -jar bench/spark/target/orc-benchmarks-spark-1.8.0-SNAPSHOT.jar spark -h
      usage: java -jar <jar> <command> <options> <data>
       -f,--fork <arg>                How many forks to use
       -g,--gc                        Should GC be profiled
       -h,--help                      Provide help
       -i,--iterations <arg>          Number of iterations
       -I,--warmup-iterations <arg>   Number of warmup iterations
       -m,--min-memory <arg>          The minimum size of each JVM
       -M,--max-memory <arg>          The maximum size of each JVM
       -p,--stack                     Should enable stack profiler in JMH
       -t,--time <arg>                How long each iteration is in seconds
      

      `core` benchmark jar file supports `format`/`data`/`compress` options. It would be great if Spark benchmark jar also supports its parameter options too.

      $ java -jar bench/core/target/orc-benchmarks-core-*-uber.jar generate -h
      usage: convert <root>
       -c,--compress <arg>   List of compression
       -d,--data <arg>       List of data sets
       -f,--format <arg>     List of formats
       -h,--help             Provide help
       -s,--sales <arg>      Number of records for sales
      

      Attachments

        Issue Links

          Activity

            People

              william William Hyun
              dongjoon Dongjoon Hyun
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: