Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26221 Improve Spark SQL instrumentation and metrics
  3. SPARK-26223

Scan: track metastore operation time

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 2.4.0
    • None
    • SQL

    Description

      The Scan node should report how much time it spent in metastore operations. Similar to file listing, would be great to also report start and end time for constructing a timeline.

       

      Attachments

        Issue Links

          links to

          Web Link GitHub Pull Request #23371

          Activity

            People

              Unassigned Unassigned
              rxin Reynold Xin
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: