Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-1625

BoundedDataset action() does not materialize RDD

Details

    • Bug
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 0.6.0
    • runner-spark
    • None

    Description

      BoundedDataset#action does not materialize RDD since it uses foreachPartition which is not an action, instead use foreach which is.
      The reason it worked until now was because there was also a call to cache() before it.

      http://spark.apache.org/docs/1.6.3/programming-guide.html#actions

      Attachments

        Issue Links

          Activity

            People

              aviemzur Aviem Zur
              aviemzur Aviem Zur
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: