Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20570

CLONE - Integrate SparkOnHBase into HBase

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • None
    • spark
    • None
    • Hide
      This release includes initial support for running Spark against HBase with a richer feature set than was previously possible with MapReduce bindings:

      * Support for Spark and Spark Streaming against Spark 1.3
      * RDD/DStream formation from scan operations
      * convenience methods for interacting with HBase from an HBase backed RDD / DStream instance
      * examples in both the Spark Java API and Spark Scala API
      * support for running against a secure HBase cluster
      Show
      This release includes initial support for running Spark against HBase with a richer feature set than was previously possible with MapReduce bindings: * Support for Spark and Spark Streaming against Spark 1.3 * RDD/DStream formation from scan operations * convenience methods for interacting with HBase from an HBase backed RDD / DStream instance * examples in both the Spark Java API and Spark Scala API * support for running against a secure HBase cluster

    Description

      This Jira is to ask if SparkOnHBase can find a home in side HBase core.

      Here is the github:
      https://github.com/cloudera-labs/SparkOnHBase

      I am the core author of this project and the license is Apache 2.0

      A blog explaining this project is here
      http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/

      A spark Streaming example is here
      http://blog.cloudera.com/blog/2014/11/how-to-do-near-real-time-sessionization-with-spark-streaming-and-apache-hadoop/

      A real customer using this in produce is blogged here
      http://blog.cloudera.com/blog/2015/03/how-edmunds-com-used-spark-streaming-to-build-a-near-real-time-dashboard/

      Please debate and let me know what I can do to make this happen.

      Attachments

        Issue Links

          duplicates

          New Feature - A new feature of the product, which has yet to be developed. HBASE-13992 Integrate SparkOnHBase into HBase

          • Major - Major loss of function.
          • Closed
          is a clone of

          New Feature - A new feature of the product, which has yet to be developed. HBASE-13992 Integrate SparkOnHBase into HBase

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              ujjawal ujjawal kumar
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: