[SPARK-5362] Gradient and Optimizer to support generic output (instead of label) and data batches - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Incomplete
Affects Version/s: 1.2.0
Fix Version/s: None
Component/s: MLlib
Labels:
- bulk-closed

Description

Currently, Gradient and Optimizer interfaces support data in form of RDD[Double, Vector] which refers to label and features. This limits its application to classification problems. For example, artificial neural network demands Vector as output (instead of label: Double). Moreover, current interface does not support data batches. I propose to replace label: Double with output: Vector. It enables passing generic output instead of label and also passing data and output batches stored in corresponding vectors.

Attachments

Issue Links

relates to

SPARK-9120 Add multivariate regression (or prediction) interface

Resolved

SPARK-5256 Improving MLlib optimization APIs

Resolved

SPARK-18303 CLONE - Improving MLlib optimization APIs

Resolved

links to

[Github] Pull Request #4152 (avulanov)

Activity

People

Assignee:: Unassigned

Reporter:: Alexander Ulanov

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 22/Jan/15 00:54

Updated:: 08/Oct/19 05:42

Resolved:: 08/Oct/19 05:42

Time Tracking

Estimated:

24h

Remaining:

24h

Logged:

Not Specified