Details
-
Wish
-
Status: Open
-
Minor
-
Resolution: Unresolved
-
None
-
None
-
None
Description
The Cloudant connector only supports DStreams/SparkStreaming. We write service tools for our field service engineers to calibrate/validate/test our instruments when they are at customer sites. The service tools sync the results into our couchdb instance. We have a daily job running in databricks using the cloudant connector to pull the data, aggregate it with other enterprise data and push it to BI dashboards.
Currently, we're pull down all of the results every night, but our goal is to make service data available near-real time.