Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12722

Add ElasticsearchIO External Versioning

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.31.0
    • io-java-elasticsearch
    • Java SDK (all environments)

    Description

      Elasticsearch External Versioning

      Beam's ElasticsearchIO Java SDK currently does not support external versioning.

      Use Case

      A primary use case is leveraging partial updates when performing a reindex operation. Without explicitly setting the external version, the versioning is set to default and version conflicts prevent any document updates.

      API Usage for External Versioning

      When using Elasticsearch's API, the ?version_type=external&version=1.0.0 query parameters must be provided.

      The options for version_type are:

      • external or external_gt
      • external_gte

       

      Attachments

        Activity

          People

            egalpin Evan Galpin
            bdaghir Benjamin Daghir
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: