Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-35096

Flink OpenSearch Connector

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • Important

    Description

      Hi Team,

      I am trying to connect with the OS using the FLINK Java but as I dont find a way to pass theĀ IAM-ROLE for the OS cluster I am not able to create the index also it does not throw any exception.

      Here is my code which I am trying to

      final DataStream<Tuple4<String, String, Long, Long>> tupleSource = env.fromCollection(users);
      final OpensearchSink<Tuple4<String, String, Long, Long>> sink =
      new OpensearchSinkBuilder<Tuple4<String, String, Long, Long>>()
      .setBulkFlushMaxActions(1)
      .setHosts(new HttpHost("aws-cluster", 443, "https"))
      .setEmitter( (element, ctx, indexer) ->

      { indexer.add( Requests .indexRequest() .index("users") .id(element.f0) .source(Map.ofEntries( Map.entry("user_id", element.f0), Map.entry("user_name", element.f1), Map.entry("uv", element.f2), Map.entry("pv", element.f3) ))); }

      )
      .setAllowInsecure(true)
      .setBulkFlushMaxActions(1)
      .build();

      Idly we do pass the assumeRole of the user once we wan to connect any of the managed service but I dont find a way role anywhere in the OS connector

      Attachments

        Activity

          People

            Unassigned Unassigned
            hksharma Harish Sharma
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: