Uploaded image for project: 'ManifoldCF'
  1. ManifoldCF
  2. CONNECTORS-941

Solr Connector with basic auth no longer works

    XMLWordPrintableJSON

Details

    Description

      HttpClient throws an exception when SolrConnector is configured to use Basic Auth.

      DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "HTTP/1.1 401 Authorization Required[\r][\n]"
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Date: Wed, 21 May 2014 09:02:53 GMT[\r][\n]"
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Server: Apache/2.2.24 (Unix)[\r][\n]"
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "WWW-Authenticate: Basic realm="resin"[\r][\n]"
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Content-Length: 527[\r][\n]"
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Keep-Alive: timeout=5, max=100[\r][\n]"
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Connection: Keep-Alive[\r][\n]"
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "Content-Type: text/html; charset=iso-8859-1[\r][\n]"
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << "[\r][\n]"
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << HTTP/1.1 401 Authorization Required
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Date: Wed, 21 May 2014 09:02:53 GMT
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Server: Apache/2.2.24 (Unix)
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << WWW-Authenticate: Basic realm="resin"
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Content-Length: 527
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Keep-Alive: timeout=5, max=100
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Connection: Keep-Alive
DEBUG 2014-05-21 11:02:53,569 (Thread-3784112) - http-outgoing-17 << Content-Type: text/html; charset=iso-8859-1
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Connection can be kept alive for 5000 MILLISECONDS
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Authentication required
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - solr-test01.uio.no:443 requested authentication
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Authentication schemes in the order of preference: [negotiate, Kerberos, NTLM, Digest, Basic]
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Challenge for negotiate authentication scheme not available
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Challenge for Kerberos authentication scheme not available
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Challenge for NTLM authentication scheme not available
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Challenge for Digest authentication scheme not available
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Selected authentication options: [BASIC]
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<html><head>[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<title>401 Authorization Required</title>[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "</head><body>[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<h1>Authorization Required</h1>[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<p>This server could not verify that you[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "are authorized to access the document[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "requested.  Either you supplied the wrong[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "credentials (e.g., bad password), or your[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "browser doesn't understand how to supply[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "the credentials required.</p>[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<hr>[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "<address>Apache/2.2.24 (Unix) Server at <a 
href="mailto:webmaster@usit.uio.no">solr-test01.uio.no</a> Port 443</address>[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17 << "</body></html>[\n]"
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17: Shutdown connection
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Connection discarded
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - http-outgoing-17: Close connection
DEBUG 2014-05-21 11:02:53,570 (Thread-3784112) - Connection released: [id: 17][route: {s}->https://solr-test01.uio.no:443][total kept alive: 0; route allocated: 
0 of 2; total allocated: 0 of 1]
 WARN 2014-05-21 11:02:53,573 (Worker thread '5') - IO exception during indexing http://foreninger.uio.no/: null
org.apache.http.client.ClientProtocolException
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:188)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
	at org.apache.manifoldcf.agents.output.solr.ModifiedHttpSolrServer.request(ModifiedHttpSolrServer.java:292)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.manifoldcf.agents.output.solr.HttpPoster$IngestThread.run(HttpPoster.java:951)
Caused by: org.apache.http.client.NonRepeatableRequestException: Cannot retry request with a non-repeatable request entity.
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:208)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:195)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:108)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:186)
	... 7 more
 WARN 2014-05-21 11:02:53,574 (Worker thread '5') - Service interruption reported for job 1391414882852 connection 'Web': IO exception during indexing 
http://foreninger.uio.no/: null
DEBUG 2014-05-21 11:02:54,673 (Idle cleanup thread) - Closing connections idle longer than 300000 MILLISECONDS
DEBUG 2014-05-21 11:02:54,673 (Idle cleanup thread) - Closing expired connections

      It does not appear that expect-continue is working in HttpClient 4.3, even though it is explicitly enabled. See CONNECTORS-661.

      Attachments

        1. CONNECTORS-941.patch
          0.8 kB
          Karl Wright

        Issue Links

          depends upon

          Bug - A problem which impairs or prevents the functions of the product. HTTPCLIENT-1510 Expect/continue not working for HttpRequest objects that are implemented with an HttpRequestWrapper

          • Major - Major loss of function.
          • Closed

          Activity

            People

              kwright@metacarta.com Karl Wright
              kwright@metacarta.com Karl Wright
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: