Details
-
Bug
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
5.0
Description
Tried to get language detection to work.
Setting:
<processor class="org.apache.solr.update.processor.LangDetectLanguageIdentifierUpdateProcessorFactory"> <str name="langid.fl">title,author</str> <str name="langid.langsField">detected_languages</str> <str name="langid.whitelist">de,en</str> <str name="langid.fallback">txt</str> <bool name="langid.map">true</bool> <bool name="langid.map.individual">true</bool> <bool name="langid.map.keepOrig">true</bool> </processor>
Main purpose
- Map fields individually
- Keep the original field
But the fields won't be mapped individually. They are mapped to a single detected language. After some hours of investigation i finally found the reason: The option langid.map.keepOrig breaks the individual mapping function. Only if it is disabled the fields will be mapped as expected.
- Regards
Attachments
Issue Links
- is caused by
-
SOLR-3881 frequent OOM in LanguageIdentifierUpdateProcessor
- Closed
- links to