Pylucene中的DelimitedPayloadFilter？

Question

我试图从http://searchhub.org/2010/04/18/refresh-getting-starting-with-payloads/using Pylucene实现java的python版本。我的分析器正在对DelimitedTokenFilter的init调用生成Lucene.InvalidArgSerror

课程在下面，任何帮助都是非常感谢的。用Pylucene3.6构建中的JAR文件编译的java版本工作得很好。

import lucene
class PayloadAnalyzer(lucene.PythonAnalyzer):
    encoder = None
    def __init__(self, encoder): 
        lucene.PythonAnalyzer.__init__(self) 
        self.encoder = encoder

    def tokenStream(self, fieldName, reader):
        result = lucene.WhitespaceTokenizer( lucene.Version.LUCENE_CURRENT, reader )
        result = lucene.LowerCaseFilter( lucene.Version.LUCENE_CURRENT, result )
        result = lucene.DelimitedPayloadTokenFilter( result, '|', self.encoder )
        return result

Answer 1

jcc的医生说：

当JCC看到这些特殊的扩展java类时，它生成C++代码，实现它们声明的本机方法。这些本机方法调用相应的Python方法实现，传入参数并将结果返回给Java VM调用者。

因此，您应该在Pylucene中编辑文件java/org/apache/pylucene/search/semines/pythonDefaultSimilarity.java。

import org.apache.lucene.util.BytesRef;
public native float scorePayload(int docId, int start, int end, BytesRef payload);

class PayloadSimilarity(PythonDefaultSimilarity):

    def scorePayload(self, docId, start, end, payload):
        return PayloadHelper.decodeFloat(payload.bytes, end)


class PayloadAnalyzer(PythonAnalyzer):
    encoder = None

    def __init__(self, encoder):
        super(PayloadAnalyzer, self).__init__()
        self.encoder = encoder

    def createComponents(self, fieldName, reader):
        source = WhitespaceTokenizer(Version.LUCENE_44, reader)
        result = LowerCaseFilter(Version.LUCENE_44, source)
        result = DelimitedPayloadTokenFilter(result, u'|', self.encoder)
        return self.TokenStreamComponents(source, result)