solr - Lucene Custom Analyzer for indexing and query -


i working on lucene 4.7 , trying migrate 1 of analyzers use in our solr configuration. 

 <analyzer>    <charfilter class="solr.htmlstripcharfilterfactory"/>     <tokenizer class="solr.whitespacetokenizerfactory"/>     <filter class="solr.stopfilterfactory" ignorecase="true" words="stopwords.txt"/>       <filter class="solr.worddelimiterfilterfactory"              generatewordparts="1"              generatenumberparts="1"              catenatewords="1"             catenatenumbers="1"             catenateall="0"             splitoncasechange="0"             splitonnumerics="0"             preserveoriginal="1"     />     <filter class="solr.lowercasefilterfactory"/>     <filter class="solr.porterstemfilterfactory"/>   </analyzer>

but, cannot figure out how use htmlstripcharfilterfactory , worddelimiterfilterfactory configuration above. also, query in solr analyzer follows, how can achieve same in lucene.

 <analyzer type="query">     <tokenizer class="solr.whitespacetokenizerfactory"/>     <filter class="solr.stopfilterfactory"             ignorecase="true"             words="stopwords.txt"             />     <filter class="solr.lowercasefilterfactory"/>     <filter class="solr.porterstemfilterfactory"/>   </analyzer>

the analysis package documentation explains how use charfilter. wrap reader in overridden initreader method.

i'm assuming problem worddelimiterfilter don't know how set configuration options using? construct int pass constructor combining appropriate constants binary , (&). such as: 

int config = worddelimiterfilter.generate_number_parts & worddelimiterfilter.generate_word_parts; //etc.

so, in end might end like:

//stopwordanalyzerbase grants convenient ways handle stop word sets. public class myanalyzer extends stopwordanalyzerbase {      private final version version = version.lucene_47;     private int worddelimiterconfig;      public myanalyzer() throws ioexception {         super(version, loadstopwordset(new filereader("stopwords.txt"), matchversion));         //might load config front, along stop words         worddelimiterconfig =              worddelimiterfilter.generate_word_parts &             worddelimiterfilter.generate_number_parts &             worddelimiterfilter.catenate_words &             worddelimiterfilter.catenate_numbers &             worddelimiterfilter.preserve_original;     }      @override     protected tokenstreamcomponents createcomponents(string fieldname, reader reader) {         tokenizer source = new whitespacetokenizer(version, reader);         tokenstream filter = new worddelimiterfilter(source, worddelimiterconfig, null);         filter = new lowercasefilterfactory(version, filter);         filter = new stopfilter(version, filter, stopwords);         filter = new porterstemfilter(filter);         return new tokenstreamcomponents(source, filter);     }      @override     protected reader initreader(string fieldname, reader reader) {         return new htmlstripcharfilter(reader);     } }

note: i've moved stopfilter after lowercasefilter. makes case insensitive, long stop word definitions in lowercase. don't know if problematic due the worddelimiterfilter. if so, there loadstopwordset method support case insensitivity, i, frankly, don't know how use it.


Comments

Post a Comment

Popular posts from this blog

apache - Remove .php and add trailing slash in url using htaccess not loading css -

i have add following code htaccess file removing .php extension , add trailing slash urls. worked fine reduced page loading speed , css code not loading @ all. pages ugly. please help rewriteengine on rewritebase / ## hide .php extension snippet # externally redirect /dir/foo.php /dir/foo rewritecond %{the_request} ^[a-z]{3,}\s([^.]+)\.php [nc] rewriterule ^ %1/ [r,l] # add trailing slash rewritecond %{request_filename} !-f rewritecond %{request_uri} !/$ rewriterule . %{request_uri}/ [l,r=301] # internally forward /dir/foo /dir/foo.php rewritecond %{request_filename} !-d rewritecond %{request_filename}.php -f rewriterule ^(.*?)/?$ $1.php [l] we can rewrite urls using .htaccess files. before writing in .htaccess files need verify kind of server using. can check server adding a <?php phpinfo(); ?> in php page. ensure mod_rewrite module enabled in apache server. can identified checking phpinfo included page. common methods used url rewriting follows ...
Read more

javascript - jQuery show full size image on click -

pretty self explanatory not workking . i want display full image when user click on image... yes know there tons of plugins but i want keep simple. any idea ? css : .full { display: none; width: 500px; height: 500px; margin-left: 100px; margin-top: -300px; position: fixed; background-color: #f00; z-index: 6; } .thumbnail { width: 50px; height: 50px; } html: <img class="thumbnail" src="http://4.bp.blogspot.com/-uhbdp2esxng/txneptvi92i/aaaaaaaaaky/upfqis7zto0/s1600/rihanna-wallpaper.jpg"> jquery: $(document).ready(function() { $('.thumbnail').on('click', function() { var img = $('<img />',{src:this.src,'class':'full'}); $('.full').html(img).show(); console.log('done!'); }); }); try looking how jquery works. $(document).ready(function() { $('.thumbnail').on('click', function(...
Read more