What are the best practices for combining analyzers in Lucene? -

-

i have situation i'm using standardanalyzer in lucene index text strings follows:

public void indextext(string suffix, boolean includestopwords)  {             standardanalyzer analyzer = null;       if (includestopwords) {         analyzer = new standardanalyzer(version.lucene_30);     }     else {          // stop_words exclude them.         set<string> stopwords = (set<string>) stop_word_listener.getstopwords();               analyzer = new standardanalyzer(version.lucene_30, stopwords);     }      try {          // index text.         directory index = new ramdirectory();         indexwriter w = new indexwriter(index, analyzer, true, indexwriter.maxfieldlength.unlimited);                     this.addtexttoindex(w, this.gettexttoindex());         w.close();          // read index.         indexreader ir = indexreader.open(index);         text_termvectormapper ttvm = new text_termvectormapper();          int docid = 0;          ir.gettermfreqvector(docid, propertiesfile.getproperty(text), ttvm);          // set output.         this.setwordfrequencies(ttvm.getwordfrequencies());         w.close();     }     catch(exception ex) {         logger.error("error message\n", ex);     } }  private void addtexttoindex(indexwriter w, string value) throws ioexception {     document doc = new document();     doc.add(new field(text), value, field.store.yes, field.index.analyzed, field.termvector.yes));     w.adddocument(doc); }

which works combine stemming using snowballanalyzer well.

this class has 2 instance variables shown in constructor below:

public text_indexer(string texttoindex) {     this.texttoindex = texttoindex;     this.wordfrequencies = new hashmap<string, integer>(); }

can tell me how best achieve code above?

thanks

mr morgan.

lucene provides org.apache.lucene.analysis.analyzer base class can used if want write own analyzer.
can check out org.apache.lucene.analysis.standard.standardanalyzer class extends analyzer.

then, in youranalyzer, you'll chain standardanalyzer , snowballanalyzer using filters analyzers use, this:

tokenstream result = new standardfilter(tokenstream); result = new snowballfilter(result, stopset);

then, in existing code, you'll able construct indexwriter own analyzer implementation chains standard , snowball filters.

totally off-topic:
suppose you'll need setup custom way of handling requests. implemented inside solr.

first write own search component extending searchcomponent , defining in solrconfig.xml, this:

<searchcomponent name="yourquerycomponent" class="org.apache.solr.handler.component.yourquerycomponent"/>

then write search handler (request handler) extending searchhandler, , define in solrconfig.xml:

  <requesthandler name="yourrequesthandlername" class="org.apache.solr.handler.component.yourrequesthandler" default="true">     <!-- default values query parameters -->         <lst name="defaults">             <str name="echoparams">explicit</str>                    <int name="rows">1000</int>             <str name="fl">*</str>             <str name="version">2.1</str>         </lst>          <arr name="components">             <str>yourquerycomponent</str>             <str>facet</str>             <str>mlt</str>             <str>highlight</str>                         <str>stats</str>             <str>debug</str>          </arr>    </requesthandler>

then, when send url query solr, include additional parameter qt=yourrequesthandlername, result in request handler being used request.

more searchcomponents.
more requesthandlers.


Comments

Post a Comment

Popular posts from this blog

c# - How to set Z index when using WPF DrawingContext? -

-
how set z-index drawing object when using drawingcontext.drawxxx() methods? the object drawn last have higher z index. can't change index of drawn objects. way draw in order. if using wpf (as placed tag), can use, example, canvas control. create shapes need like polyline obj = new polyline(); //... // ... set properties of obj and add them canvas uielementcollection: yourcanvasname.children.add(obj); //or yourcanvasname.children.insert(i, obj); first items of collection have higher z index. advantages in way: no need redraw on window changes, can anytime move objects , change order.
Read more

razor - Is this a bug in WebMatrix PageData? -

-
i think may have found bug in webmatrix's pagedata, not sure. concerns how pass data partial page calling page. in webmatrix documentation (tutorials, e.g. " 3 - creating consistent look ", , example code), pagedata recommended mechanism pass data between pages (e.g. content page layout page, or partial page). however have found not work other way, pass data partial page calling page. modifying or adding entries in pagedata in partial page, not seem calling page. cutting right down simplest possible example, in test page may have this: @{ pagedata["test"] = "initial entry"; } <p>before calling partial page, test value @pagedata["test"]</p> @renderpage("_testpartial.cshtml") <p>after returning calling page, test value @pagedata["test"]</p> and in _testpartial.cshtml page might have this: @{ pagedata["test"] = "modified entry"; } <p>in partial page...
Read more

visual c++ - Using relative values in array sorting ( asm ) -

-
i need sort through array , sort each individual row in array in ascending order. doesn't seem going (surprise!) keep getting hit 2 errors: a2101: cannot add 2 relocatable labels , a2026: constant expected here's sort, makes sense me, think i'm still trying implement high-lvl language techniqes assembly. there way around not being able use relative values? (the array 7 rows 9 columns, btw). mov cx, 7; cx = number of rows outer: ; outer loop walk through rows push cx mov cx, 9 mov row, cx ;rows middle: ; middle-loop walk through columns push cx sub cx, 1 ;cx = cx-1 mov column, cx ;columns inner: ;inner loop - compare , exchange column values cmp marray[row*9 + column], marray[row*9 + column+1] xchg marray[row*9 + column+1], marray[row*9 + column] ; compare , exchange values marray table inc column loop inner pop cx loop mid...
Read more