AW: [smila-dev] lucene m-threads problems

[<Daniel.Stucky@xxxxxxxxxxx>]

Hi Ivan,

I encountered similar problems today. I think the methods of class org.eclipse.smila.search.lucene.index.IndexConnection that use an IndexReader need to be synchronized. I already asked Georg to take a look at it, because it's code originating from brox.

Bye,
Daniel


> -----Ursprüngliche Nachricht-----
> Von: smila-dev-bounces@xxxxxxxxxxx [mailto:smila-dev-
> bounces@xxxxxxxxxxx] Im Auftrag von Ivan Churkin
> Gesendet: Donnerstag, 16. Oktober 2008 15:57
> An: Smila project developer mailing list
> Betreff: [smila-dev] lucene m-threads problems
> 
> Hi,
> 
> I tested ActiveMQ queue overflow and found that there are problems with
> lucene.
> I collected 50.000 records in queue without processing, after that
> starts to process them playing with Listener workers.quantity. As a
> result:
> 
> Lucene index service does not support correctly multi-thread access.
> Typical errors:
> 
> 1. unable to get lock
> 
> org.apache.lucene.store.LockObtainFailedException: Lock obtain timed
> out: SimpleFSLock@C:\a a\workspace\.metadata\.plugins\
> lucene\test_index\write.lock
>         at org.apache.lucene.store.Lock.obtain(Lock.java:85)
>         at
> org.apache.lucene.index.DirectoryIndexReader.acquireWriteLock(Directory
> IndexReader.java:250)
>         at
> org.apache.lucene.index.IndexReader.deleteDocument(IndexReader.java:725
> )
>         at
> org.apache.lucene.index.IndexReader.deleteDocuments(IndexReader.java:76
> 1)
>         at
> org.eclipse.smila.search.lucene.index.IndexConnection.deleteDocument(In
> dexConnection.java:257)
> 
> 
> 
> 2. unable to write by IndexWriter
> 
> org.eclipse.smila.search.index.IndexException: unable to learn document
>         at
> org.eclipse.smila.search.lucene.index.IndexConnection.learnDocument(Ind
> exConnection.java:343)
>         at
> org.eclipse.smila.lucene.LuceneIndexService.addRecord(LuceneIndexServic
> e.java:217)
>         at
> org.eclipse.smila.lucene.LuceneIndexService.process(LuceneIndexService.
> java:174)
>         at
> org.eclipse.smila.processing.bpel.ProcessingServiceManager.doInvoke(Pro
> cessingServiceManager.java:107)
>         at
> org.eclipse.smila.processing.bpel.ExtensionManager.invokeAdapter(Extens
> ionManager.java:224)
>         at
> org.eclipse.smila.processing.bpel.ExtensionManager.invokeActivity(Exten
> sionManager.java:174)
>         at
> org.eclipse.smila.processing.bpel.SMILAExtensionBundle$InvokeServiceAct
> ivity.run(SMILAExtensionBundle.java:107)
>         at
> org.eclipse.smila.processing.bpel.SMILAExtensionBundle$InvokeServiceAct
> ivity.run(SMILAExtensionBundle.java:119)
>         at
> org.apache.ode.bpel.rtrep.v2.EXTENSIONACTIVITY.run(EXTENSIONACTIVITY.ja
> va:66)
> --
> Regards, Ivan
> P.S. and Binary storage becomes very-very slow
> _______________________________________________
> smila-dev mailing list
> smila-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/smila-dev