RE: [smila-dev] lucene m-threads problems

[August Georg Schmidt <g.schmidt@xxxxxxx>]

In the data dictionary a not expected amount of parallel connections was configured. 

Therefore parallel indexing (delete operations) could occur on Lucene indices. A synchronize block on index level was added for delete operations.

-----Original Message-----
From: smila-dev-bounces@xxxxxxxxxxx [mailto:smila-dev-bounces@xxxxxxxxxxx] On Behalf Of August Georg Schmidt
Sent: Donnerstag, 16. Oktober 2008 23:06
To: Smila project developer mailing list
Subject: RE: [smila-dev] lucene m-threads problems

I'll do it.


-----Original Message-----
From: smila-dev-bounces@xxxxxxxxxxx [mailto:smila-dev-bounces@xxxxxxxxxxx] On Behalf Of Daniel.Stucky@xxxxxxxxxxx
Sent: Donnerstag, 16. Oktober 2008 16:08
To: smila-dev@xxxxxxxxxxx
Subject: AW: [smila-dev] lucene m-threads problems

Hi Ivan,

I encountered similar problems today. I think the methods of class org.eclipse.smila.search.lucene.index.IndexConnection that use an IndexReader need to be synchronized. I already asked Georg to take a look at it, because it's code originating from brox.

Bye,
Daniel


> -----Ursprüngliche Nachricht-----
> Von: smila-dev-bounces@xxxxxxxxxxx [mailto:smila-dev- 
> bounces@xxxxxxxxxxx] Im Auftrag von Ivan Churkin
> Gesendet: Donnerstag, 16. Oktober 2008 15:57
> An: Smila project developer mailing list
> Betreff: [smila-dev] lucene m-threads problems
> 
> Hi,
> 
> I tested ActiveMQ queue overflow and found that there are problems 
> with lucene.
> I collected 50.000 records in queue without processing, after that 
> starts to process them playing with Listener workers.quantity. As a
> result:
> 
> Lucene index service does not support correctly multi-thread access.
> Typical errors:
> 
> 1. unable to get lock
> 
> org.apache.lucene.store.LockObtainFailedException: Lock obtain timed
> out: SimpleFSLock@C:\a a\workspace\.metadata\.plugins\ 
> lucene\test_index\write.lock
>         at org.apache.lucene.store.Lock.obtain(Lock.java:85)
>         at
> org.apache.lucene.index.DirectoryIndexReader.acquireWriteLock(Director
> y
> IndexReader.java:250)
>         at
> org.apache.lucene.index.IndexReader.deleteDocument(IndexReader.java:72
> 5
> )
>         at
> org.apache.lucene.index.IndexReader.deleteDocuments(IndexReader.java:7
> 6
> 1)
>         at
> org.eclipse.smila.search.lucene.index.IndexConnection.deleteDocument(I
> n
> dexConnection.java:257)
> 
> 
> 
> 2. unable to write by IndexWriter
> 
> org.eclipse.smila.search.index.IndexException: unable to learn document
>         at
> org.eclipse.smila.search.lucene.index.IndexConnection.learnDocument(In
> d
> exConnection.java:343)
>         at
> org.eclipse.smila.lucene.LuceneIndexService.addRecord(LuceneIndexServi
> c
> e.java:217)
>         at
> org.eclipse.smila.lucene.LuceneIndexService.process(LuceneIndexService.
> java:174)
>         at
> org.eclipse.smila.processing.bpel.ProcessingServiceManager.doInvoke(Pr
> o
> cessingServiceManager.java:107)
>         at
> org.eclipse.smila.processing.bpel.ExtensionManager.invokeAdapter(Exten
> s
> ionManager.java:224)
>         at
> org.eclipse.smila.processing.bpel.ExtensionManager.invokeActivity(Exte
> n
> sionManager.java:174)
>         at
> org.eclipse.smila.processing.bpel.SMILAExtensionBundle$InvokeServiceAc
> t
> ivity.run(SMILAExtensionBundle.java:107)
>         at
> org.eclipse.smila.processing.bpel.SMILAExtensionBundle$InvokeServiceAc
> t
> ivity.run(SMILAExtensionBundle.java:119)
>         at
> org.apache.ode.bpel.rtrep.v2.EXTENSIONACTIVITY.run(EXTENSIONACTIVITY.j
> a
> va:66)
> --
> Regards, Ivan
> P.S. and Binary storage becomes very-very slow 
> _______________________________________________
> smila-dev mailing list
> smila-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/smila-dev