[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
|
Re: [smila-dev] OutOfMemoryException during Crawl
|
Hi Daniel
Is it necessary to base the BinStore implementation on commons VSF ? What
are the benefits ?
[Marius] ... the commons-vfs was already chosen from long time ... Excluding
this memory consumption (issue discussed in the last days) commons-vfs
offers many functionalities and nice API for dealing with the file system.
Also commons-vfs it is used by other important projects (anyway, ... there
are many aspects that should be taken into consideration when choosing an
API... including the community too... and others).
I sent an email two days ago, related to specific requirements in order to
decide if the binary storage shall be based on file system or other
solutions could be used... I suggest we should obtain this answer first
before switching from commons-vfs to other fs API.
Best Regards,
marius
----- Original Message -----
From: <Daniel.Stucky@xxxxxxxxxxx>
To: <smila-dev@xxxxxxxxxxx>
Sent: Friday, October 10, 2008 5:46 PM
Subject: AW: [smila-dev] OutOfMemoryException during Crawl
Hi Marius,
I think I found the cause but I was not able to fix it, yet.
The cause lies in class org.apache.commons.vfs.provider.AbstractFileSystem.
There is a listenerMap that maps from FileName to an ArrayList of listeners
for that file. The problem is that Listeners are added but never removed.
Thus the number of entries in the map grows with the number of files stored
in the BinStore.
Is it necessary to base the BinStore implementation on commons VSF ? What
are the benefits ?
At the moment commons VSF seems a bit buggy and also is not very up to date.
Bye,
Daniel
-----Ursprüngliche Nachricht-----
Von: smila-dev-bounces@xxxxxxxxxxx [mailto:smila-dev-
bounces@xxxxxxxxxxx] Im Auftrag von Marius Cimpean
Gesendet: Freitag, 10. Oktober 2008 13:58
An: Smila project developer mailing list
Betreff: Re: [smila-dev] OutOfMemoryException during Crawl
Hi Daniel,
Thanks for the hint.
The commons-vfs bundle uses nightly builds ... which is old enough (Apr
2007) ... there is a new version of the nightly build (July 2007). I'll
do
some more tests based on the most recent available nightly build.
I also got in contact with the commons-vfs community to find out when
the
next release will be... unfortunately no answer yet.
Best Regards,
Marius
_______________________________________________
smila-dev mailing list
smila-dev@xxxxxxxxxxx
https://dev.eclipse.org/mailman/listinfo/smila-dev
