[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
|
AW: [smila-dev] voting against HASH calculating specification
|
+1 from me.
I always voted for creating it inside the crawler :-)
Bye,
Daniel
> -----Ursprüngliche Nachricht-----
> Von: smila-dev-bounces@xxxxxxxxxxx [mailto:smila-dev-
> bounces@xxxxxxxxxxx] Im Auftrag von Ivan Churkin
> Gesendet: Mittwoch, 22. Oktober 2008 10:36
> An: Smila project developer mailing list
> Betreff: [smila-dev] voting against HASH calculating specification
>
> Hi,
>
> I want to discuss old problem again. It's about HASH calculating.
> This problem relates to
> http://wiki.eclipse.org/SMILA/Specifications/CrawlerAPIDiscussion09
> discussion.
>
> It was specified that HASH should be calculated on Crawler Controller
> side automatically by configuration.
> In my opinion it's absolutely unacceptable for distributed systems.
> I'll argue it by the next sample.
>
> There are distributed system with 2 nodes. CrawlerController and
> FileCrawler are communicating remotely.
> FileCrawler is configured to calculate HASH by the file content.
> Let's imagine that FileCrawler is monitoring video archive and crawling
> procedure is started automatically every hour.
>
> Can you imagine that happens in this situation? Complete video archive
> will send remotely every hour )).
>
> --
> Ivan
>
> _______________________________________________
> smila-dev mailing list
> smila-dev@xxxxxxxxxxx
> https://dev.eclipse.org/mailman/listinfo/smila-dev
