Re: AW: [smila-dev] voting against HASH calculating specification

[Ivan Churkin <ivan@xxxxxxxxxxxx>]

Hi Daniel,

Yes it was :)

Automatic HASH calculating may be easy included into suggested in the
http://wiki.eclipse.org/SMILA/Specifications/CrawlerAPIDiscussion09
Communication class
It will solve automatic HASH calculating issues for JAVA based services.

And, also, in my opinion, HASH should be included into "datamodel" as 
separate property for Record and DIData because its specific and required.

record.getHash();
diData.getHash();

(now it's ordinary Attribute with hardcoded name "HASH")

--
Regards, Ivan



Daniel.Stucky@xxxxxxxxxxx wrote:
> +1 from me.
> I always voted for creating it inside the crawler :-)
>
> Bye,
> Daniel
>
>   
> > -----Ursprüngliche Nachricht-----
> > Von: smila-dev-bounces@xxxxxxxxxxx [mailto:smila-dev-
> > bounces@xxxxxxxxxxx] Im Auftrag von Ivan Churkin
> > Gesendet: Mittwoch, 22. Oktober 2008 10:36
> > An: Smila project developer mailing list
> > Betreff: [smila-dev] voting against HASH calculating specification
> >
> > Hi,
> >
> > I want to discuss old problem again. It's about HASH calculating.
> > This problem relates to
> > http://wiki.eclipse.org/SMILA/Specifications/CrawlerAPIDiscussion09
> > discussion.
> >
> > It was specified that HASH should be calculated on Crawler Controller
> > side automatically by configuration.
> > In my opinion it's absolutely unacceptable for distributed systems.
> > I'll argue it by the next sample.
> >
> > There are distributed system with 2 nodes. CrawlerController and
> > FileCrawler are communicating remotely.
> > FileCrawler is configured to calculate HASH by the file content.
> > Let's imagine that FileCrawler is monitoring video archive and crawling
> > procedure is started automatically every hour.
> >
> > Can you imagine that happens in this situation? Complete video archive
> > will send remotely every hour )).
> >
> > --
> > Ivan
> >
> > _______________________________________________
> > smila-dev mailing list
> > smila-dev@xxxxxxxxxxx
> > https://dev.eclipse.org/mailman/listinfo/smila-dev
> >     
> > ------------------------------------------------------------------------
> >
> > _______________________________________________
> > smila-dev mailing list
> > smila-dev@xxxxxxxxxxx
> > https://dev.eclipse.org/mailman/listinfo/smila-dev
> >