| AW: [smila-user] Handling Streaming Ressources vs JMS |
|
Hi Hannes, thanks for your interest in SMILA. At the moment the data exchange between Crawler and Connectivity
does not support streaming. All the data of objects is actually copied (using a
byte[]) as record attachments (or as Strings using record attributes). So
you certainly cannot use data of such a big size as you plan to use. However, perhaps you can still use SMILA to do the job J Assuming that all machines you are running SMILA on are able to
access the data to be processed (e.g. by public URL, a filesystem share or
a database, etc.) your Crawler could only provide the information necessary to
access the data but not the data itself (e.g. a URL, or a path, or a database
Id). In the BPEL pipeline then you would need to implement your own Pipelet
that is capable of reading the data using a stream und create multiple records
from the streamed data. You may want to take a look at the org.eclipse.smila.processing.pipelets.xmlprocessing.XmlSplitterPipelet
as a sample on how to generate new records from an existing record. Bye, Daniel Von:
smila-user-bounces@xxxxxxxxxxx [mailto:smila-user-bounces@xxxxxxxxxxx] Im
Auftrag von Hannes Carl Meyer Hi, |