Is it possibile using jbpm for data integration?

[antonio.giambanco]

Hi all,

anybody tried to use jbpm for data integration?

I have txt files with data that I need to validate (I thought usign drools), extract and load on db.

Since I have many and huge files I need to process them as fast as possible, load validated data and handling discarded data.

In the case of discarded data I could ask human support to fix data problem, call an external service to get the right data and so on. . .

I thought a process with some custom work items able to validate, extract and load data. If I have validation problems i would  instantiate a process for each kind of error I found in the data file and in the mean time I would go ahaed with extracting and loading of the correct data.

I'm a little scared about the performance of the validation, extracting and loading of data, what could I use?

thanks

[swiderski.maciej]

for data validation and integrity check I'd go for drools and in case issues are found collect some or all of them and then start a process to handle them, either automatically or by human intervention.

HTH

[antonio.giambanco]

do you think I should integrate a tool for massive data loading or there is something else that I can use?

thanks!