2 Replies Latest reply on Apr 1, 2015 9:26 AM by antonio.giambanco

Is it possibile using jbpm for data integration?

antonio.giambanco Mar 26, 2015 5:11 AM

Hi all,

anybody tried to use jbpm for data integration?

I have txt files with data that I need to validate (I thought usign drools), extract and load on db.

Since I have many and huge files I need to process them as fast as possible, load validated data and handling discarded data.

In the case of discarded data I could ask human support to fix data problem, call an external service to get the right data and so on. . .

I thought a process with some custom work items able to validate, extract and load data. If I have validation problems i would instantiate a process for each kind of error I found in the data file and in the mean time I would go ahaed with extracting and loading of the correct data.

I'm a little scared about the performance of the validation, extracting and loading of data, what could I use?

thanks

1. Re: Is it possibile using jbpm for data integration?

swiderski.maciej Mar 27, 2015 2:34 AM (in response to antonio.giambanco)

for data validation and integrity check I'd go for drools and in case issues are found collect some or all of them and then start a process to handle them, either automatically or by human intervention.

HTH
Actions
2. Re: Is it possibile using jbpm for data integration?

antonio.giambanco Apr 1, 2015 9:26 AM (in response to swiderski.maciej)

do you think I should integrate a tool for massive data loading or there is something else that I can use?

thanks!
Actions

Go to original post