Get around the loopback restriction (JBERET000607)

[srahaingoson]

I have to batch process a list of files by scanning a directory and process the files inside one by one.

Each file is further processed line by line.

Coming from a spring batch background, to do this I scan the directory, take the first file in the list, process it in a batch step and move the file elsewhere after the processing then return to the directory scan step to load another file.

This goes on until there is no more file left in the directory.

And here is where I face a problem : the JSR-352 specification does not allow loopbacks to an execution element even though there is a clearly defined exit condition to prevent an endless loop.

(With the error returned :

JBERET000607: The step loadFilesStep would form a loopback in sequence: [loadFilesStep, processED2AStep, fileRejectedStep]

Any idea on how I can get around this without implementing an overly complicated would be much appreciated.

[cfang]

the type of flow you described seems fit chunk-type better than batchlet-type steps.  The chunk item reader can reads in file names until there is no more to read, the chunk item processor can do the necessary processing work, and the chunk item writer can handle the output.

I don't see a clean solution to support loopback without violating the spec (hence failing the tck tests).

[srahaingoson]

I realize that it's a chunk scenario but I also need to chunk the line processing at the file level.

I guess I'll have to find another solution unless there is an option to nest chunking.

[cfang]

1. JBERET-262

Allow loopback between steps and other job elements

[srahaingoson]

Thanks for opening this.

I will be following the development with interest.

[cfang]

JBERET-262 is resolved.  See JIRA issue details how to allow loop and test app example.