Is it possible to obtain the name of the files that are processed by the file translator?

[lmann99]

I have a need to import multiple files where a record in one file may be duplicated in another file.  The file records do not contain any fields such as an 'date updated' so it isn't possible to determine which is the latest update from the content itself.  The updated date information can be obtained from the file naming convention but I don't see how one can add a column for the filename along with the columns derived from the parsed data contents in the file translator.  Is there any way to have an output column with the name of the file that each record is associated with?

Thanks

Les

[rareddy]

Leslie,

On "getTextFiles" or "getFiles" call, there is second result available other than "file" called "filePath", that should give you the name of the file. You can project that out or use it in some other computations.

select x.filePath, x.file from ( exec getTextFiles("path/foo.txt) ) x

Ramesh..

[lmann99]

Thanks, that works!  I've been using the 'flat file' wizard and just had to add the extra column...

1. select colA, colB, ..., colX, f.filePath from ( exec getTextFiles("path/foo.txt) AS f, TEXTTABLES(...) ) x