Mass flat file loading

Here is what I'm trying to do in SSIS:

- I have hundreds of flat files that were dumped during last several month from a legacy system. All files have consistent naming including date/time stamp and a prefix that defines what table will it end up in.

What I need is:

- build SSIS package to load exiting files

- build SSIS package to load files on daily basis in future

What would be the best way to loop through the file folder I imagine someone has done this before

I just need a pointer to what tools from SSIS are best fit for the job.

Dima.



Answer this question

Mass flat file loading

  • Drallab

    You have 2 options:

    1) Use the ForEach loop with the Foreach File Enumerator to loop over every file in the folder

    2) Use the MultiFlatFile connection manager.

    Research those 2 in BOL and see what works for you.

    -Jamie

     



  • Idev

    IF you've got lots of files to process you might consider having multiple packages running, that process specific folders, this is probably only needed if you have a multi processor server processing the files.

  • Mass flat file loading