All,
I need to load a 50 million records table monthly. Any suggestion about the best/fast way to do it
Thanks a lot
Need suggestion on loading a 50 million records table from Oracle
Hot Topic
- Row Order on View Results
- loging in to sql express
- openquery update and optimistic concurrency
- Works fine inside BI Dev. Studio, but fails when scheduling it in SQL server 2005.
- What are the current best practices for standardizing report layout and appearance?
- Upgrade from June CTP to Sept CTP - BKM
- Usage-based optimization in AS 2005
- Designing SSB queues, EA sample and unreliable interdependant NTFS tasks
- Unable to use Reporting Services
- UDF or trigonometric functions in an expression for a Derived Column?
SQL Server
- Problem writing a report on a generated Report Model
- database design - joins on which fields?
- SQLExpress database file auto-creation error
- Question about Redistributing SSIS
- running number
- Replication to IP addressed server
- Merge replication 101
- ado connection
- uninstalling everything??
- SQL Server 2005 data export wizard did not transfer stored procedures
Need suggestion on loading a 50 million records table from Oracle
Chip Zero
All
I tried today; it used 8 hours to load the data just from the Oracle table to the staging table on sql server 2005. It is unacceptable!!!
There are must be a better way to do it.
In the data flow, there is only an OLE DB source (from Oracle) ----> data conversion transformation(convert the CLOB type) ---------> OLE DB target (SQL server 2005)
Do I need to do more in the data flow What should I doMany Thanks
RogerO
There IS a better way of doing it. Scott Barrett has done loads of work on this sort of stuff and has written some great blogs on it. Especially this one: http://microsoftdw.blogspot.com/2005/11/final-storyhow-to-get-data-out-of.html.
Search this forum as well - you'll find loads of good stuff.
Lastly, if you do only one thing make sure its to read this fabulous post (http://www.sqljunkies.com/WebLog/donald_farmer/archive/2005/03/13/8819.aspx) on SSIS and Oracle from Donald Farmer, Group Program Manager for SSIS.
-Jamie