Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 General SQL Server Forums
 New to SQL Server Programming
 Data Warehousing Excel to SQL

Author  Topic 

cardullo4321
Starting Member

40 Posts

Posted - 2011-09-08 : 21:25:24
I am currently taking finished Excel files with no unique identifiers unless you combined about 5 or 6 columns together. The files hold our final calculations and I am uploading them into SQL with SSIS. I need to do month over month analysis and each monthly excel file is about 140mbs (impossible to do month to month analysis) However, my tables have no primary keys.

Everyone recommends a primary key but really do not see a total need. Can anyone suggest the best way to handle this situation? I have heard that maybe should put a timestamp on my data uploads. My database has multiple tables each from different reports. Then I do a insert union query on multiple tables into one summary table that are unique in each report but still need the detail in each report.

Gregory Cardullo

visakh16
Very Important crosS Applying yaK Herder

52326 Posts

Posted - 2011-09-09 : 02:17:26
i think it would be probably worth adding timestamp field. also are files containing incremental (delta) data for the month or is it kind of snapshot?

------------------------------------------------------------------------------------------------------
SQL Server MVP
http://visakhm.blogspot.com/

Go to Top of Page

thoden.it
Starting Member

4 Posts

Posted - 2011-09-19 : 03:21:42
up up, I have this problem, too.

Can you all help me to import data from Excel to SQL. I really don't know how to import,
I was export data from SQL to Excel, to refresh data, and now, I want to import roll back

If you can, contact me with my mail: thoden_it@yahoo.com.vn or instant messenger : tommy_1760

thanks for your's attention !


http://thodencnt.com
Go to Top of Page

visakh16
Very Important crosS Applying yaK Herder

52326 Posts

Posted - 2011-09-19 : 04:34:37
http://support.microsoft.com/kb/321686

------------------------------------------------------------------------------------------------------
SQL Server MVP
http://visakhm.blogspot.com/

Go to Top of Page

cardullo4321
Starting Member

40 Posts

Posted - 2011-09-19 : 10:14:43
I upload all of my data using SSIS packaging in Business Development Studio. When you upload it, you can also add derived columns. I originally using the Import and Export Wizard but that has major issues with upload large amounts of data.

Gregory Cardullo
Go to Top of Page

visakh16
Very Important crosS Applying yaK Herder

52326 Posts

Posted - 2011-09-19 : 10:31:57
quote:
Originally posted by cardullo4321

I upload all of my data using SSIS packaging in Business Development Studio. When you upload it, you can also add derived columns. I originally using the Import and Export Wizard but that has major issues with upload large amounts of data.

Gregory Cardullo


export/import wizard is same as ssis (its in fact small sized integration service tool driven by wizards and creates a ssis package on background) so not sure what was problem you faced with export import wizard which you overcame in ssis (unless you had some custom requirement)

------------------------------------------------------------------------------------------------------
SQL Server MVP
http://visakhm.blogspot.com/

Go to Top of Page

thoden.it
Starting Member

4 Posts

Posted - 2011-09-20 : 05:34:56
quote:
Originally posted by cardullo4321

I upload all of my data using SSIS packaging in Business Development Studio. When you upload it, you can also add derived columns. I originally using the Import and Export Wizard but that has major issues with upload large amounts of data.

Gregory Cardullo



yeah, I have a large amounts of data, I afraid it can import all my data

http://thodencnt.com
Go to Top of Page
   

- Advertisement -