Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 SQL Server 2005 Forums
 SQL Server Administration (2005)
 Design for storing and querying historical data

Author  Topic 

lebedev
Posting Yak Master

126 Posts

Posted - 2007-08-02 : 12:25:52
I am working on a project, which involves displaying trends of certain aggregate values over time. For example, suppose we want to display how the number of active and inactive users changed over time.

One issue is how to store historical data. First of all, should I create a separate database for each historical snapshot or should I use one database for all snapshots? Second, our database size is a couple of gigabytes and replicating the entire database on a daily basis is not feasible. An alternative solution is to back up aggregate values, but how do I back up results of aggregate queries, where the user can specify a date range in the WHERE-clause? Another solution is to create fact tables from our relational schema and back those up.

Another issue is how to query historical data. Using multiple databases to store historical snapshots makes it harder to query.

As you can see there are several design alternatives and I would like to know how this sort of problem is generally solved in the industry. Does SQL Server provide any support for solving this problem?

Thanks.

rmiao
Master Smack Fu Yak Hacker

7266 Posts

Posted - 2007-08-02 : 23:10:59
Do you mean cubes in AS? It depends on data volumn, we create cube for each month.
Go to Top of Page

lebedev
Posting Yak Master

126 Posts

Posted - 2007-08-03 : 11:46:05
I read up on cubes in AS, but am not sure if I can use them in my application. My application accesses the database via JDBC and then displays the aggregate data in a chart. Is there a way I can take advantage of AS cubes with this set up? Can I query cube data via JDBC?

Thanks
Go to Top of Page

rmiao
Master Smack Fu Yak Hacker

7266 Posts

Posted - 2007-08-03 : 14:04:35
I thought you may use cubes since you mentioned backup aggregation values. Not sure how to pass MDX in jdbc.
Go to Top of Page

lebedev
Posting Yak Master

126 Posts

Posted - 2007-08-05 : 13:33:25
Does anybody know if it's possible or even feasible to access AS cube data via JDBC?
Go to Top of Page

spirit1
Cybernetic Yak Master

11752 Posts

Posted - 2007-08-05 : 15:55:37
not with MS JDBC driver

maybe this will help you:
http://www.simba.com/sql-to-mdx.htm

_______________________________________________
Causing trouble since 1980
blog: http://weblogs.sqlteam.com/mladenp
Go to Top of Page
   

- Advertisement -