Serving the Quantitative Finance Community

 
User avatar
daveangel
Posts: 5
Joined: October 20th, 2003, 4:05 pm

Database design

March 11th, 2010, 9:54 pm

QuoteOriginally posted by: jawabeanQuoteOriginally posted by: JP03from what I have read MYSQL is enterprise type DB and would need server process and server machine, balancing etc which itself is big job. Need people and time to setup and do these things (again speculating here), where in a off shelf product these things are not needed. Appreciate sharing you thoughts herelook, kdb is Godzilla compared to mySQL in terms of learning curve and use.mySQL started as the "kids DB", imho. it's most recently it's being marketed as enterprise class DB. have you heard of LAMP stack? linux-apache-mysql-php - that's what school kids used to do for cheapo web sites.try to install mySQL, it takes a few minutes to start using it. the good thing about is that it can scale, i.e. if you wanted to make it work on 1000 clients and terabytes of data, you can do it too, using clustering and other advanced stuff. you don't need a server. i'm running it on my laptop. it's not an embedded DB, like berkley, of course. it'll run as separate service.I have been playing around with Berkeley and I have to say I like it although I am not a database expert. I like the C++ API as its easy to use but there are a few gotchas.
knowledge comes, wisdom lingers
 
User avatar
quantstart
Posts: 0
Joined: March 7th, 2010, 11:16 am

Database design

March 12th, 2010, 7:49 am

Wha gotchas do you refer to, daveangel?
 
User avatar
exneratunrisk
Posts: 0
Joined: April 20th, 2004, 12:25 pm

Database design

March 12th, 2010, 9:09 am

Our FACTORY supported mySQL and MS SQL Server.We needed to stop mySQL support, because, using it, transaction processing became too much a bottle neck for the grid-enabled number crunching (every single valuation in a portfolio across scenario groups analysis is made persistent). Also with MS SQL we need tricks, but ...In general, for heavy transaction processing in the data-deluge age SQL will become THE bottle neck.
 
User avatar
yuryr
Posts: 0
Joined: November 5th, 2007, 12:47 pm

Database design

March 12th, 2010, 9:17 am

You can download free version of kdb+ and it might satisfy you, the limitations it puts on you might be not so restrictive after all. It doesn't expire.It is better for price history than SQL databases. I like it a lot.
 
User avatar
daveangel
Posts: 5
Joined: October 20th, 2003, 4:05 pm

Database design

March 12th, 2010, 9:18 am

QuoteOriginally posted by: quantstartWha gotchas do you refer to, daveangel?I should have read the manual more carefully. if you don't use exceptions (which I don't) its hard to figure out why it keeps throwing exceptions. I had a lot of fun dealing with secondary databases ... although the callback function looks simple, the memory management of the returned key should be done carefully.
knowledge comes, wisdom lingers
 
User avatar
DominicConnor
Posts: 41
Joined: July 14th, 2002, 3:00 am

Database design

March 12th, 2010, 6:26 pm

I also lean towards SQL Server, it will import Access DB's directly and is about the easiest to use of the major DBs.Yes, it's "enterprise" but has a nice GUI, wizards, good online help and if you go for the entry level stuff it's cheap or free.KDB is overkill for what you want, and both costs more and is considerably harder to use.Mysql will handle the work with ease, but I'm assuming that you aren't a DB professional and don't want to be, so it's a bit more work than it needs to be.Oracle is the least optimal choice because it's not as friendly, and costs more, and if you're really unlucky some shithead from Oracle will find out you're using it and try to make life hard for you, your boss, and the girl you met in the bar last year. However you do this be aware that Access has different ideas about data types than any real database. I've got an MS SQL Server manual which lists "differences between Access SQL and Microsoft SQL", that's how screwy it is. This can hit you with timestamps especially.
 
User avatar
quantstart
Posts: 0
Joined: March 7th, 2010, 11:16 am

Database design

March 13th, 2010, 9:48 am

QuoteOriginally posted by: DominicConnorI also lean towards SQL Server, it will import Access DB's directly and is about the easiest to use of the major DBs.Yes, it's "enterprise" but has a nice GUI, wizards, good online help and if you go for the entry level stuff it's cheap or free.KDB is overkill for what you want, and both costs more and is considerably harder to use.Mysql will handle the work with ease, but I'm assuming that you aren't a DB professional and don't want to be, so it's a bit more work than it needs to be.Oracle is the least optimal choice because it's not as friendly, and costs more, and if you're really unlucky some shithead from Oracle will find out you're using it and try to make life hard for you, your boss, and the girl you met in the bar last year. However you do this be aware that Access has different ideas about data types than any real database. I've got an MS SQL Server manual which lists "differences between Access SQL and Microsoft SQL", that's how screwy it is. This can hit you with timestamps especially.I'm currently working on a project with MS SQL, importing huge datasets from Excel (which is badly formatted). It is almost impossible to get it in. I believe in one instance I had to export as CSV, import into Access and then into MS SQL. Although, I'm inclined to believe this is the data's fault, not the products.
 
User avatar
quantmeh
Posts: 0
Joined: April 6th, 2007, 1:39 pm

Database design

March 15th, 2010, 2:34 pm

QuoteOriginally posted by: DominicConnorMysql will handle the work with ease, but I'm assuming that you aren't a DB professional and don't want to be, so it's a bit more work than it needs to be.mysql is easier to maintain and support than Oracle, SYbase or MS SQL server. i wouldn't use MS SQLServer unless in really special cases, the reason's that it runs only on Windows.don't use access for anything. it's for non-professionals like accountants or bus analyst, who are struggling with any technology. i worked with access a lot in the past, and wrote multi-user network apps. it's entirely possible but absolutely unnecessary hassle
 
User avatar
DominicConnor
Posts: 41
Joined: July 14th, 2002, 3:00 am

Database design

March 15th, 2010, 5:02 pm

Having used both mysql and MSSQL, I am surprised that anyone would come to the conclusion that MS isn't easier to drive.Yes, it only works on Windows, that is a real pain for some people, but if you're currently an Access user, that's not an issue.I agree that Access is not nice, I've been doing SQL since the 80s and Access still manages to fuck with my mind.
 
User avatar
Hansi
Posts: 41
Joined: January 25th, 2010, 11:47 am

Database design

March 15th, 2010, 5:07 pm

Anyone have a good suggestion to a MS Server management studio type interface applications for some of the other DB options? Such as MySQL and postgreSQL. I'm fine with command line but most people prefer a nice functional easy to use GUI.
 
User avatar
quantmeh
Posts: 0
Joined: April 6th, 2007, 1:39 pm

Database design

March 15th, 2010, 7:29 pm

QuoteOriginally posted by: HansiAnyone have a good suggestion to a MS Server management studio type interface applications for some of the other DB options? Such as MySQL and postgreSQL. I'm fine with command line but most people prefer a nice functional easy to use GUI.MySQL comes with MySQL admin GUI. it's adequate.i didn't touch it since installing the DB on my laptop a few months ago.
 
User avatar
quantmeh
Posts: 0
Joined: April 6th, 2007, 1:39 pm

Database design

March 15th, 2010, 7:34 pm

QuoteOriginally posted by: DominicConnorHaving used both mysql and MSSQL, I am surprised that anyone would come to the conclusion that MS isn't easier to drive."easier" is not a deifined term. for instance, if I want to back up MySQL table, I copy 3 files from its data dir. done. the same thing in MS Access in not easier. maybe writing SQL in Query builder is easier in Access to some people. to me it's a pain in the ass. if one wants a query builder there are things like TOAD for MySQL, which are better and easier than Access. if you work with databases on daily basis, Access is much more difficult to deal with. if you do DB queries once a month, maybe Access is a better option.
 
User avatar
Hansi
Posts: 41
Joined: January 25th, 2010, 11:47 am

Database design

March 15th, 2010, 9:02 pm

QuoteOriginally posted by: outrunQuoteOriginally posted by: HansiAnyone have a good suggestion to a MS Server management studio type interface applications for some of the other DB options? Such as MySQL and postgreSQL. I'm fine with command line but most people prefer a nice functional easy to use GUI.I don't know " MS Server management studio", but for postgreSQL you have pgAdmin3 which is good. For MySQL I always use phpMyAdmin (webbased on a local apache) which is very easy for all the database management needsThanks, phAdmin3 looks good. I use phpmyadmin on most webserver installs of MySQL I use but people around me are complaining about getting a native Windows application.QuoteOriginally posted by: jawabeanQuoteOriginally posted by: HansiAnyone have a good suggestion to a MS Server management studio type interface applications for some of the other DB options? Such as MySQL and postgreSQL. I'm fine with command line but most people prefer a nice functional easy to use GUI.MySQL comes with MySQL admin GUI. it's adequate.i didn't touch it since installing the DB on my laptop a few months ago.Hmm okay never seen this, is it part of the enterprise install then? Not the community or cluster version?