database - MySQL Merge tables - high-traffic and large amounts of data -

My work currently uses MySQL (MyISAM) specifically for all data collection, currently we have 300 There are more webservers and there are around 150 databases. Unfortunately I'm in a position to write a table structure to support more than 100 million rows over a period of 30 days. The idea is:

1. Inserts in high volumes (no updates are removed or always at the end of the table)
2. 1 row selection
3. Old data is thrown in comparison to 30 days

The best solution is to select a table for each day in the merge table. Actually there will be duplicate data, but SELECT will only pull a recent line based on a timestamp and a full field. Obviously 30 tables are not ideal, but rather they go to life.

Is there any inherent flaw with this approach? Are there any other ways to approach this thing that I'm missing (we got stuck on 5.0)? Can table locking be a big issue when the new day's table is created while ALTER TABLE on the merge table? We currently have a table rotation structure, but if we go with a single table, then the data we want from the old table will be very slow, because it will reach 100 million rows.

There are other technologies to accomplish this in a great way, but our sales team has already sold the solution and we do not have the luxury of time.

Any input will be appreciated.

structure:

  make table 'merge_test_1' (`dated_stamp`) long tap,` hash` four (32) not tap, `p_id` medium (8) unsigned No 'zero', 'A_ID' medium (8) unsigned, tap 'b_id' medium (8) unsigned null, primary key (`hash`,` p_id`, `date_stamp`)) engine = mice  

query example If I am getting the origin of this question, then de SING will be redundant due to high-volume inserts, and, search based on MAX (ID) does not meet your criteria ... "SELECT will only drag the most recent row based on the timestamp and int." Have you used a scene for this purpose? One seems pleasant for victory For example. create table lotofdata (id INT uninstalled AUTO_INCREMENT, int_val INT UNAIGNED, the_timestamp TIMESTAMP, primary key); - View ID, int_val, the_timestamp with many data WHERE_timestamp = MAX (the_timestamp) and MAX (int_val) LIMIT 0,1; I hope this helps if you can provide table structure and a query example, then I want to help. I need some more features Get link Facebook X Pinterest Email Other Apps Comments Post a Comment Popular Posts IronPython in C#: No module named xmlrpclib - I am trying to create a web application with an interactive console for IronPython. When I try to import xmlrpclib into the General console of IronPython, it works. However, if I use IronPython inside my C # code, then it does not put an exception "a module named xmlrpclib", is it a known issue? Any solution to solve this issue? Here is the code: var testcode = @ "import xmlrpclib; apiarver = xmlrpclib.ServerProxy ('address', allow_none = true); print APIServer.Hello () ; "; Mystream str = newest Mystream (); ScriptEngine Engine = Python. Cretegenine (); Engine. Retyme.io asset output (str, system text encoding. ASCII); Engine. Serial.io.setuperoutput (str, systemtext.edcoding.aspx); ScriptScope scope = engine.CreateScope (); ScriptSource src = engine.CreateScriptSourceFromString (testCode); Src.Execute (scope); Sorry for the silly question, it has come to know that there is a path used by IronPathon inside me. The C # code was not correct. I ... qt creator - QtCreator importing makefile projects - Have you ever tried importing Classic C ++ / project into Qt Creator? Say that I wanted to use some libraries in my GUI project, which must be created. how can I do this? In Qt Creator 2.0.1 you can import projects using only * * Cmake, * .creator, * .pro or * .qmlproject Then switch to cmake and you can import the project into Qt builder (Welcome tab -> Open project ...). Alex php - cURL Cookie and 307 redirect issue - I currently have a script that loads my client using curls on another server Currently, the settings curl_setopt ($ CH, CURLOPT_RETURNTRANSFER, 1); Curl_setopt ($ CH, CURLOPT_FOLLOWLOCATION, TRUE); Curl_setopt ($ ch, CURLOPT_AUTOREFERER, true); Curl_setopt ($ ch, CURLOPT_USERAGENT, $ UserAgent); Curl_setopt ($ CH, CURLOPT_HEADER, 0); $ Usecookie = ROOT_PATH "/public_html/football_parser/cookie.txt"; If ($ usecookie) {if (! Is_writable ($ usecookie)) {return "$ usecookie can not write cookie file, change the file's permission to 777 or read only for windows."; } Curl_setopt ($ ch, CURLOPT_COOKIEJAR, $ usecookie); Curl_setopt ($ ch, CURLOPT_COOKIEFILE, $ usecookie); } $ Output = curl_xac ($ ch); I'm trying to load two example URLs statto.com/football/teams/newcastle-united/2005-2006/results and statto.com/football/teams/newcastle-united/2008-2009/results Without a second load without any problems curl_setopt ($ ch, CURLOPT_FOLLOWLOCATION, TR... Powered by Blogger