database - MySQL Merge tables - high-traffic and large amounts of data -

My work currently uses MySQL (MyISAM) specifically for all data collection, currently we have 300 There are more webservers and there are around 150 databases. Unfortunately I'm in a position to write a table structure to support more than 100 million rows over a period of 30 days. The idea is:

1. Inserts in high volumes (no updates are removed or always at the end of the table)
2. 1 row selection
3. Old data is thrown in comparison to 30 days

The best solution is to select a table for each day in the merge table. Actually there will be duplicate data, but SELECT will only pull a recent line based on a timestamp and a full field. Obviously 30 tables are not ideal, but rather they go to life.

Is there any inherent flaw with this approach? Are there any other ways to approach this thing that I'm missing (we got stuck on 5.0)? Can table locking be a big issue when the new day's table is created while ALTER TABLE on the merge table? We currently have a table rotation structure, but if we go with a single table, then the data we want from the old table will be very slow, because it will reach 100 million rows.

There are other technologies to accomplish this in a great way, but our sales team has already sold the solution and we do not have the luxury of time.

Any input will be appreciated.

structure:

  make table 'merge_test_1' (`dated_stamp`) long tap,` hash` four (32) not tap, `p_id` medium (8) unsigned No 'zero', 'A_ID' medium (8) unsigned, tap 'b_id' medium (8) unsigned null, primary key (`hash`,` p_id`, `date_stamp`)) engine = mice  

query example

If I am getting the origin of this question, then de SING will be redundant due to high-volume inserts, and, search based on MAX (ID) does not meet your criteria ... "SELECT will only drag the most recent row based on the timestamp and int."

Have you used a scene for this purpose? One seems pleasant for victory

For example.

  create table lotofdata (id INT uninstalled AUTO_INCREMENT, int_val INT UNAIGNED, the_timestamp TIMESTAMP, primary key); - View ID, int_val, the_timestamp with many data WHERE_timestamp = MAX (the_timestamp) and MAX (int_val) LIMIT 0,1;  

I hope this helps if you can provide table structure and a query example, then I want to help. I need some more features

Popular Posts

qt creator - QtCreator importing makefile projects -

Have you ever tried importing Classic C ++ / project into Qt Creator? Say that I wanted to use some libraries in my GUI project, which must be created. how can I do this? In Qt Creator 2.0.1 you can import projects using only * * Cmake, * .creator, * .pro or * .qmlproject Then switch to cmake and you can import the project into Qt builder (Welcome tab -> Open project ...). Alex

php - cURL Cookie and 307 redirect issue -

I currently have a script that loads my client using curls on another server Currently, the settings curl_setopt ($ CH, CURLOPT_RETURNTRANSFER, 1); Curl_setopt ($ CH, CURLOPT_FOLLOWLOCATION, TRUE); Curl_setopt ($ ch, CURLOPT_AUTOREFERER, true); Curl_setopt ($ ch, CURLOPT_USERAGENT, $ UserAgent); Curl_setopt ($ CH, CURLOPT_HEADER, 0); $ Usecookie = ROOT_PATH "/public_html/football_parser/cookie.txt"; If ($ usecookie) {if (! Is_writable ($ usecookie)) {return "$ usecookie can not write cookie file, change the file's permission to 777 or read only for windows."; } Curl_setopt ($ ch, CURLOPT_COOKIEJAR, $ usecookie); Curl_setopt ($ ch, CURLOPT_COOKIEFILE, $ usecookie); } $ Output = curl_xac ($ ch); I'm trying to load two example URLs statto.com/football/teams/newcastle-united/2005-2006/results and statto.com/football/teams/newcastle-united/2008-2009/results Without a second load without any problems curl_setopt ($ ch, CURLOPT_FOLLOWLOCATION, TR...

asp.net mvc 2 - Problem using WIF with IIS6 -

If there is a problem using sessionAuthenticationModule on IIS 6, the following exception occurs when you try to use the application Is: The data protection operation was unsuccessful. This may be due to the lack of user profile for the user thread of the current thread, which may occur when the thread is impersonated. It is possible to enable the profiles in IIS 7 which I am capable of doing but our hosting company uses IIS 6. Any thoughts to do? To make some effort, or just general thoughts? Stacktrace: [Cryptographic Expression: The data protection operation was unsuccessful. This may be due to the user profile not loading for the user reference of the current thread, which may occur when the thread is impersonated.] System. Security. Cryptography Protected data Protected (Byte [] userData, Byte [] Optional Encryption, Data Protection Scope Scope) +456 Microsoft. Identity MODEL. Web. Protected DataCookie Transform Encoding (byte [value]) +54 [Invalid Operation Expan...

Powered by Blogger