Ron
Veteran
The October 2009 file is now online.
http://www.worldcubeassociation.org/results/wcadump200910.xlsx
http://www.worldcubeassociation.org/results/wcadump200910.xlsx
WCA website crawling
- Thread starter Ron
- Start date
Ron
Veteran
We used this specific format of the results because we wanted to be able to sort the results on value.
Bryan
Premium Member
This doesn't work.
Does anyone happen to have the latest file that could export the results tables into CSV or MySQL format?
Ron
Veteran
Bryan,
The WCA server was migrated to a new server recently.
Not all files are on the new server yet. I will correct this later today.
Sorry,
Ron
The WCA server was migrated to a new server recently.
Not all files are on the new server yet. I will correct this later today.
Sorry,
Ron
Ranzha
Friendly, Neighbourhoodly
- Joined
- Jul 24, 2009
- Messages
- 2,551
- Location
- Reno, Nevada, United States
- WCA ID
- 2009HARN01
- YouTube
- Visit Channel
The server is down -sadfaec-.
Oh well, it'll be back up soon, amirite?
--R
Oh well, it'll be back up soon, amirite?
--R
Ron
Veteran
The main page is not working yet, but the deep links are: http://www.worldcubeassociation.org/results
Another problem is that accidentally most of the competition results have been deleted. We will correct that on Monday.
Bryan
Premium Member
OK, this link is working again. I have no access to a system that can convert the results table*, so if someone could get me a CSV or MySQL format of the results table, that would be good.
*- I use OpenOffice on my Linux system, OpenOffice on my home laptop, and my work laptop has MS Office, but the older versions can't read past 65,536 rows.
JBCM627
Veteran
Just got access to a computer with Excel 2007. I've uploaded a (compressed) .csv version of the results sheet here:
http://koii.cubingusa.com/cm/assets/files/wcadump200910.zip (1.65MB)
http://koii.cubingusa.com/cm/assets/files/wcadump200910.7z (1.32MB, whee)
I also had no idea that the .xlsx files were structured just by zipping the xml files and such up... if you treat the .xlsx as a .zip file, you can unzip it, and get the xml files that way. Sort of cool.
Last edited:
Bryan
Premium Member
Yeah, too bad the XML sucks
I did a lot of searching last night and found a python script that can convert an xlsx to a tsv file, which I can import into MySQL. I'll probably modify the python script so I can feed it the xlsx and it'll go right into the MySQL.JBCM627
Veteran
Well... Excel can also just save it as a tsv or csv, which is how I got that csv file. I thought that would be easier than a script, but I guess if you are automating it, that would be better.
Last edited:
hr.mohr
Veteran
The latest OpenOffice only displays 65.536 rows, if you save as CSV then all rows are exported.
Stefan
Legend
Got that down to 952KB with NanoZip and 732KB with paq8px. The latter admittedly took 16 minutes
. But wheeeeeee anyway.Though yeah, putting out CSV or SQL shouldn't be that hard and I doubt something speaks against it. I'm currently getting to work on the system again and will look into this, too.
Ron
Veteran
I am also pro SQL. Now if someone would help me solve the special characters problem...
hr.mohr
Veteran
What is the problem with special characters?
Ron
Veteran
If I use the export function in phpMyAdmin, then all special characters become garbage. So 'Frédérick Badie' becomes 'Fr~#8sd~#8srick Badie'.
I think I tried everything.
Bryan
Premium Member
November's file isn't there yet. I would like to update State Rankings for CubingUSA.
Stefan
Legend
Working on the new export right now, almost finished, sorry for the wait.
Stefan
Legend
Got Ron's OK to publish the new WCA export. Everything's built automatically with one click now, allowing more frequent updates. Let me know if something's problematic or unclear, or if you have suggestions for improvement.
Similar threads
