Muxtape

On May 21st, Muxtape experienced an error that caused every song in the database to be overwritten with the wrong artist & title. I initially reported this as a malicious act, but after taking the site down and investigating further it was clear that it was a fault of the software, for which I am wholly responsible. The last available complete backup of the songs database was three weeks old; so while the site is now repaired and back online, most songs uploaded in the last three weeks have disappeared.

I’m truly sorry for this massive inconvenience. Data integrity is something I take seriously, and to prevent this from happening again we’ve started creating complete backups of the database twice a day. In addition, Muxtape will soon be joined by two more developers (as opposed to one developer who’s constantly distracted by everything else it takes to start and run a business/web site).

Thanks for your patience and understanding through this, and please contact us if you have any questions or concerns.

We’ve narrowed down the issue, but we’re triple-checking everything to make sure it doesn’t happen again before we bring the site back up. I’m very sorry to report that, contrary to what I said earlier, there’s going to be some lost data. I won’t drag out all the details, but Muxtape has two backup methods and they both failed in a particular way that screwed the other out of being useful. A perfect storm, if you will. I take full responsibility; there was a typo in the code a few weeks ago that I swore up and down had been fixed and it would’ve rendered this whole thing moot, but it somehow didn’t get saved and went unnoticed until now. Extremely frustrating.

What it boils down to is that only 15% or so of songs uploaded in the last three weeks (and 100% of songs before that point) are going to be restored. I’m very sorry about this, and I’m working with some brilliant minds to make sure it never happens again. Muxtape will be back online this afternoon.

We’re hard at work restoring the database, which is a little more involved than it would be otherwise thanks to various mitigating circumstances. Once the site comes back up, every single muxtape should be restored with all their songs in the right order. However, some songs uploaded in the last three weeks that have a custom title may need to be relabeled. We’re very sorry for the inconvenience, thanks for being patient during our downtime.

I don’t want to bring the site up again until I’m sure what happened this afternoon won’t get repeated, but there are backups of the overwritten data and I anticipate most of it being restored successfully.

Update: what initially appeared as someone gaining access to our server could have possibly been an accident. We are still investigating the cause of the problem. I’ve taken the site down temporarily as a precaution. Thanks for your understanding and patience.