Last night the issue happened to me (again). It's happened enough that I have a saved backup of Snaek ready to go at all times since his stats and items don't matter as much as they do to players. It happened in a very short window which gave me a few breadcrumbs to chase. After implementing some new tests and rebooting, I was actually able to catch the issue before it happened, preventing a character from being corrupted. The character still cannot be logged in, but this time they are perfectly saved in the database without any need to rebuild. An error msg is now displayed indicating that there was a character issue and to email [email protected] to get it resolved. Still a minor inconvenience, but now both staff and players are aware of what's going on and resolving it is as simple as re-adding your account name to your character.
I consider this a huge win for a rare but damaging bug. No information is lost and only a minimal amount of downtime for the character occurs. A real win-win for the game. There's still work to be done in finding the root of the issue that is doing the disconnecting, but now we have a stop in place to prevent it from getting worse. If this happens to you, simply follow the instructions given and you'll be back in business in no time.
I'm still monitoring the issue, but when even the negative results look good, I start to get excited. This is the one bug that would hold up a launch and it is looking strongly like it has been defeated. It'll be nice to put that time and effort into other areas.