Well, before this planning didn't matter either. We were deciding things arcs in advance, plotting out the course of events. This can make for great stories and I wouldn't undo what we did, but it means that it's not much of a game anymore. It ended up bad enough that two or three of us were deciding how everything went behind the scenes while everyone else struggled to keep up.
This way, no one knows what's going to happen, we all have to roll with the punches.
It's not a perfect system, but we'll improve it as we go like we do with everything else. We could complicate things further with rules that allow for strategy to impact the rolls, but then those rules need modifiers to keep things in check, and at a certain point we might as well just play DnD.