It will be much harder than they think, and in the process, they could lose it all, and the rest of us could end up freer than we've ever been before. Here's why.