Robert A. Heinlein, Time Enough for Love

A society that gets rid of all its troublemakers goes downhill.