Toughened or coarsened by their worldly lives, the other dissenters could shrug and move on, but Souter couldn’t. His whole life was being a judge.