Death was the judge. The Reapers were the executioners. Death was the one who decided who the Reapers would visit and exact their justice.