Although many claimed that General Ulysses S. Grant was the person responsible for the most casualties during the war – in fact, it was Robert E. Lee. Proportionally, his army suffered heavier losses throughout the war.