Moderate republicans agreed with Lincoln's ideals. They believed that the seceded states should be restored to the Union swiftly and on the terms of Congress, not the President. The radical republicans believed that the South should pay dearly for their crimes. The radicals wanted to social structure of the South to be changed before it was restored to the Union. They wanted the planters punished and the blacks protected by federal power. They were against Abraham Lincoln.