Castles increase the defensive strength of any military units within the city by 1.0. They also cut crime by 50%.