I think it's better if you have one of your towers destroyed. That way you're not splitting up your defenses to cover 3 towers spread on the lower portion of the map, you're covering two, allowing you to try and take hold of the choke point a bit easier.