the same issue happened to me I ran a simulated battle against a lvl2 fortress with 0% attack penalty and I plugged in like 900 swordsman and 10 battering rams and it only did like 7000 damage a round?
I made this simulation myself. The 10 rams and 900 swordsmen broke the Fortress in one round, seems fair enough.