Did you heard of army saves? You send army away when you are not online on some distant gold coin. That way when you return, you have your army alive and some gold from attack. And if you dont live a lot of resources in your forts, you wont get hitted so much. And if people see you are attacking someone, they wont hit you so much. but if you dont attack at all, you are easy target.
If you were online more, you would be able to catch when they attack you and move your army from strongest guy and kill one of those 2 comming after him. High fort would really pay off in your case.
Because if those guys are still in your 2x after 2 months doing that, then they are not so good as they seem. Even pillaged, always destroyed empire can grow faster and after a time train army and get revenge.