Defend only the lower file (2 gold mines) with lots of archers and ignore the upper, eventually you will have enough money to defend the upper file too (then mine from all 4 from there). Once boar riders are available it is very easy.
You need to spawn loads and loads of archers, if you have no +spawn upgrade you may need to use only one worker and 3 archer army.