My guess: You haven't been able to get your total training queue time to where you are training something 24/7. This means your goal should be to have the queue where it is a bit more than your longest time away from the game, usually sleeping time or around 8-9hrs. The first thing you need, to be able to do this, is to have 5 training slots in your barracks. Yes, upgrading to that level will shorten the time for individual unit training, but having 5 slots gives you more to work with. Once you get the barracks up to 5 slots, then upgrading armories will increase the number of individual units training at one time, thus increasing the time it takes a slot to train them.
This is a common misconception in the beginning chapters of the game. It *feels* like if you're training them faster and can collect more often during the day you *should* have more troops. But, if you're losing several hours of time training zero units, it's hard to make up for that.
Note: as your training size increases, it will cost more supplies to train a slot of troops. Make sure you can keep up with this by keeping a sufficient number of upgraded workshops and using Power of Provision (PoP) spells when you're able to collect shorter term productions.