While you only spend 1 or 2 gems for those quick upgrades, but those gems can add up quickly if you’re not paying attention.
While minor, you can still avoid the quick build option the game suggests to you during the tutorial by waiting for your upgrades. Lots of sources say to save your gems early on so that you can get more builders quickly. Wait out the building process in the beginning. I thought I’d provide some of my experience with being a late comer to the game and some things I’ve found to help me out when playing (some really beginner things). Clash of clans has been a long running game with a huge fan following and with that, plenty of guides and resources on how to get the best out of your experience with this big title.