I always preferred wearing lighter armour. If the armourer knows his craft, a thick leather vest will offer you sufficient protection to survive most skirmishes. Obviously it’s not as impenetrable as a coat of plate, but it’s also less restricting.
You must learn how to use these traits to your advantage – yes, a strong enough blow will cut through your protection, but it’s easier to train yourself how to move with such armour. More importantly, nothing stops you from wearing it even outside of battle, making you prepared for any surprise attacks. Try that with a chainmail and you’ll be chafed all over in no time.