Even though charging is still a thing in lore it’s probably nowhere near as effective/fast as in the game
And to address super powerful wizards having a way bigger magic pool to charge, maybe it’s more efficient for their own body/mind/magic organ/whatever to recharge itself than to take it from the environment lorewise?