I managed to get rid of my hesitation.
Remember how you learned that 迷う means "to go astray" or "to get lost?" Well when you feel like you're about to go astray or get lost it causes hesitation. You end up with a lot of doubt about where to go or what to do. It's a natural progression.
You learned this reading already when you learned 迷う! Just swap the う for an い.