Mobility - Following a familiar journey

From my village into town is a familiar journey, as my husband has been taking me for the past 3 years in the car, but if someone asked me to drive myself there, I would not be able to due to not only anxiety, but for some other reasons that I do not know - I just cant keep directions in my head, for instance my husband once dropped me in town, and I needed to find a particular shop, which we went over on the google map before hand, I had been to town plenty of times with my husband before, but once I got into town, on my own, I had to phone my husband and he had to stay on the phone while I walked to the exact location giving me exact directions as I walked - I'm not sure if I would score points for this, and how would I back it up. Another instance is that we went into town to go to my husbands PIP assessment, we parked in the next car park along to the assessment centre, which was about 5 mins walk, but my husband actually had to give me directions from the car, to the centre, even down to each footpath to take, what side of the road to take, each dropped curb etc - I had been to the centre before, again I dont know why I cant manage. Apart from anxiety/depression/bipolar that I have documented.

Thank you for replying - I have not told my GP because I feel stupid, I shall have to be brave.