Vitamin B12 is crucial for memory, so if you're deficient in it you could experience forgetfulness. A vitamin D deficiency could also put you at risk for memory-impairing conditions like Alzheimers.