No matter how far back you believe your personality development extends, the fact of the matter remains: all that we typically consider ourselves to be amounts to memory.
We are the sum of our previous choices. Our personalities are our karma. The ego is the cumulative result of a chain of actions we enacted. We may not have the episodic recall, but we embody the implicit memory. We are history, in this sense quite literally. We are habits of mind and body forged through our previous experience, however hidden or otherwise unavailable that previous experience might be for semantic breakdown or episodic display.
The question is: do we need to remember — episodically, semantically — before we can overcome the karma we have become?