Finding Your Way Through Faulty Memories