I thought they canonically didn’t have memories of when they were animals.
I think it's more that an animal's memories aren't as sophisticated as a human's. The Friends don't have specific memories of being animals, but they know how they lived as animals.