(what a contradictory phrase; "loli" is an inherently sexual term, it doesn't mean "anime little girl" it means "lolita complex")
"Loli" doesn't mean "lolita complex", "lolicon" does (though it's also now used to refer to a style of art that appeals to lolicons). You're right that "loli" doesn't mean "anime little girl"; it just means "little girl" and that's it (including real, anime, or whatever else, sexualised or not).