So, what I get from this is that Hinoka knew her own feelings already back then and has been holding back ever since, and the reason she doesn't like to be touched is simply that she's afraid she might overreact and do something that would ruin their friendship if there's too much physical contact between them.