Can people see if you are looking at their facebook profile?

[737]

Well to be honest, I've been visiting a friend's page a lot recently and I noticed a pattern on the left side of the facebook friend-list. His profile page keeps appearing on the left side of my page, while the rest of the people are random. While searching on details if there were really a patern, facebook clearly notifies us that the left bar friend system is based on the amount of interaction you had with that person. Well I never interact with that person through facebook, but I do visit his page alot. So the question is, can people see through my profile which profile I visited the most?
if i'm safe either way, would there be an explanation while his profile page keeps appearing. It seems that it comes from only one direction (me visiting his profile page)