Will people know which way I swipe when I come across their profile?

No, it’s completely anonymous. Users will only know which way another user swiped on them if both users swiped right on each other, creating a connection.