Browsing: uneven chemistry

I went on a date recently with a cool new guy I met on OK…

So how does swinging work if you are only sexually interested in one of the partners? Should you avoid them? Do you stand the risk of hurting the other side of the partnership if you are not interested in women or is this normal?