I can't help but notice the tension between "I could leave my city of isolation, get sex, and come home refreshed" versus "I felt disposable as I drove home". Clearly, you were using "Mr. Last Straw" for sex, but then felt "triggered" because he dared let it show that he was just in it to "get sex", too. You were upset because in that moment he functioned as a mirror, and the reflection made you uncomfortable.
(The condom thing is a whole other issue, but was nevertheless douchey on his part.)
Could it be that you're wrestling with the whole idea of sex in the absence of genuine intimacy or companionship? You want some of the basic trappings of actual intimacy (i.e. feeling valued and appreciated), while also remaining "emotionally unavailable".
Casual sex, by definition, is disconnected, and involves each partner offering up their bodies (and their dignity) to the other as something disposable and without value. Mutual objectification is the name of the game.
One way or another, everything in life comes at a price.