My only short term suggestion would be something I saw some drivers do in trucking for this. Gloves.
I don't mean make a spectacle of yourself with mittens or latex surgical gloves like a criminal about to strike... Naww... I was surprised to see on
other drivers, how subtle and understated the finger less 'driving gloves' can be. Almost unnoticeable and especially in the colder months.
If anyone asks? You have a skin sensitivity issue, which is also one I've heard used in relation. It's not a bad excuse ...and doesn't invite tons
of questions to something I'm sure you'd prefer remain forgotten in daily life.