When I can’t find an ATM without fees, I just go into the nearest grocery store, and buy something small and pay for with the ATM card and ask for cashback. In urban areas I look for a drugstore like Walgreens. I’ve never had a surcharge, and it’s a ‘purchase’ so your own bank won’t charge you either for using a foreign ATM.
But what should you buy? If you buy something useless, that’s wasting money too right? If I see something on sale or need something anyways I’ll get it, but my standby is stamps. You’ll use them up sooner or later, the price is the same everywhere, and they don’t lose value.