One suggestion is to try a personalized gift. This would require more effort on your part, however - but the personal touch could go really far.
For instance, if you always meet with a particular business contact at a specific coffee shop or restaurant, a gift card for that location could be nice. If a business contact really enjoys a particular sports team, some sports memorabilia could work. If a business contact mentioned being interested in reading a particular book, go out and purchase that book for him/her.
I would stay away from giving them a generic gift (like cups, mouse pads, etc) with your company's logo on it, however. I've received such corporate schwag before and never felt any warm glow inside.