There are a few antique shops in the Bazaar District -- rather grandly named, as they're mostly junk -- but if you're willing to dig through, sometimes you can find some pretty special things at good prices.
Alternately, there's always books, or one of the accessory shops!