To start with what Swampers are you looking at? The trux's line are some good tires, for street use and wheeling, from what I've seen and run I would run them before BFG's on rig that see's allot of highway use. Now if your looking at Boogers, LTB's, SX's, or Bias TSL's, then you will be giving up allot of street use for off highway performance, and I would pass if your Jeep see's mostly highway miles, unless like others have said you have 2 sets of tires and swap them out.
As for running 33's w/ 4.10's it's not that big of a deal, it will remind you that your Jeep is a off road vehicle and not a sports car, but I ran 2 years with 34" LTBs with 4.10's and as long as I remembered to keep the pace down a little, and shift down more often it wasn't bad and my milage didn't suffer too bad. I also have a buddy who used to run 33" MT's on his 4 banger w/ 4.10's and he actually got better milage then stock as long as he remembered to drive it appropriately, and not try to drive like an ass. I know my Jeep would have done better but my motor was a little past the beat and tired stage of things and only had about half the ower it did stock so I had to be a little more aggresive with my driving to keep it moving.
Also don't be affraid of the d35 with 33's, my buddy has a TJ that he beats on off-road, thats running a lunch box locker on 33's w/ a 4.0l and in 5 years has only ever broke one set of stock shafts, and that happend while trying to drag another Jeep up a hill out of creek missing the front wheel from broken ball joints in a foot of snow. (boy does that sound like a BS story)
But of course like with anything else with Jeeps, for every opinion there is 3 more and this is all just my opinion so take it for what it's worth.