I agree, actually. Whenever I travel I make it a point to take public transit because it not only allows me to get to know the place better, but it makes me feel like I'm more of a local instead of a tourist.
I have to say that one of the most interesting trips I've ever been on was taking the Greyhound from Duluth to Boston. I didn't feel like a local but I did meet an astonishing number of fascinating men.