There have been many articles lately on travelling to interesting places without a passport, now that rules have gone into effect requiring passports for travel to Canada, Mexico, and the Caribbean for those going by air (land and sea arrivals will require passports next year). I don't see what the big deal is. I've had a passport since I was 13. It only costs $95 or so and lasts for 10 years, that's cheaper than a driver's license.
Apparently around 25% of Americans have passports. That makes me embarrassed to be an American. To have 75% of your fellow citizens too ignorant and closed minded to travel abroad upsets me. Maybe that's why we have a negative perception in some countries, because we appear to be those who never want to venture out of their little world, who are afraid to go anywhere that English isn't spoken.
If you travel abroad often, good. If not, get off your ass, get a passport, and go explore the world.