I hear a lot of people talk about that problem, but I've never had it myself. I love to bring my 3DS to the movies, because I get there early, can get some game time in, and then shut it during the movie and street pass. That's how I've gotten most of my street passes, actually.
I think my form of adult gamer guilt comes in my backlog, I can afford more games than I can play now, which results in me having tons of games on my shelf that I've never played. I keep telling myself that I'm saving them for a time when I can't afford the new releases, but who am I kidding? I find a way to buy the games I'm excited about, even when times are lean.