I despised the Zelda games when I was a kid. I don't know why, but I thought they were stupid and boring (based on my 10 minutes of playing). Funny thing is that Zelda is pretty much my favorite game series.
The other was Street Fighter II. I remember going to an arcade once, and playing Turbo for the first time. I got murdered and tried again. After losing again, I gave up on the game and for years hated the series because of that one experience. Years later, I was 14 (I think) and I had $8 left on the Wii Shop Channel. For some odd reason, I downloaded Super Street Fighter II and played it. Initially I didn't care about it, but after a while I started enjoying it. I guess the less steep difficulty from the arcade to SNES made a difference in my liking of the game.
But hopefully one day I can live in the world of Zelda or Street Fighter. Actually, scratch that. I never want to live in a world where a single man can cause the ground to shake with a simple stomp and cause the entire screen to go black. D=