Lord_Buscemi - Harvey Danger is a great call - that song is riotously funny too.
For me this is a tricky thread - most people consider The La's a one hit wonder, I consider them creators of an all-time classic album.......so......I would never list them myself.
But as anyone who knows me (and can you ever really "know" pacinoyes?) my beloved Power Pop genre lends itself to genuine one-hit wonders so with that in mind The Records "Starry Eyes" which made/ruined their career and they were initially a great band .......shame, that. Check out the stupendous "Girls That Don't Exist" too which I often post.............. but wasn't a hit