The song is best known for its lengthy saxophone solos, performed by Tom Scott, while King sings an ode to "the Jazzman" and the effect he has on her. Curtis Amy, saxophonist, composer, and former musical director for the Ray Charles band, was the "jazz man" of the song.
Shortly after arriving on the Billboard Hot 100 the single rose to the #2 spot for a week in mid-November 1974 (stuck behind "You Ain't Seen Nothing Yet" by Bachman Turner Overdrive). The song also reached No. 4 on the Billboard easy listening chart. The B-side of the "Jazzman" single was "You Go Your Way, I'll Go Mine".
The song is prominently featured in the Simpsons episode "'Round Springfield", sung by Yeardley Smith as Lisa Simpson. The song is presented as a duet between Lisa and recurring character Bleeding Gums Murphy, who plays the saxophone.
Bonnie Koloc also recorded a song called "Jazzman" on her album After All This Time in 1971. Composed by Ed Holstein, a Chicago-based folk musician, this song was also recorded by Pure Prairie League, Steve Goodman, Tom Rush, Martin Simpson, and Bette Midler.