From wordorigins.org:

The selfish connotation comes from hogging a marijuana cigarette. Someone who kept the joint in their mouth, hanging from their lip like Bogey, would be bogarting the joint. Instead of bogarting, one should pass it on to another. The term can be used for hoarding items other than pot.

The term is first attested to in the song Don't Bogart Me, by Elliot Ingber and Larry Wagner, which appears on Fraternity Of Man's eponymous album, released 24 June 1968 by ABC Records. The song was featured the next year in the movie Easy Rider and is on that movie's soundtrack. (The song was later covered by the band Little Feat under the title Don't Bogart That Joint.)

Think I first heard it on Beavis and Butthead.