I just looked and there's a vinyl "Shut Up And Play Your Guitar" on Amazon for $33, which isn't bad for a three album set, but its still $33. I was also wrong about "You Can't Do That On Stage Anymore Vol. II," the song "Sexual Harrassment In The Workplace" is actually on "Guitar" another good cd, as is Vol II of "You Can't Do That." I don't know how hard it is to get "Guitar" or the "You Can't Do That Anymore" series (there's a bunch of them, at least six) on vinyl, I don't think I've ever seen them on vinyl. I would definitely start with Shut Up and Play Your Guitar in any event.