As a teenager in Chicago, Goldberg sat in with Muddy Waters, Otis Rush, and Howlin' Wolf. He played keyboardsin the band supporting Bob Dylan during his 1965 newly 'electrified' appearance at the Newport Folk Festival. He formed The Electric Flag with Mike Bloomfield in 1967, and later formed the Barry Goldberg Reunion in 1968.
Goldberg's songs (some of which co-written with Gerry Goffin) have been recorded by many musicians includingRod Stewart, Gladys Knight, Joe Cocker, Steve Miller, Bobby "Blue" Bland, Gram Parsons and B. J. Thomas.
Goldberg's first professional recording session was "Devil With The Blue Dress On" / "Good Golly Miss Molly" byMitch Ryder & the Detroit Wheels. Among the albums he contributed to are Leonard Cohen's Death of a Ladies' Man, The Ramones' End of the Century, The Flying Burrito Brothers' The Gilded Palace of Sin, and Super Session which featured Michael Bloomfield, Stephen Stills, and Al Kooper.
Goldberg also has co-produced albums by Percy Sledge including Blue Night (Grammy nominated and WC Handy soul album of the year) as well as Shining Through the Rain, Charlie Musselwhite, James Cotton, The Textones plus Bob Dylan's version of Curtis Mayfield's "People Get Ready".
In 1992 he played keyboards with the Carla Olson & Mick Taylor band, which resulted in the live CD Too Hot for Snakes, featuring the talents of artists like Ian McLagan, and Jesse Sublett, and John "Juke" Logan.
In 1994, Goldberg and Saul Davis produced Blue Night by Percy Sledge, which featured Bobby Womack, Steve Cropper, Mick Taylor, Greg Leisz, Bob Glaub, Ed Greene, Mikael Rickfors, the Waters... and songs written by Rickfors, Gregg Sutton, Pat Robinson, Carla Olson, the Bee Gees, Quinton Claunch, Fats Domino, and Otis Redding.
2004: Shining Through The Rain by Percy also co-produced by Davis and Goldberg, featuring Larry Byrom, Denny Freeman, Clayton Ivey, Ed Greene, Phil Upchurch, Bob Glaub, the Waters, Jakob Dylan... and songs by the Bee Gees, Mikael Rickfors, Carla Olson, Jackie Lomax, Earl Carson, Bobby Moore.
In 2002, he was featured on the Bo Diddley tribute album Hey Bo Diddley - A Tribute!, playing piano on the songs "Pills", "I'm A Man" and "Before You Accuse Me". (produced by Carla Olson). Carla also produced Barry's "Stoned Again" album which featured Denny Freeman, Mick Taylor and Ernie Watts.