He was previously married to Colleen Orgeron. He met his second wife, Kelly, at the 1996 Liberty Bowl and the couple has three boys. Upon returning to USC in 2010, Orgeron lived in a hotel across the street from the campus while his wife and children made their home in Louisiana.
Orgeron is known for his strong, gravelly voice, Cajun accent, and intensity while coaching. In 2006, during his time at Ole Miss, he was parodied in an internet video titled “Colonel Reb is Cryin’”.