James was the youngest of eight children and was born in Spartanburg. His mother died when he was infant, and his grandmother Vicey Rice raised him while his father worked to support the family. As a child in the projects, he picked up the nickname "Patch" because his play clothes were often covered with patches.

James credits his teachers and family as his main source of inspiration as a teenager. They encouraged him when he graduated from Carver High School and earned his way through college on multiple athletic scholarships. James received his B.S. degree in Math and Science from Livingstone College in Salisbury, NC. James then served four years in the Navy before returning to South Carolina and starting a career in teaching. James first taught in Greenville County before transferring to his alma mater, Carver High School. During desegregation in the 70s, James transferred to Spartanburg High School and remained there until he retired in 1993.

James held a seat on Spartanburg City Council for eleven years. In 1993, when the current mayor resigned, James became Mayor of Spartanburg. After serving six months as mayor, he ran to serve a full four-year term and won by a landslide, receiving 75% of the vote. He served as mayor for two terms.

In 2000, the James E Talley Resource Center was founded by the Spartanburg Housing Authority. One of their programs involved an after-school tutoring program utilizing retired teachers. As a result of the program, several students were able to go on to college on full scholarships. In 2002, the City of Spartanburg honored James by naming the "James E Talley Bridge" after him in honor of his numerous and outstanding accomplishments as Mayor of Spartanburg.

James has taken an active role in several organization including the South Carolina Municipal Association, Spartanburg Development Corporation, Uptown Optimist Club, Special Olympics, Converse College Advisory Board, Omega Psi Phi Fraternity, Commission on Minority Affairs for South Carolina, the Board of the Appalachian Council of Governments, and the Advisory Board for USC-Upstate.

James currently serves as a Magistrate for Spartanburg County. James has two children, Diedre and Carlton, and two grandchildren, Tianna and Brandon. James is an active member of the Bunton Institutional CME Church in Spartanburg. For his inspirational story and continuing outstanding contributions to his community, 107.3 JAMZ is proud to salute The Honorable James E. Talley as a 2008 Upstate Black History Maker.