Mount Hermon Baptist Church was founded in July of 1877. On December 28, 1925, the church house caught fire and burned down so the congregation relocated services to the old Berlin Schoolhouse located on the right side of what is known today as Highway 302. When deciding to rebuild, opinions were split over where the new church building should be. 24 votes were in favor of rebuilding between the railroad crossing and the field on the left of the road near Dead Man's Branch while 18 votes favored the intersection of Highway 302 and Cedar Creek Road.
On the second Sunday in May of 1927, under the leadership of Reverend K.D. Smith, both locations were chosen resulting in the formations of Old Mount Hermon (modern day Mount Hermon Baptist Church) on the location where it sits today, and New Mount Hermon which ultimately became Berlin Baptist Church in 1964.
