Above the church, on the skyline, is a great gash on the side of the mountain caused by a landslide and it is this feature which gives the church and village its name Cwmyoy - the valley of the yoke.

Local tradition says the landslide was caused by a terrible earthquake during Christ’s crucifixion, when there was darkness over the whole land and the veil of the Temple was torn in two.

It is situated along The Cistercian Way, a long distance walk into the heart of Wales.