Nearby Cloughmore and the Kilfeaghan Dolmen are big stones surrounded by legends. Cloughmore according to local legend was tossed across Carlingford Lough from the Cooley mountains opposite, during a fight between the legendary Irish giant Finn McCool and his arch rival Ruscaire, the Ice Giant. One can see the outline of a sleeping Finn McCool in the Mourne Mountains from some places in Rostrevor. Walking around the stone seven times will apparently bring good luck.

Kilfeaghan Dolmen is situated on the main Kilkeel to Newry road about three and three quarter miles from Rostrevor. It is a prehistoric dolmen and the site is dated between 2000 and 1000 BC. The capstone is said to be one of the biggest in Ireland and is estimated to weigh between 35 and 40 tons. Excavations at the site earlier this century unearthed various bones and pottery.