St Andrew's is unique: the oldest timber building in Britian, possibly in Europe. It is made up of large split logs placed vertically with the rounded face on the outside. The logs are grooved, and tongues of wood have been inserted between them to make the whole thing weatherproof. The split logs have been tree-ring dated to the late 11th century, and the church is Grade I listed.
The tower and spire are 18th century and the porch, 19th century.
Folklore links this ancient church to the story of a Saxon King, saint and martyr. In 869 Edmund, King of East Anglia, was killed by the Danes because he refused to renounce Christianity. He was beaten, shot with arrows and beheaded. His head was thrown into the woods where it was found by wolves, who protected it and howled out "Hic, Hic, Hic" ("Here, Here, Here") to the searchers so that it could be found. Edmund's body (and head) were taken to Bury.
Over time his reputation grew and a stone church was built to contain his relics. In due course, this became a shrine. For a long time, Edmund was the patron saint of England and many kings made a pilgrimage to visit his shrine. In 1010, to protect the relics from Viking raiders, the body was removed from Bury and taken to London temporarily but 3 years later, it was deemed safe to return it to its rightful place. The body is rumoured to have rested for a time in St Andrews on its long journey back to Bury St Edmunds in 1013.
There is no evidence to support this story, and the tree ring data would seem to undermine its authenticity so far as the current building goes. However there is archeological evidence of earlier Saxon churches on this site, so I like to think it is true.