Walmer Castle was built during the reign of Henry VIII, part of a network of castles built to repel an invasion from Europe. The Duke of Wellington died in Walmer Castle in 1852, he was Warden of the Cinque Ports at the time. Queen Elizabeth the Queen Mother was also Warden of the Cinque Ports until her death and occasionally stayed at Walmer Castle.