The earlier house was rebuilt circa 1683 by William Cleare. The porticos (one now demolished) were added from the 1720s to 1730s by Vanbrugh and William Kent. Robert Adam added the colonnades in the 1770s.
The gardens have structures by William Kent and James Gibbs. Capability Brown created much of the landscape seen today.