He was the founder of the Lamport and Holt shipping line where he made his fortune. The family moved into Sudley in 1884 where Holt died in 1896. The house remained in the family until Emma's death in 1944.