James Rigby was born in Pendlebury in Lancashire in about 1780.
Young James may have learned his trade as a hatter, then enlisted in the army. He served as a gunner in the Royal Artillery. he served overseas, possibly in India, for at least seven years.
On discharge from the army, James resumed his trade as a hatter in the town of Chatham in Kent.
James married twice, but his first wife died.
Mary Hayes was born in Chatham, Kent and was baptised there on 25 January 1797. Her parents were William hayes and Mary Row.
James and Mary were married at Gillingham, Kent on 7 May 1818. James was about 38 and Mary 21.
They set up a hat shop in the High Street of Chatham and raised a family of at least five children. The 1841 Census lists the couple living at the hat shop with four children.
James died in 1851 aged 67. Mary carried on the business for a number of years and died in 1857 aged 60.
James Henry, 1818–1819. Died in infancy.
Henry James, 1820–1851. Married Catharine Loft and had two children. Henry worked as a railway clerk and died of tuberculosis aged 31.
Eliza, 1822–1826. Died in childhood.
John Robert, 1825–1860. Married Matilda Cooper, and was trained as a hatter in his father's shop. No record of children has been found.
Edwin George, 1829–1913. Trained as a carpenter, Edwin married Eleanor Lott and emigrated to Australia. They had 13 children.
Ann Eliza, 1830–1906. Married William Elmore and had 10 children. William was a carpenter.
William Charles, 1832–1913. Trained as a printer, William married Harriet Caple. The couple also emigrated to Australia and tried their hand at gold mining before William established a very successful printing, publishing and bookselling business in Adelaide. They had seven children.