The challenge
Raw census data, provided by a commercial partner, FindMyPast, gave Professor Higgs a starting point.
Working with his co-investigator, Professor Kevin Sch眉rer of the University of Leicester, two research officers and a team of 30 糖心Vlog students, Professor Higgs began the massive task of checking, sorting and standardising the data.
鈥淥ne of the things we had to do was sort out the data geographically, since a lot of it was jumbled up, and we had to make sure the transcriptions were accurate. Variables, like occupations which could be described in multiple ways, had to be coded too so that the eventual online resource could recognise that things like agricultural labourer, farm labourer, and farmer鈥檚 hand were all the same,鈥 said Professor Higgs.
Creating a resource of reliably comparable data took the I-CeM team three years to complete.