The Socface Project: Large-Scale Collection, Processing, and Analysis of a Century of French Censuses - INED - Institut National Etudes Démographiques Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2024

The Socface Project: Large-Scale Collection, Processing, and Analysis of a Century of French Censuses

Mélodie Boillet
  • Fonction : Auteur
Solène Tarride
  • Fonction : Auteur
Yoann Schneider
  • Fonction : Auteur
Bastien Abadie
  • Fonction : Auteur
Christopher Kermorvant
  • Fonction : Auteur

Résumé

This paper presents a complete processing workflow for extracting information from French census lists from 1836 to 1936. These lists contain information about individuals living in France and their households. We aim at extracting all the information contained in these tables using automatic handwritten table recognition. At the end of the Socface project, in which our work is taking place, the extracted information will be redistributed to the departmental archives, and the nominative lists will be freely available to the public, allowing anyone to browse hundreds of millions of records. The extracted data will be used by demographers to analyze social change over time, significantly improving our understanding of French economic and social structures. For this project, we developed a complete processing workflow: large-scale data collection from French departmental archives, collaborative annotation of documents, training of handwritten table text and structure recognition models, and mass processing of millions of images. We present the tools we have developed to easily collect and process millions of pages. We also show that it is possible to process such a wide variety of tables with a single table recognition model that uses the image of the entire page to recognize information about individuals, categorize them and automatically group them into households. The entire process has been successfully used to process the documents of a departmental archive, representing more than 450,000 images.
Fichier principal
Vignette du fichier
socface_project_2024.pdf (4.81 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04608446 , version 1 (11-06-2024)

Licence

Identifiants

Citer

Mélodie Boillet, Solène Tarride, Yoann Schneider, Bastien Abadie, Lionel Kesztenbaum, et al.. The Socface Project: Large-Scale Collection, Processing, and Analysis of a Century of French Censuses. 2024. ⟨hal-04608446⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More