ICDAR2019 Competition on Historical Book Analysis -HBA2019

Maroua Mehri (1, 2, 3, 4) , Pierre Héroux (1, 4) , Rémy Mullot (5) , Jean-Philippe Moreux (6) , Bertrand B. Couasnon (7) , Bill Barrett (8)

1 LITIS - Laboratoire d'Informatique, de Traitement de l'Information et des Systèmes
2 LATIS - Laboratory of Advanced Technology and Intelligent Systems
3 LATIS - Laboratory of Advanced Technology and Intelligent Systems (Ecole Nationale d'Ingénieurs de Sousse, Sousse University)
4 DocApp - LITIS - Equipe Apprentissage
5 L3I - Laboratoire Informatique, Image et Interaction - EA 2118
6 BnF - Bibliothèque nationale de France
7 IntuiDoc - intuitive user interaction for document
8 BYU - Brigham Young University

In this paper, we present an evaluative study of pixel-labeling methods using the HBA 1.0 dataset for historical book analysis. This study is held in the context of the 2 nd historical book analysis (HBA2019) competition and in conjunction with the 15 th IAPR international conference on document analysis and recognition (ICDAR2019). The HBA2019 competition provides a large experimental corpus and a thorough evaluation protocol to ensure an objective performance benchmarking of pixel-labeling document image methods. Two nested challenges are evaluated in the HBA2019 competition: Challenge 1 and Challenge 2. Challenge 1 evaluates how image analysis methods could discriminate the textual content from the graphical ones at pixel level. Challenge 2 assesses the capabilities of pixel-labeling methods to separate the textual content according to different text fonts (e.g. lowercase, uppercase, italic, etc.) at pixel level. During the competition, we received 52 and 38 different teams' registrations for Challenge 1 and Challenge 2, respectively and finally 5 of them submitted their results in each challenge. Qualitative and numerical results of the participating methods in both challenges are reported and discussed in this paper in order to provide a baseline for future evaluation studies in historical document image analysis. The evaluation shows that the method submitted by the NLPR-CASIA team achieves the highest performance in both challenges.

Mots clés: HBA 1.0 dataset; Historical book analysis; Pixel-labeling

Domaines: Traitement du texte et du document

Maroua Mehri, Pierre Héroux, Rémy Mullot, Jean-Philippe Moreux, Bertrand B. Couasnon, et al.. ICDAR2019 Competition on Historical Book Analysis -HBA2019. 15th International Conference on Document Analysis and Recognition, Sep 2019, Sydney, Australia. ⟨hal-02490897⟩