Making Equations Accessible in Scientific Documents

Shivansh Juyal; Sanjeev Sharma; Neha Jadhav; Volker Sorge; M. Balakrishnan

doi:10.1007/978-3-031-08648-9_4

Making Equations Accessible in Scientific Documents

Shivansh Juyal
, Sanjeev Sharma^*
, Neha Jadhav
, Volker Sorge
, M. Balakrishnan

^*Corresponding author for this work

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Unlike a standard text document, a STEM document not only consists of text information but different components such as tables, figures, captions, mathematical equations etc. This paper presents a novel technique to detect mathematical equations in PDF documents and convert those equations into a more accessible format such as Latex. We use visual features of the document to detect the mathematical equations using object detection and subsequently apply heuristics to the generated bounding boxes to precisely cover the complete equation. These detections are passed to a tool called Maxtract which will rewrite the equations in Latex.

Original language	English
Title of host publication	Computers Helping People with Special Needs
Subtitle of host publication	18th International Conference, ICCHP-AAATE 2022, Lecco, Italy, July 11–15, 2022, Proceedings, Part I
Editors	Klaus Miesenberger, Georgios Kouroupetroglou, Katerina Mavrou, Roberto Manduchi, Mario Covarrubias Rodriguez, Petr Penáz
Publisher	Springer
Pages	22-29
Number of pages	8
Edition	1
ISBN (Electronic)	9783031086489
ISBN (Print)	9783031086472
DOIs	https://doi.org/10.1007/978-3-031-08648-9_4
Publication status	Published - 1 Jul 2022
Event	Joint International Conference on Digital Inclusion, Assistive Technology, and Accessibility, ICCHP-AAATE 2022 - Lecco, Italy Duration: 11 Jul 2022 → 15 Jul 2022

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	13341
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	Joint International Conference on Digital Inclusion, Assistive Technology, and Accessibility, ICCHP-AAATE 2022
Country/Territory	Italy
City	Lecco
Period	11/07/22 → 15/07/22

Bibliographical note

Publisher Copyright:
© 2022, Springer Nature Switzerland AG.

Keywords

Accessibility
Digital accessibility
Heuristics
Object detection
STEM

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-031-08648-9_4

Cite this

Juyal, S., Sharma, S., Jadhav, N., Sorge, V., & Balakrishnan, M. (2022). Making Equations Accessible in Scientific Documents. In K. Miesenberger, G. Kouroupetroglou, K. Mavrou, R. Manduchi, M. Covarrubias Rodriguez, & P. Penáz (Eds.), Computers Helping People with Special Needs: 18th International Conference, ICCHP-AAATE 2022, Lecco, Italy, July 11–15, 2022, Proceedings, Part I (1 ed., pp. 22-29). (Lecture Notes in Computer Science; Vol. 13341). Springer. https://doi.org/10.1007/978-3-031-08648-9_4

Juyal, Shivansh ; Sharma, Sanjeev ; Jadhav, Neha et al. / Making Equations Accessible in Scientific Documents. Computers Helping People with Special Needs: 18th International Conference, ICCHP-AAATE 2022, Lecco, Italy, July 11–15, 2022, Proceedings, Part I. editor / Klaus Miesenberger ; Georgios Kouroupetroglou ; Katerina Mavrou ; Roberto Manduchi ; Mario Covarrubias Rodriguez ; Petr Penáz. 1. ed. Springer, 2022. pp. 22-29 (Lecture Notes in Computer Science).

@inproceedings{4b633cde68b44026afdc68f581c703e2,

title = "Making Equations Accessible in Scientific Documents",

abstract = "Unlike a standard text document, a STEM document not only consists of text information but different components such as tables, figures, captions, mathematical equations etc. This paper presents a novel technique to detect mathematical equations in PDF documents and convert those equations into a more accessible format such as Latex. We use visual features of the document to detect the mathematical equations using object detection and subsequently apply heuristics to the generated bounding boxes to precisely cover the complete equation. These detections are passed to a tool called Maxtract which will rewrite the equations in Latex.",

keywords = "Accessibility, Digital accessibility, Heuristics, Object detection, STEM",

author = "Shivansh Juyal and Sanjeev Sharma and Neha Jadhav and Volker Sorge and M. Balakrishnan",

note = "Publisher Copyright: {\textcopyright} 2022, Springer Nature Switzerland AG.; Joint International Conference on Digital Inclusion, Assistive Technology, and Accessibility, ICCHP-AAATE 2022 ; Conference date: 11-07-2022 Through 15-07-2022",

year = "2022",

month = jul,

day = "1",

doi = "10.1007/978-3-031-08648-9\_4",

language = "English",

isbn = "9783031086472",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "22--29",

editor = "Klaus Miesenberger and Georgios Kouroupetroglou and Katerina Mavrou and Roberto Manduchi and \{Covarrubias Rodriguez\}, Mario and Petr Pen{\'a}z",

booktitle = "Computers Helping People with Special Needs",

edition = "1",

}

Juyal, S, Sharma, S, Jadhav, N, Sorge, V & Balakrishnan, M 2022, Making Equations Accessible in Scientific Documents. in K Miesenberger, G Kouroupetroglou, K Mavrou, R Manduchi, M Covarrubias Rodriguez & P Penáz (eds), Computers Helping People with Special Needs: 18th International Conference, ICCHP-AAATE 2022, Lecco, Italy, July 11–15, 2022, Proceedings, Part I. 1 edn, Lecture Notes in Computer Science, vol. 13341, Springer, pp. 22-29, Joint International Conference on Digital Inclusion, Assistive Technology, and Accessibility, ICCHP-AAATE 2022, Lecco, Italy, 11/07/22. https://doi.org/10.1007/978-3-031-08648-9_4

Making Equations Accessible in Scientific Documents. / Juyal, Shivansh; Sharma, Sanjeev; Jadhav, Neha et al.
Computers Helping People with Special Needs: 18th International Conference, ICCHP-AAATE 2022, Lecco, Italy, July 11–15, 2022, Proceedings, Part I. ed. / Klaus Miesenberger; Georgios Kouroupetroglou; Katerina Mavrou; Roberto Manduchi; Mario Covarrubias Rodriguez; Petr Penáz. 1. ed. Springer, 2022. p. 22-29 (Lecture Notes in Computer Science; Vol. 13341).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Making Equations Accessible in Scientific Documents

AU - Juyal, Shivansh

AU - Sharma, Sanjeev

AU - Jadhav, Neha

AU - Sorge, Volker

AU - Balakrishnan, M.

PY - 2022/7/1

Y1 - 2022/7/1

N2 - Unlike a standard text document, a STEM document not only consists of text information but different components such as tables, figures, captions, mathematical equations etc. This paper presents a novel technique to detect mathematical equations in PDF documents and convert those equations into a more accessible format such as Latex. We use visual features of the document to detect the mathematical equations using object detection and subsequently apply heuristics to the generated bounding boxes to precisely cover the complete equation. These detections are passed to a tool called Maxtract which will rewrite the equations in Latex.

AB - Unlike a standard text document, a STEM document not only consists of text information but different components such as tables, figures, captions, mathematical equations etc. This paper presents a novel technique to detect mathematical equations in PDF documents and convert those equations into a more accessible format such as Latex. We use visual features of the document to detect the mathematical equations using object detection and subsequently apply heuristics to the generated bounding boxes to precisely cover the complete equation. These detections are passed to a tool called Maxtract which will rewrite the equations in Latex.

KW - Accessibility

KW - Digital accessibility

KW - Heuristics

KW - Object detection

KW - STEM

UR - https://www.scopus.com/pages/publications/85134333168

U2 - 10.1007/978-3-031-08648-9_4

DO - 10.1007/978-3-031-08648-9_4

M3 - Conference contribution

AN - SCOPUS:85134333168

SN - 9783031086472

T3 - Lecture Notes in Computer Science

SP - 22

EP - 29

BT - Computers Helping People with Special Needs

A2 - Miesenberger, Klaus

A2 - Kouroupetroglou, Georgios

A2 - Mavrou, Katerina

A2 - Manduchi, Roberto

A2 - Covarrubias Rodriguez, Mario

A2 - Penáz, Petr

PB - Springer

T2 - Joint International Conference on Digital Inclusion, Assistive Technology, and Accessibility, ICCHP-AAATE 2022

Y2 - 11 July 2022 through 15 July 2022

ER -

Juyal S, Sharma S, Jadhav N, Sorge V, Balakrishnan M. Making Equations Accessible in Scientific Documents. In Miesenberger K, Kouroupetroglou G, Mavrou K, Manduchi R, Covarrubias Rodriguez M, Penáz P, editors, Computers Helping People with Special Needs: 18th International Conference, ICCHP-AAATE 2022, Lecco, Italy, July 11–15, 2022, Proceedings, Part I. 1 ed. Springer. 2022. p. 22-29. (Lecture Notes in Computer Science). doi: 10.1007/978-3-031-08648-9_4