Multi-laboratory performance assessment of diffuse optics instruments: the BitMap exercise

Pranav Lanka; Lin Yang; David Orive-Miguel; Joshua Deepak Veesa; Susanna Tagliabue; Aleh Sudakou; Saeed Samaei; Mario Forcione; Zuzana Kovacsova; Anurag Behera; Thomas Gladytz; Dirk Grosenick; Lionel Hervé; Turgut Durduran; Karolina Bejm; Magdalena Morawiec; Michał Kacprzak; Piotr Sawosz; Anna Gerega; Adam Liebert; Antonio Belli; Ilias Tachtsidis; Frédéric Lange; Gemma Bale; Luca Baratelli; Sylvain Gioux; Kalyanov Alexander; Martin Wolf; Sanathana Konugolu Venkata Sekar; Marta Zanoletti; Ileana Pirovano; Michele Lacerenza; Lina Qiu; Edoardo Ferocino; Giulia Maffeis; Caterina Amendola; Lorenzo Colombo; Lorenzo Frabasile; Pietro Levoni; Mauro Buttafava; Marco Renna; Laura Di Sieno; Rebecca Re; Andrea Farina; Lorenzo Spinelli; Alberto Dalla Mora; Davide Contini; Paola Taroni; Alberto Tosi; Alessandro Torricelli; Hamid Dehghani; Heidrun Wabnitz; Antonio Pifferi

doi:10.1117/1.JBO.27.7.074716

Multi-laboratory performance assessment of diffuse optics instruments: the BitMap exercise

Pranav Lanka, Lin Yang, David Orive-Miguel, Joshua Deepak Veesa, Susanna Tagliabue, Aleh Sudakou, Saeed Samaei, Mario Forcione, Zuzana Kovacsova, Anurag Behera, Thomas Gladytz, Dirk Grosenick, Lionel Hervé, Turgut Durduran, Karolina Bejm, Magdalena Morawiec, Michał Kacprzak, Piotr Sawosz, Anna Gerega, Adam LiebertAntonio Belli, Ilias Tachtsidis, Frédéric Lange, Gemma Bale, Luca Baratelli, Sylvain Gioux, Kalyanov Alexander, Martin Wolf, Sanathana Konugolu Venkata Sekar, Marta Zanoletti, Ileana Pirovano, Michele Lacerenza, Lina Qiu, Edoardo Ferocino, Giulia Maffeis, Caterina Amendola, Lorenzo Colombo, Lorenzo Frabasile, Pietro Levoni, Mauro Buttafava, Marco Renna, Laura Di Sieno, Rebecca Re, Andrea Farina, Lorenzo Spinelli, Alberto Dalla Mora, Davide Contini, Paola Taroni, Alberto Tosi, Alessandro Torricelli, Hamid Dehghani, Heidrun Wabnitz, Antonio Pifferi

Research output: Contribution to journal › Article › peer-review

34 Downloads (Pure)

Abstract

SIGNIFICANCE: Multi-laboratory initiatives are essential in performance assessment and standardization-crucial for bringing biophotonics to mature clinical use-to establish protocols and develop reference tissue phantoms that all will allow universal instrument comparison.

AIM: The largest multi-laboratory comparison of performance assessment in near-infrared diffuse optics is presented, involving 28 instruments and 12 institutions on a total of eight experiments based on three consolidated protocols (BIP, MEDPHOT, and NEUROPT) as implemented on three kits of tissue phantoms. A total of 20 synthetic indicators were extracted from the dataset, some of them defined here anew.

APPROACH: The exercise stems from the Innovative Training Network BitMap funded by the European Commission and expanded to include other European laboratories. A large variety of diffuse optics instruments were considered, based on different approaches (time domain/frequency domain/continuous wave), at various stages of maturity and designed for different applications (e.g., oximetry, spectroscopy, and imaging).

RESULTS: This study highlights a substantial difference in hardware performances (e.g., nine decades in responsivity, four decades in dark count rate, and one decade in temporal resolution). Agreement in the estimates of homogeneous optical properties was within 12% of the median value for half of the systems, with a temporal stability of <5 % over 1 h, and day-to-day reproducibility of <3 % . Other tests encompassed linearity, crosstalk, uncertainty, and detection of optical inhomogeneities.

CONCLUSIONS: This extensive multi-laboratory exercise provides a detailed assessment of near-infrared Diffuse optical instruments and can be used for reference grading. The dataset-available soon in an open data repository-can be evaluated in multiple ways, for instance, to compare different analysis tools or study the impact of hardware implementations.

Original language	English
Article number	074716
Number of pages	27
Journal	Journal of Biomedical Optics
Volume	27
Issue number	7
Early online date	15 Jun 2022
DOIs	https://doi.org/10.1117/1.JBO.27.7.074716
Publication status	Published - Jul 2022

Keywords

absorption
diffuse optics
near-infrared spectroscopy
phantom
scattering

Access to Document

10.1117/1.JBO.27.7.074716Licence: Creative Commons: Attribution (CC BY)

LankaP2022MultiFinal published version, 6.01 MBLicence: Creative Commons: Attribution (CC BY)

Cite this

Lanka, P., Yang, L., Orive-Miguel, D., Veesa, J. D., Tagliabue, S., Sudakou, A., Samaei, S., Forcione, M., Kovacsova, Z., Behera, A., Gladytz, T., Grosenick, D., Hervé, L., Durduran, T., Bejm, K., Morawiec, M., Kacprzak, M., Sawosz, P., Gerega, A., ... Pifferi, A. (2022). Multi-laboratory performance assessment of diffuse optics instruments: the BitMap exercise. Journal of Biomedical Optics, 27(7), Article 074716. Advance online publication. https://doi.org/10.1117/1.JBO.27.7.074716

@article{87b09575067147ee81d0455eec6254a9,

title = "Multi-laboratory performance assessment of diffuse optics instruments: the BitMap exercise",

abstract = "SIGNIFICANCE: Multi-laboratory initiatives are essential in performance assessment and standardization-crucial for bringing biophotonics to mature clinical use-to establish protocols and develop reference tissue phantoms that all will allow universal instrument comparison.AIM: The largest multi-laboratory comparison of performance assessment in near-infrared diffuse optics is presented, involving 28 instruments and 12 institutions on a total of eight experiments based on three consolidated protocols (BIP, MEDPHOT, and NEUROPT) as implemented on three kits of tissue phantoms. A total of 20 synthetic indicators were extracted from the dataset, some of them defined here anew.APPROACH: The exercise stems from the Innovative Training Network BitMap funded by the European Commission and expanded to include other European laboratories. A large variety of diffuse optics instruments were considered, based on different approaches (time domain/frequency domain/continuous wave), at various stages of maturity and designed for different applications (e.g., oximetry, spectroscopy, and imaging).RESULTS: This study highlights a substantial difference in hardware performances (e.g., nine decades in responsivity, four decades in dark count rate, and one decade in temporal resolution). Agreement in the estimates of homogeneous optical properties was within 12% of the median value for half of the systems, with a temporal stability of <5 % over 1 h, and day-to-day reproducibility of <3 % . Other tests encompassed linearity, crosstalk, uncertainty, and detection of optical inhomogeneities.CONCLUSIONS: This extensive multi-laboratory exercise provides a detailed assessment of near-infrared Diffuse optical instruments and can be used for reference grading. The dataset-available soon in an open data repository-can be evaluated in multiple ways, for instance, to compare different analysis tools or study the impact of hardware implementations.",

keywords = "absorption, diffuse optics, near-infrared spectroscopy, phantom, scattering",

author = "Pranav Lanka and Lin Yang and David Orive-Miguel and Veesa, {Joshua Deepak} and Susanna Tagliabue and Aleh Sudakou and Saeed Samaei and Mario Forcione and Zuzana Kovacsova and Anurag Behera and Thomas Gladytz and Dirk Grosenick and Lionel Herv{\'e} and Turgut Durduran and Karolina Bejm and Magdalena Morawiec and Micha{\l} Kacprzak and Piotr Sawosz and Anna Gerega and Adam Liebert and Antonio Belli and Ilias Tachtsidis and Fr{\'e}d{\'e}ric Lange and Gemma Bale and Luca Baratelli and Sylvain Gioux and Kalyanov Alexander and Martin Wolf and Sekar, {Sanathana Konugolu Venkata} and Marta Zanoletti and Ileana Pirovano and Michele Lacerenza and Lina Qiu and Edoardo Ferocino and Giulia Maffeis and Caterina Amendola and Lorenzo Colombo and Lorenzo Frabasile and Pietro Levoni and Mauro Buttafava and Marco Renna and {Di Sieno}, Laura and Rebecca Re and Andrea Farina and Lorenzo Spinelli and {Dalla Mora}, Alberto and Davide Contini and Paola Taroni and Alberto Tosi and Alessandro Torricelli and Hamid Dehghani and Heidrun Wabnitz and Antonio Pifferi",

year = "2022",

month = jul,

doi = "10.1117/1.JBO.27.7.074716",

language = "English",

volume = "27",

journal = "Journal of Biomedical Optics",

issn = "1083-3668",

publisher = "Society of Photo-Optical Instrumentation Engineers",

number = "7",

}

Lanka, P, Yang, L, Orive-Miguel, D, Veesa, JD, Tagliabue, S, Sudakou, A, Samaei, S, Forcione, M, Kovacsova, Z, Behera, A, Gladytz, T, Grosenick, D, Hervé, L, Durduran, T, Bejm, K, Morawiec, M, Kacprzak, M, Sawosz, P, Gerega, A, Liebert, A, Belli, A, Tachtsidis, I, Lange, F, Bale, G, Baratelli, L, Gioux, S, Alexander, K, Wolf, M, Sekar, SKV, Zanoletti, M, Pirovano, I, Lacerenza, M, Qiu, L, Ferocino, E, Maffeis, G, Amendola, C, Colombo, L, Frabasile, L, Levoni, P, Buttafava, M, Renna, M, Di Sieno, L, Re, R, Farina, A, Spinelli, L, Dalla Mora, A, Contini, D, Taroni, P, Tosi, A, Torricelli, A, Dehghani, H, Wabnitz, H & Pifferi, A 2022, 'Multi-laboratory performance assessment of diffuse optics instruments: the BitMap exercise', Journal of Biomedical Optics, vol. 27, no. 7, 074716. https://doi.org/10.1117/1.JBO.27.7.074716

TY - JOUR

T1 - Multi-laboratory performance assessment of diffuse optics instruments

T2 - the BitMap exercise

AU - Lanka, Pranav

AU - Yang, Lin

AU - Orive-Miguel, David

AU - Veesa, Joshua Deepak

AU - Tagliabue, Susanna

AU - Sudakou, Aleh

AU - Samaei, Saeed

AU - Forcione, Mario

AU - Kovacsova, Zuzana

AU - Behera, Anurag

AU - Gladytz, Thomas

AU - Grosenick, Dirk

AU - Hervé, Lionel

AU - Durduran, Turgut

AU - Bejm, Karolina

AU - Morawiec, Magdalena

AU - Kacprzak, Michał

AU - Sawosz, Piotr

AU - Gerega, Anna

AU - Liebert, Adam

AU - Belli, Antonio

AU - Tachtsidis, Ilias

AU - Lange, Frédéric

AU - Bale, Gemma

AU - Baratelli, Luca

AU - Gioux, Sylvain

AU - Alexander, Kalyanov

AU - Wolf, Martin

AU - Sekar, Sanathana Konugolu Venkata

AU - Zanoletti, Marta

AU - Pirovano, Ileana

AU - Lacerenza, Michele

AU - Qiu, Lina

AU - Ferocino, Edoardo

AU - Maffeis, Giulia

AU - Amendola, Caterina

AU - Colombo, Lorenzo

AU - Frabasile, Lorenzo

AU - Levoni, Pietro

AU - Buttafava, Mauro

AU - Renna, Marco

AU - Di Sieno, Laura

AU - Re, Rebecca

AU - Farina, Andrea

AU - Spinelli, Lorenzo

AU - Dalla Mora, Alberto

AU - Contini, Davide

AU - Taroni, Paola

AU - Tosi, Alberto

AU - Torricelli, Alessandro

AU - Dehghani, Hamid

AU - Wabnitz, Heidrun

AU - Pifferi, Antonio

PY - 2022/7

Y1 - 2022/7

N2 - SIGNIFICANCE: Multi-laboratory initiatives are essential in performance assessment and standardization-crucial for bringing biophotonics to mature clinical use-to establish protocols and develop reference tissue phantoms that all will allow universal instrument comparison.AIM: The largest multi-laboratory comparison of performance assessment in near-infrared diffuse optics is presented, involving 28 instruments and 12 institutions on a total of eight experiments based on three consolidated protocols (BIP, MEDPHOT, and NEUROPT) as implemented on three kits of tissue phantoms. A total of 20 synthetic indicators were extracted from the dataset, some of them defined here anew.APPROACH: The exercise stems from the Innovative Training Network BitMap funded by the European Commission and expanded to include other European laboratories. A large variety of diffuse optics instruments were considered, based on different approaches (time domain/frequency domain/continuous wave), at various stages of maturity and designed for different applications (e.g., oximetry, spectroscopy, and imaging).RESULTS: This study highlights a substantial difference in hardware performances (e.g., nine decades in responsivity, four decades in dark count rate, and one decade in temporal resolution). Agreement in the estimates of homogeneous optical properties was within 12% of the median value for half of the systems, with a temporal stability of <5 % over 1 h, and day-to-day reproducibility of <3 % . Other tests encompassed linearity, crosstalk, uncertainty, and detection of optical inhomogeneities.CONCLUSIONS: This extensive multi-laboratory exercise provides a detailed assessment of near-infrared Diffuse optical instruments and can be used for reference grading. The dataset-available soon in an open data repository-can be evaluated in multiple ways, for instance, to compare different analysis tools or study the impact of hardware implementations.

AB - SIGNIFICANCE: Multi-laboratory initiatives are essential in performance assessment and standardization-crucial for bringing biophotonics to mature clinical use-to establish protocols and develop reference tissue phantoms that all will allow universal instrument comparison.AIM: The largest multi-laboratory comparison of performance assessment in near-infrared diffuse optics is presented, involving 28 instruments and 12 institutions on a total of eight experiments based on three consolidated protocols (BIP, MEDPHOT, and NEUROPT) as implemented on three kits of tissue phantoms. A total of 20 synthetic indicators were extracted from the dataset, some of them defined here anew.APPROACH: The exercise stems from the Innovative Training Network BitMap funded by the European Commission and expanded to include other European laboratories. A large variety of diffuse optics instruments were considered, based on different approaches (time domain/frequency domain/continuous wave), at various stages of maturity and designed for different applications (e.g., oximetry, spectroscopy, and imaging).RESULTS: This study highlights a substantial difference in hardware performances (e.g., nine decades in responsivity, four decades in dark count rate, and one decade in temporal resolution). Agreement in the estimates of homogeneous optical properties was within 12% of the median value for half of the systems, with a temporal stability of <5 % over 1 h, and day-to-day reproducibility of <3 % . Other tests encompassed linearity, crosstalk, uncertainty, and detection of optical inhomogeneities.CONCLUSIONS: This extensive multi-laboratory exercise provides a detailed assessment of near-infrared Diffuse optical instruments and can be used for reference grading. The dataset-available soon in an open data repository-can be evaluated in multiple ways, for instance, to compare different analysis tools or study the impact of hardware implementations.

KW - absorption

KW - diffuse optics

KW - near-infrared spectroscopy

KW - phantom

KW - scattering

UR - http://www.scopus.com/inward/record.url?scp=85132050109&partnerID=8YFLogxK

U2 - 10.1117/1.JBO.27.7.074716

DO - 10.1117/1.JBO.27.7.074716

M3 - Article

C2 - 35701869

SN - 1083-3668

VL - 27

JO - Journal of Biomedical Optics

JF - Journal of Biomedical Optics

IS - 7

M1 - 074716

ER -

Multi-laboratory performance assessment of diffuse optics instruments: the BitMap exercise

Abstract

Keywords

Access to Document

Fingerprint

Cite this