Multi-laboratory performance assessment of diffuse optics instruments: the BitMap exercise.
Author
Lanka, PranavYang, Lin
Orive-Miguel, David
Veesa, Joshua Deepak
Tagliabue, Susanna
Sudakou, Aleh
Samaei, Saeed
Forcione, Mario
Kovacsova, Zuzana
Behera, Anurag
Gladytz, Thomas
Grosenick, Dirk
Hervé, Lionel
Durduran, Turgut
Bejm, Karolina
Morawiec, Magdalena
Kacprzak, Michał
Sawosz, Piotr
Gerega, Anna
Liebert, Adam
Belli, Antonio
Tachtsidis, Ilias
Lange, Frédéric
Bale, Gemma
Baratelli, Luca
Gioux, Sylvain
Alexander, Kalyanov
Wolf, Martin
Sekar, Sanathana Konugolu Venkata
Zanoletti, Marta
Pirovano, Ileana
Lacerenza, Michele
Qiu, Lina
Ferocino, Edoardo
Maffeis, Giulia
Amendola, Caterina
Colombo, Lorenzo
Frabasile, Lorenzo
Levoni, Pietro
Buttafava, Mauro
Renna, Marco
Di Sieno, Laura
Re, Rebecca
Farina, Andrea
Spinelli, Lorenzo
Dalla Mora, Alberto
Contini, Davide
Taroni, Paola
Tosi, Alberto
Torricelli, Alessandro
Dehghani, Hamid
Wabnitz, Heidrun
Pifferi, Antonio
Publication date
2022-06Subject
Health services. Management
Metadata
Show full item recordAbstract
Significance: Multi-laboratory initiatives are essential in performance assessment and standardization-crucial for bringing biophotonics to mature clinical use-to establish protocols and develop reference tissue phantoms that all will allow universal instrument comparison. Aim: The largest multi-laboratory comparison of performance assessment in near-infrared diffuse optics is presented, involving 28 instruments and 12 institutions on a total of eight experiments based on three consolidated protocols (BIP, MEDPHOT, and NEUROPT) as implemented on three kits of tissue phantoms. A total of 20 synthetic indicators were extracted from the dataset, some of them defined here anew. Approach: The exercise stems from the Innovative Training Network BitMap funded by the European Commission and expanded to include other European laboratories. A large variety of diffuse optics instruments were considered, based on different approaches (time domain/frequency domain/continuous wave), at various stages of maturity and designed for different applications (e.g., oximetry, spectroscopy, and imaging). Results: This study highlights a substantial difference in hardware performances (e.g., nine decades in responsivity, four decades in dark count rate, and one decade in temporal resolution). Agreement in the estimates of homogeneous optical properties was within 12% of the median value for half of the systems, with a temporal stability of <5 % over 1 h, and day-to-day reproducibility of <3 % . Other tests encompassed linearity, crosstalk, uncertainty, and detection of optical inhomogeneities. Conclusions: This extensive multi-laboratory exercise provides a detailed assessment of near-infrared Diffuse optical instruments and can be used for reference grading. The dataset-available soon in an open data repository-can be evaluated in multiple ways, for instance, to compare different analysis tools or study the impact of hardware implementations.Citation
Lanka P, Yang L, Orive-Miguel D, Veesa JD, Tagliabue S, Sudakou A, Samaei S, Forcione M, Kovacsova Z, Behera A, Gladytz T, Grosenick D, Hervé L, Durduran T, Bejm K, Morawiec M, Kacprzak M, Sawosz P, Gerega A, Liebert A, Belli A, Tachtsidis I, Lange F, Bale G, Baratelli L, Gioux S, Alexander K, Wolf M, Sekar SKV, Zanoletti M, Pirovano I, Lacerenza M, Qiu L, Ferocino E, Maffeis G, Amendola C, Colombo L, Frabasile L, Levoni P, Buttafava M, Renna M, Di Sieno L, Re R, Farina A, Spinelli L, Dalla Mora A, Contini D, Taroni P, Tosi A, Torricelli A, Dehghani H, Wabnitz H, Pifferi A. Multi-laboratory performance assessment of diffuse optics instruments: the BitMap exercise. J Biomed Opt. 2022 Jun;27(7):074716. doi: 10.1117/1.JBO.27.7.074716Type
ArticleAdditional Links
http://biomedicaloptics.spiedigitallibrary.org/journal.aspxPMID
35701869Journal
Journal of Biomedical OpticsPublisher
SPIEae974a485f413a2113503eed53cd6c53
10.1117/1.JBO.27.7.074716