Assessing Trustworthy AI in Times of COVID-19: Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients | IEEE Journals & Magazine | IEEE Xplore

Assessing Trustworthy AI in Times of COVID-19: Deep Learning for Predicting a Multiregional Score Conveying the Degree of Lung Compromise in COVID-19 Patients

Publisher: IEEE

Abstract:

This article’s main contributions are twofold: 1) to demonstrate how to apply the general European Union’s High-Level Expert Group’s (EU HLEG) guidelines for trustworthy ...View more

Abstract:

This article’s main contributions are twofold: 1) to demonstrate how to apply the general European Union’s High-Level Expert Group’s (EU HLEG) guidelines for trustworthy AI in practice for the domain of healthcare and 2) to investigate the research question of what does “trustworthy AI” mean at the time of the COVID-19 pandemic. To this end, we present the results of a post-hoc self-assessment to evaluate the trustworthiness of an AI system for predicting a multiregional score conveying the degree of lung compromise in COVID-19 patients, developed and verified by an interdisciplinary team with members from academia, public hospitals, and industry in time of pandemic. The AI system aims to help radiologists to estimate and communicate the severity of damage in a patient’s lung from Chest X-rays. It has been experimentally deployed in the radiology department of the ASST Spedali Civili clinic in Brescia, Italy, since December 2020 during pandemic time. The methodology we have applied for our post-hoc assessment, called Z-Inspection®, uses sociotechnical scenarios to identify ethical, technical, and domain-specific issues in the use of the AI system in the context of the pandemic.
Published in: IEEE Transactions on Technology and Society ( Volume: 3, Issue: 4, December 2022)
Page(s): 272 - 289
Date of Publication: 29 July 2022
Electronic ISSN: 2637-6415
PubMed ID: 36573115
Publisher: IEEE

Funding Agency:

Enterprise Intelligence Department, EY Netherlands, Amsterdam, The Netherlands
Department of Health Sciences and Technology, Health Ethics and Policy Lab, ETH Zurich, Zürich, Switzerland
Postgraduate Studies in Diplomacy and International Relations, Center for Diplomatic & Strategic Studies, Paris, France
Institute of Information Science and Technologies, National Research Council of Italy (CNR), Pisa, Italy
Bioethics Center, Hackensack Meridian Health, Edison, NJ, USA
Faculty of Philosophy, University of Oxford, Oxford, U.K.
Philosophie Department, Collège André- Laurendeau, Montreal, Canada
École des médias, Université du Québec à Montréal, Montreal, Canada
Philosophy Department, Pace University, New York, NY, USA
Department of Radiology, Wexner Medical Center, The Ohio State University, Columbus, OH, USA
Department of Radiology, Humanitas Research Hospital, Milan, Italy
Department of Biomedical Sciences, Humanitas University, Milan, Italy
Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW, Australia
Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, Australia
European Centre of Excellence on the Regulation of Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
Group of Computer Architecture, University of Bremen, Bremen, Germany
Department of Medicine, Division of Infectious Diseases and Immunology, New York University Grossman School of Medicine, New York, NY, USA
AI Research Section, Digital Institute, Stockholm, Sweden
Department of Business Management and Analytics, Arcada University of Applied Sciences, Helsinki, Finland
Department of Medical and Surgical Specialties, Radiological Sciences, and Public Health, University of Brescia, Brescia, Italy
Ethique Groupe, SNCF Reseau SA, La Plaine, France
Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Zürich, Switzerland
Department of Mathematics and Computer Science, Eindhoven University of Technology, Eindhoven, The Netherlands
Data Privacy Advisor, Ericsson, Stockholm, Sweden
Department of Cardiology, 4th Gliwice Municipal Hospital, Gliwice, Poland
Z-Inspection® Initiative, Frankfurt, Germany
Center for the Study of Ethics in the Professions, Illinois Institute of Technology, Chicago, IL, USA
Department of Food and Resource Economics, University of Copenhagen, Copenhagen, Denmark
Department of Physiology, Faculty of Medicine, University of Iceland, Reykjavik, Iceland
Cyber Policy Center, Stanford University, Stanford, CA, USA
Department for Dermatology, Hautmedizin Bad Soden, Bad Soden, Germany
Data Science Department, Scuola Normale Superiore, Pisa, Italy
Department of Neurosurgery, the QUEST Centre for Responsible Research, Charité Lab for Artificial Intelligence in Medicine, Berlin Institute of Health at Charité, Charité Universitätsmedizin Berlin, Berlin, Germany
Faculty of Computing, Engineering and the Built Environment, School of Computing and Digital Technology, Birmingham City University, Birmingham, U.K.
Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, The Netherlands
CADS Department, Syngenta, Research Triangle Park, NC, USA
Z-Inspection® Initiative, Frankfurt, Germany
Policy Research, The Lisbon Council, Brussels, Belgium
Department of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy
Department of Clinical Neuroscience, Center for Psychiatry Research, Karolinska Institutet, Stockholm, Sweden
Department of Medicine, The University of Cambridge, Addenbrooke’s Hospital, Cambridge, U.K.
School of Cell Matrix and Regenerative Medicine, The University of Manchester, Manchester, U.K.
Department of Human Genetics, The Wellcome Sanger Institute, Wellcome Genome Campus, Cambridge, U.K.
Department of Computer Science, University of Pisa, Pisa, Italy
Department of Population Health, Division of Medical Ethics, NYU Grossman School of Medicine, New York, NY, USA
Institute of Information Science and Technologies, National Research Council of Italy (CNR), Pisa, Italy
School of Healthcare and Social Work, Seinäjoki University of Applied Sciences, Seinäjoki, Finland
Law Department, European University Institute, Firenze, Italy
CIRSFID-Alma AI and Law Department, University of Bologna, Bologna, Italy
Department of Information Engineering, University of Brescia, Brescia, Italy
Department of Information Engineering, University of Brescia, Brescia, Italy
Advanced Analytics, Finnish Tax Administration, Helsinki, Finland
Artificial Intelligence Research, AI for Good Foundation, El Cerrito, CA, USA
Industrial Engineering and Operation Research Department, University of California at Berkeley, Berkeley, CA, USA
Data Services Function in Roche Diagnostics, Roche, Pune, India
Digital Systems, NORCE Norwegian Research Centre AS, Bergen, Norway
School of Research, Swinburne University of Technology (Sarawak), Kuching, Malaysia
Parallel Computing Labs, Intel, Santa Clara, CA, USA
Department of Computer Science, Stony Brook University, Stony Brook, NY, USA
Department of Psychology and Speech- Language Pathology, University of Turku, Turku, Finland
Department of Values, Technology and Innovation, Delft University of Technology, Delft, The Netherlands
Department of Medical and Surgical Specialties, Radiological Sciences, and Public Health, University of Brescia, Brescia, Italy
Computational Vision and Artificial Intelligence Lab, Goethe University Frankfurt, Frankfurt, Germany
Department of Business Management and Analytics, Arcada University of Applied Sciences, Helsinki, Finland
School of Economics, Innovation and Technology, Kristiania University College, Olso, Norway
T. H. Chan School of Public Health, Harvard University, Boston, MA, USA
Department of Business Management and Analytics, Arcada University of Applied Sciences, Helsinki, Finland
Data Science Graduate School, Seoul National University, Seoul, South Korea

Enterprise Intelligence Department, EY Netherlands, Amsterdam, The Netherlands
Department of Health Sciences and Technology, Health Ethics and Policy Lab, ETH Zurich, Zürich, Switzerland
Postgraduate Studies in Diplomacy and International Relations, Center for Diplomatic & Strategic Studies, Paris, France
Institute of Information Science and Technologies, National Research Council of Italy (CNR), Pisa, Italy
Bioethics Center, Hackensack Meridian Health, Edison, NJ, USA
Faculty of Philosophy, University of Oxford, Oxford, U.K.
Philosophie Department, Collège André- Laurendeau, Montreal, Canada
École des médias, Université du Québec à Montréal, Montreal, Canada
Philosophy Department, Pace University, New York, NY, USA
Department of Radiology, Wexner Medical Center, The Ohio State University, Columbus, OH, USA
Department of Radiology, Humanitas Research Hospital, Milan, Italy
Department of Biomedical Sciences, Humanitas University, Milan, Italy
Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW, Australia
Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, Australia
European Centre of Excellence on the Regulation of Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
Group of Computer Architecture, University of Bremen, Bremen, Germany
Department of Medicine, Division of Infectious Diseases and Immunology, New York University Grossman School of Medicine, New York, NY, USA
AI Research Section, Digital Institute, Stockholm, Sweden
Department of Business Management and Analytics, Arcada University of Applied Sciences, Helsinki, Finland
Department of Medical and Surgical Specialties, Radiological Sciences, and Public Health, University of Brescia, Brescia, Italy
Ethique Groupe, SNCF Reseau SA, La Plaine, France
Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, Zürich, Switzerland
Department of Mathematics and Computer Science, Eindhoven University of Technology, Eindhoven, The Netherlands
Data Privacy Advisor, Ericsson, Stockholm, Sweden
Department of Cardiology, 4th Gliwice Municipal Hospital, Gliwice, Poland
Z-Inspection® Initiative, Frankfurt, Germany
Center for the Study of Ethics in the Professions, Illinois Institute of Technology, Chicago, IL, USA
Department of Food and Resource Economics, University of Copenhagen, Copenhagen, Denmark
Department of Physiology, Faculty of Medicine, University of Iceland, Reykjavik, Iceland
Cyber Policy Center, Stanford University, Stanford, CA, USA
Department for Dermatology, Hautmedizin Bad Soden, Bad Soden, Germany
Data Science Department, Scuola Normale Superiore, Pisa, Italy
Department of Neurosurgery, the QUEST Centre for Responsible Research, Charité Lab for Artificial Intelligence in Medicine, Berlin Institute of Health at Charité, Charité Universitätsmedizin Berlin, Berlin, Germany
Faculty of Computing, Engineering and the Built Environment, School of Computing and Digital Technology, Birmingham City University, Birmingham, U.K.
Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, The Netherlands
CADS Department, Syngenta, Research Triangle Park, NC, USA
Z-Inspection® Initiative, Frankfurt, Germany
Policy Research, The Lisbon Council, Brussels, Belgium
Department of Translational Research, Academic Radiology, University of Pisa, Pisa, Italy
Department of Clinical Neuroscience, Center for Psychiatry Research, Karolinska Institutet, Stockholm, Sweden
Department of Medicine, The University of Cambridge, Addenbrooke’s Hospital, Cambridge, U.K.
School of Cell Matrix and Regenerative Medicine, The University of Manchester, Manchester, U.K.
Department of Human Genetics, The Wellcome Sanger Institute, Wellcome Genome Campus, Cambridge, U.K.
Department of Computer Science, University of Pisa, Pisa, Italy
Department of Population Health, Division of Medical Ethics, NYU Grossman School of Medicine, New York, NY, USA
Institute of Information Science and Technologies, National Research Council of Italy (CNR), Pisa, Italy
School of Healthcare and Social Work, Seinäjoki University of Applied Sciences, Seinäjoki, Finland
Law Department, European University Institute, Firenze, Italy
CIRSFID-Alma AI and Law Department, University of Bologna, Bologna, Italy
Department of Information Engineering, University of Brescia, Brescia, Italy
Department of Information Engineering, University of Brescia, Brescia, Italy
Advanced Analytics, Finnish Tax Administration, Helsinki, Finland
Artificial Intelligence Research, AI for Good Foundation, El Cerrito, CA, USA
Industrial Engineering and Operation Research Department, University of California at Berkeley, Berkeley, CA, USA
Data Services Function in Roche Diagnostics, Roche, Pune, India
Digital Systems, NORCE Norwegian Research Centre AS, Bergen, Norway
School of Research, Swinburne University of Technology (Sarawak), Kuching, Malaysia
Parallel Computing Labs, Intel, Santa Clara, CA, USA
Department of Computer Science, Stony Brook University, Stony Brook, NY, USA
Department of Psychology and Speech- Language Pathology, University of Turku, Turku, Finland
Department of Values, Technology and Innovation, Delft University of Technology, Delft, The Netherlands
Department of Medical and Surgical Specialties, Radiological Sciences, and Public Health, University of Brescia, Brescia, Italy
Computational Vision and Artificial Intelligence Lab, Goethe University Frankfurt, Frankfurt, Germany
Department of Business Management and Analytics, Arcada University of Applied Sciences, Helsinki, Finland
School of Economics, Innovation and Technology, Kristiania University College, Olso, Norway
T. H. Chan School of Public Health, Harvard University, Boston, MA, USA
Department of Business Management and Analytics, Arcada University of Applied Sciences, Helsinki, Finland
Data Science Graduate School, Seoul National University, Seoul, South Korea

References

References is not available for this document.