Abstract:
Traditional infrastructure inspection methods require specialized expertise and involve complex maintenance techniques. Currently, inspectors depend on auditory cues, par...Show MoreMetadata
Abstract:
Traditional infrastructure inspection methods require specialized expertise and involve complex maintenance techniques. Currently, inspectors depend on auditory cues, particularly the sound produced by hammering, to sense loose bolts, relying heavily on their personal experience. However, these methods might become obsolete in the future due to a shortage of skilled personnel. Therefore, AI-based sensing methods are being adopted to address this critical issue more efficiently. Yet, as of now, there is no AI-based solution specifically designed for diagnosing bolt loosening in structures that utilize bolts/nuts. In response, we propose an AI-based approach to identify both the location and the degree of loosening in bolt/nut connections by analyzing the impact sounds. Initially, we convert frequency-limited spectrogram data into a visual representation of the sound emanating from the bolt shaft when it is struck by a hammer on its surroundings. Subsequently, a novel regression detection AI sensing system is employed to determine the location and extent of the bolt loosening using these visualizations. This method can diagnose the degree of looseness in detail, which is not possible with conventional hammering inspection. Through the experiments, we confirmed the usefulness of the regression system with high sensing accuracy and the suitability of lightweight convolutional neural network (CNN)-based models, and gained insight into the dataset. These results highlight the efficiency and reliability of our proposed AI-based sensing method, demonstrating its significant potential for enhancing the safety and maintenance of infrastructural components.
Published in: IEEE Sensors Journal ( Volume: 25, Issue: 9, 01 May 2025)
Funding Agency:
Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, Japan
Tomoki Furusawa received the B.S. degree in electronic engineering from the Shibaura Institute of Technology, Tokyo, Japan, in 2023, where he is currently pursuing the M.S. degree with the Graduate School of Engineering and Science.
His research interests include audio processing, computer vision, infrastructure inspection systems, and human support systems.
Tomoki Furusawa received the B.S. degree in electronic engineering from the Shibaura Institute of Technology, Tokyo, Japan, in 2023, where he is currently pursuing the M.S. degree with the Graduate School of Engineering and Science.
His research interests include audio processing, computer vision, infrastructure inspection systems, and human support systems.View more
College of Engineering and the Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, Japan
Chinthaka Premachandra (Senior Member, IEEE) was born in Sri Lanka. He received the B.Sc. and M.Sc. degrees from Mie University, Tsu, Japan, in 2006 and 2008, respectively, and the Ph.D. degree from Nagoya University, Nagoya, Japan, in 2011.
From 2012 to 2015, he was an Assistant Professor with the Department of Electrical Engineering, Faculty of Engineering, Tokyo University of Science, Tokyo, Japan. From 2016 to 2017, he...Show More
Chinthaka Premachandra (Senior Member, IEEE) was born in Sri Lanka. He received the B.Sc. and M.Sc. degrees from Mie University, Tsu, Japan, in 2006 and 2008, respectively, and the Ph.D. degree from Nagoya University, Nagoya, Japan, in 2011.
From 2012 to 2015, he was an Assistant Professor with the Department of Electrical Engineering, Faculty of Engineering, Tokyo University of Science, Tokyo, Japan. From 2016 to 2017, he...View more
Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, Japan
Shogo Kihara (Student Member, IEEE) currently pursuing the B.S. degree with the College of Engineering, Department of Electronic Engineering, Shibaura Institute of Technology, Tokyo, Japan.
His research interests include computer vision, infrastructure inspection systems, and human support systems.
Shogo Kihara (Student Member, IEEE) currently pursuing the B.S. degree with the College of Engineering, Department of Electronic Engineering, Shibaura Institute of Technology, Tokyo, Japan.
His research interests include computer vision, infrastructure inspection systems, and human support systems.View more
Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, Japan
Myuji Takizawa received the B.S. degree in engineering science and mechanics from Shibaura Institute of Technology, Tokyo, Japan, in 2023, where he is currently pursuing the M.S. degree with the Graduate School of Engineering and Science.
His research interests include frequency response function measurement, impact testing, bolt/nut assembly, and experimental modal analysis.
Myuji Takizawa received the B.S. degree in engineering science and mechanics from Shibaura Institute of Technology, Tokyo, Japan, in 2023, where he is currently pursuing the M.S. degree with the Graduate School of Engineering and Science.
His research interests include frequency response function measurement, impact testing, bolt/nut assembly, and experimental modal analysis.View more
Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, Japan
Haruki Katsuragi received the B.S. and master’s degrees from the Department of Mechanical and Functional Engineering, Faculty of Engineering, Shibaura Institute of Technology, Tokyo, Japan, in 2021 and 2023, respectively.
His research interests include vibration testing, axial force detection, and experimental modal analysis.
Haruki Katsuragi received the B.S. and master’s degrees from the Department of Mechanical and Functional Engineering, Faculty of Engineering, Shibaura Institute of Technology, Tokyo, Japan, in 2021 and 2023, respectively.
His research interests include vibration testing, axial force detection, and experimental modal analysis.View more
College of Engineering, Shibaura Institute of Technology, Tokyo, Japan
Shinji Hashimura is a Full Professor at the Shibaura Institute of Technology, Tokyo, Japan. He has conducted the researches on strength of materials especially bolt tightening, self-loosening, and fatigue of bolted joints. The results of research have been published in Engineering.
Shinji Hashimura is a Full Professor at the Shibaura Institute of Technology, Tokyo, Japan. He has conducted the researches on strength of materials especially bolt tightening, self-loosening, and fatigue of bolted joints. The results of research have been published in Engineering.View more
College of Engineering, Shibaura Institute of Technology, Tokyo, Japan
Naoki Hosoya received the Ph.D. degree from Tokyo Metropolitan University, Hachioji, Japan, in 2002.
From 2002 to 2006, he was an Assistant Professor at the Graduate School of Science and Engineering, Saitama University, Saitama, Japan. From 2007 to 2008, he was a Lecturer at the Department of Mechanical Engineering, Shibaura Institute of Technology, Tokyo, Japan. From 2009 to 2017, he was an Associate Professor at the Shi...Show More
Naoki Hosoya received the Ph.D. degree from Tokyo Metropolitan University, Hachioji, Japan, in 2002.
From 2002 to 2006, he was an Assistant Professor at the Graduate School of Science and Engineering, Saitama University, Saitama, Japan. From 2007 to 2008, he was a Lecturer at the Department of Mechanical Engineering, Shibaura Institute of Technology, Tokyo, Japan. From 2009 to 2017, he was an Associate Professor at the Shi...View more
Contents Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, Japan
Tomoki Furusawa received the B.S. degree in electronic engineering from the Shibaura Institute of Technology, Tokyo, Japan, in 2023, where he is currently pursuing the M.S. degree with the Graduate School of Engineering and Science.
His research interests include audio processing, computer vision, infrastructure inspection systems, and human support systems.
Tomoki Furusawa received the B.S. degree in electronic engineering from the Shibaura Institute of Technology, Tokyo, Japan, in 2023, where he is currently pursuing the M.S. degree with the Graduate School of Engineering and Science.
His research interests include audio processing, computer vision, infrastructure inspection systems, and human support systems.View more
College of Engineering and the Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, Japan
Chinthaka Premachandra (Senior Member, IEEE) was born in Sri Lanka. He received the B.Sc. and M.Sc. degrees from Mie University, Tsu, Japan, in 2006 and 2008, respectively, and the Ph.D. degree from Nagoya University, Nagoya, Japan, in 2011.
From 2012 to 2015, he was an Assistant Professor with the Department of Electrical Engineering, Faculty of Engineering, Tokyo University of Science, Tokyo, Japan. From 2016 to 2017, he was an Assistant Professor with the Department of Electronic Engineering, School of Engineering, Shibaura Institute of Technology, Tokyo, where he was an Associate Professor, from 2018 to 2022. In 2022, he was promoted to a Professor with the Department of Electronic Engineering, Graduate School of Engineering, Shibaura Institute of Technology, where he is currently the Manager of the Image Processing and Robotic Laboratory. His research interests include AI, UAV, image processing, audio processing, intelligent transport systems (ITS), and mobile robotics.
Chinthaka Premachandra (Senior Member, IEEE) was born in Sri Lanka. He received the B.Sc. and M.Sc. degrees from Mie University, Tsu, Japan, in 2006 and 2008, respectively, and the Ph.D. degree from Nagoya University, Nagoya, Japan, in 2011.
From 2012 to 2015, he was an Assistant Professor with the Department of Electrical Engineering, Faculty of Engineering, Tokyo University of Science, Tokyo, Japan. From 2016 to 2017, he was an Assistant Professor with the Department of Electronic Engineering, School of Engineering, Shibaura Institute of Technology, Tokyo, where he was an Associate Professor, from 2018 to 2022. In 2022, he was promoted to a Professor with the Department of Electronic Engineering, Graduate School of Engineering, Shibaura Institute of Technology, where he is currently the Manager of the Image Processing and Robotic Laboratory. His research interests include AI, UAV, image processing, audio processing, intelligent transport systems (ITS), and mobile robotics.View more
Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, Japan
Shogo Kihara (Student Member, IEEE) currently pursuing the B.S. degree with the College of Engineering, Department of Electronic Engineering, Shibaura Institute of Technology, Tokyo, Japan.
His research interests include computer vision, infrastructure inspection systems, and human support systems.
Shogo Kihara (Student Member, IEEE) currently pursuing the B.S. degree with the College of Engineering, Department of Electronic Engineering, Shibaura Institute of Technology, Tokyo, Japan.
His research interests include computer vision, infrastructure inspection systems, and human support systems.View more
Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, Japan
Myuji Takizawa received the B.S. degree in engineering science and mechanics from Shibaura Institute of Technology, Tokyo, Japan, in 2023, where he is currently pursuing the M.S. degree with the Graduate School of Engineering and Science.
His research interests include frequency response function measurement, impact testing, bolt/nut assembly, and experimental modal analysis.
Myuji Takizawa received the B.S. degree in engineering science and mechanics from Shibaura Institute of Technology, Tokyo, Japan, in 2023, where he is currently pursuing the M.S. degree with the Graduate School of Engineering and Science.
His research interests include frequency response function measurement, impact testing, bolt/nut assembly, and experimental modal analysis.View more
Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, Japan
Haruki Katsuragi received the B.S. and master’s degrees from the Department of Mechanical and Functional Engineering, Faculty of Engineering, Shibaura Institute of Technology, Tokyo, Japan, in 2021 and 2023, respectively.
His research interests include vibration testing, axial force detection, and experimental modal analysis.
Haruki Katsuragi received the B.S. and master’s degrees from the Department of Mechanical and Functional Engineering, Faculty of Engineering, Shibaura Institute of Technology, Tokyo, Japan, in 2021 and 2023, respectively.
His research interests include vibration testing, axial force detection, and experimental modal analysis.View more
College of Engineering, Shibaura Institute of Technology, Tokyo, Japan
Shinji Hashimura is a Full Professor at the Shibaura Institute of Technology, Tokyo, Japan. He has conducted the researches on strength of materials especially bolt tightening, self-loosening, and fatigue of bolted joints. The results of research have been published in Engineering.
Shinji Hashimura is a Full Professor at the Shibaura Institute of Technology, Tokyo, Japan. He has conducted the researches on strength of materials especially bolt tightening, self-loosening, and fatigue of bolted joints. The results of research have been published in Engineering.View more
College of Engineering, Shibaura Institute of Technology, Tokyo, Japan
Naoki Hosoya received the Ph.D. degree from Tokyo Metropolitan University, Hachioji, Japan, in 2002.
From 2002 to 2006, he was an Assistant Professor at the Graduate School of Science and Engineering, Saitama University, Saitama, Japan. From 2007 to 2008, he was a Lecturer at the Department of Mechanical Engineering, Shibaura Institute of Technology, Tokyo, Japan. From 2009 to 2017, he was an Associate Professor at the Shibaura Institute of Technology. From 2018 to the present, he has been a Professor at the Department of Mechanical and Functional Engineering, Shibaura Institute of Technology. His research interests include nondestructive testing, acoustic testing, vibration testing, modal analysis, and food engineering.
Dr. Hosoya is a member of Japan Society for Mechanical Engineers, American Society of Mechanical Engineers, the Visualization Society of Japan, Japan Society of Applied Physics, and the Acoustical Society of Japan.
Naoki Hosoya received the Ph.D. degree from Tokyo Metropolitan University, Hachioji, Japan, in 2002.
From 2002 to 2006, he was an Assistant Professor at the Graduate School of Science and Engineering, Saitama University, Saitama, Japan. From 2007 to 2008, he was a Lecturer at the Department of Mechanical Engineering, Shibaura Institute of Technology, Tokyo, Japan. From 2009 to 2017, he was an Associate Professor at the Shibaura Institute of Technology. From 2018 to the present, he has been a Professor at the Department of Mechanical and Functional Engineering, Shibaura Institute of Technology. His research interests include nondestructive testing, acoustic testing, vibration testing, modal analysis, and food engineering.
Dr. Hosoya is a member of Japan Society for Mechanical Engineers, American Society of Mechanical Engineers, the Visualization Society of Japan, Japan Society of Applied Physics, and the Acoustical Society of Japan.View more