No Cover Image

Journal article 417 views 58 downloads

Human Activity Recognition for AI-Enabled Healthcare Using Low-Resolution Infrared Sensor Data

Yordanka Karayaneva, Sara Sharifzadeh Orcid Logo, Yanguo Jing, Bo Tan Orcid Logo

Sensors, Volume: 23, Issue: 1, Start page: 478

Swansea University Author: Sara Sharifzadeh Orcid Logo

  • 62398.pdf

    PDF | Version of Record

    This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license

    Download (2.52MB)

Check full text

DOI (Published version): 10.3390/s23010478

Abstract

This paper explores the feasibility of using low-resolution infrared (LRIR) image streams for human activity recognition (HAR) with potential application in e-healthcare. Two datasets based on synchronized multichannel LRIR sensors systems are considered for a comprehensive study about optimal data...

Full description

Published in: Sensors
ISSN: 1424-8220
Published: MDPI AG 2023
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa62398
Tags: Add Tag
No Tags, Be the first to tag this record!
first_indexed 2023-01-23T10:42:25Z
last_indexed 2023-02-14T04:16:21Z
id cronfa62398
recordtype SURis
fullrecord <?xml version="1.0"?><rfc1807 xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><datestamp>2023-02-13T15:19:23.6738068</datestamp><bib-version>v2</bib-version><id>62398</id><entry>2023-01-23</entry><title>Human Activity Recognition for AI-Enabled Healthcare Using Low-Resolution Infrared Sensor Data</title><swanseaauthors><author><sid>a4e15f304398ecee3f28c7faec69c1b0</sid><ORCID>0000-0003-4621-2917</ORCID><firstname>Sara</firstname><surname>Sharifzadeh</surname><name>Sara Sharifzadeh</name><active>true</active><ethesisStudent>false</ethesisStudent></author></swanseaauthors><date>2023-01-23</date><deptcode>SCS</deptcode><abstract>This paper explores the feasibility of using low-resolution infrared (LRIR) image streams for human activity recognition (HAR) with potential application in e-healthcare. Two datasets based on synchronized multichannel LRIR sensors systems are considered for a comprehensive study about optimal data acquisition. A novel noise reduction technique is proposed for alleviating the effects of horizontal and vertical periodic noise in the 2D spatiotemporal activity profiles created by vectorizing and concatenating the LRIR frames. Two main analysis strategies are explored for HAR, including (1) manual feature extraction using texture-based and orthogonal-transformation-based techniques, followed by classification using support vector machine (SVM), random forest (RF), k-nearest neighbor (k-NN), and logistic regression (LR), and (2) deep neural network (DNN) strategy based on a convolutional long short-term memory (LSTM). The proposed periodic noise reduction technique showcases an increase of up to 14.15% using different models. In addition, for the first time, the optimum number of sensors, sensor layout, and distance to subjects are studied, indicating the optimum results based on a single side sensor at a close distance. Reasonable accuracies are achieved in the case of sensor displacement and robustness in detection of multiple subjects. Furthermore, the models show suitability for data collected in different environments.</abstract><type>Journal Article</type><journal>Sensors</journal><volume>23</volume><journalNumber>1</journalNumber><paginationStart>478</paginationStart><paginationEnd/><publisher>MDPI AG</publisher><placeOfPublication/><isbnPrint/><isbnElectronic/><issnPrint/><issnElectronic>1424-8220</issnElectronic><keywords>human activity recognition (HAR); infrared sensors; noise reduction; feature extraction; classification; AI-enabled healthcare</keywords><publishedDay>2</publishedDay><publishedMonth>1</publishedMonth><publishedYear>2023</publishedYear><publishedDate>2023-01-02</publishedDate><doi>10.3390/s23010478</doi><url/><notes/><college>COLLEGE NANME</college><department>Computer Science</department><CollegeCode>COLLEGE CODE</CollegeCode><DepartmentCode>SCS</DepartmentCode><institution>Swansea University</institution><apcterm/><funders>This research was funded by the Data Driven Research and Innovation (DDRI) grant at Coventry University, UK.</funders><projectreference/><lastEdited>2023-02-13T15:19:23.6738068</lastEdited><Created>2023-01-23T10:38:54.7775192</Created><path><level id="1">Faculty of Science and Engineering</level><level id="2">School of Mathematics and Computer Science - Computer Science</level></path><authors><author><firstname>Yordanka</firstname><surname>Karayaneva</surname><order>1</order></author><author><firstname>Sara</firstname><surname>Sharifzadeh</surname><orcid>0000-0003-4621-2917</orcid><order>2</order></author><author><firstname>Yanguo</firstname><surname>Jing</surname><order>3</order></author><author><firstname>Bo</firstname><surname>Tan</surname><orcid>0000-0002-6855-6270</orcid><order>4</order></author></authors><documents><document><filename>62398__26354__28e598d7ad0b468fb9f20d832ed1b393.pdf</filename><originalFilename>62398.pdf</originalFilename><uploaded>2023-01-23T10:43:51.4378940</uploaded><type>Output</type><contentLength>2637802</contentLength><contentType>application/pdf</contentType><version>Version of Record</version><cronfaStatus>true</cronfaStatus><documentNotes>This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license</documentNotes><copyrightCorrect>true</copyrightCorrect><language>eng</language><licence>https://creativecommons.org/licenses/by/4.0/</licence></document></documents><OutputDurs><OutputDur><Id>162</Id><IsDataAvailableOnline>true</IsDataAvailableOnline><DataNotAvailableOnlineReasonId xsi:nil="true"/><DurUrl>https://ieee-dataport.org/documents/infrared-human-activity-recognition-dataset-coventry-2018</DurUrl><IsDurRestrictions xsi:nil="true"/><DurRestrictionReasonId xsi:nil="true"/><DurEmbargoDate xsi:nil="true"/></OutputDur></OutputDurs></rfc1807>
spelling 2023-02-13T15:19:23.6738068 v2 62398 2023-01-23 Human Activity Recognition for AI-Enabled Healthcare Using Low-Resolution Infrared Sensor Data a4e15f304398ecee3f28c7faec69c1b0 0000-0003-4621-2917 Sara Sharifzadeh Sara Sharifzadeh true false 2023-01-23 SCS This paper explores the feasibility of using low-resolution infrared (LRIR) image streams for human activity recognition (HAR) with potential application in e-healthcare. Two datasets based on synchronized multichannel LRIR sensors systems are considered for a comprehensive study about optimal data acquisition. A novel noise reduction technique is proposed for alleviating the effects of horizontal and vertical periodic noise in the 2D spatiotemporal activity profiles created by vectorizing and concatenating the LRIR frames. Two main analysis strategies are explored for HAR, including (1) manual feature extraction using texture-based and orthogonal-transformation-based techniques, followed by classification using support vector machine (SVM), random forest (RF), k-nearest neighbor (k-NN), and logistic regression (LR), and (2) deep neural network (DNN) strategy based on a convolutional long short-term memory (LSTM). The proposed periodic noise reduction technique showcases an increase of up to 14.15% using different models. In addition, for the first time, the optimum number of sensors, sensor layout, and distance to subjects are studied, indicating the optimum results based on a single side sensor at a close distance. Reasonable accuracies are achieved in the case of sensor displacement and robustness in detection of multiple subjects. Furthermore, the models show suitability for data collected in different environments. Journal Article Sensors 23 1 478 MDPI AG 1424-8220 human activity recognition (HAR); infrared sensors; noise reduction; feature extraction; classification; AI-enabled healthcare 2 1 2023 2023-01-02 10.3390/s23010478 COLLEGE NANME Computer Science COLLEGE CODE SCS Swansea University This research was funded by the Data Driven Research and Innovation (DDRI) grant at Coventry University, UK. 2023-02-13T15:19:23.6738068 2023-01-23T10:38:54.7775192 Faculty of Science and Engineering School of Mathematics and Computer Science - Computer Science Yordanka Karayaneva 1 Sara Sharifzadeh 0000-0003-4621-2917 2 Yanguo Jing 3 Bo Tan 0000-0002-6855-6270 4 62398__26354__28e598d7ad0b468fb9f20d832ed1b393.pdf 62398.pdf 2023-01-23T10:43:51.4378940 Output 2637802 application/pdf Version of Record true This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license true eng https://creativecommons.org/licenses/by/4.0/ 162 true https://ieee-dataport.org/documents/infrared-human-activity-recognition-dataset-coventry-2018
title Human Activity Recognition for AI-Enabled Healthcare Using Low-Resolution Infrared Sensor Data
spellingShingle Human Activity Recognition for AI-Enabled Healthcare Using Low-Resolution Infrared Sensor Data
Sara Sharifzadeh
title_short Human Activity Recognition for AI-Enabled Healthcare Using Low-Resolution Infrared Sensor Data
title_full Human Activity Recognition for AI-Enabled Healthcare Using Low-Resolution Infrared Sensor Data
title_fullStr Human Activity Recognition for AI-Enabled Healthcare Using Low-Resolution Infrared Sensor Data
title_full_unstemmed Human Activity Recognition for AI-Enabled Healthcare Using Low-Resolution Infrared Sensor Data
title_sort Human Activity Recognition for AI-Enabled Healthcare Using Low-Resolution Infrared Sensor Data
author_id_str_mv a4e15f304398ecee3f28c7faec69c1b0
author_id_fullname_str_mv a4e15f304398ecee3f28c7faec69c1b0_***_Sara Sharifzadeh
author Sara Sharifzadeh
author2 Yordanka Karayaneva
Sara Sharifzadeh
Yanguo Jing
Bo Tan
format Journal article
container_title Sensors
container_volume 23
container_issue 1
container_start_page 478
publishDate 2023
institution Swansea University
issn 1424-8220
doi_str_mv 10.3390/s23010478
publisher MDPI AG
college_str Faculty of Science and Engineering
hierarchytype
hierarchy_top_id facultyofscienceandengineering
hierarchy_top_title Faculty of Science and Engineering
hierarchy_parent_id facultyofscienceandengineering
hierarchy_parent_title Faculty of Science and Engineering
department_str School of Mathematics and Computer Science - Computer Science{{{_:::_}}}Faculty of Science and Engineering{{{_:::_}}}School of Mathematics and Computer Science - Computer Science
document_store_str 1
active_str 0
description This paper explores the feasibility of using low-resolution infrared (LRIR) image streams for human activity recognition (HAR) with potential application in e-healthcare. Two datasets based on synchronized multichannel LRIR sensors systems are considered for a comprehensive study about optimal data acquisition. A novel noise reduction technique is proposed for alleviating the effects of horizontal and vertical periodic noise in the 2D spatiotemporal activity profiles created by vectorizing and concatenating the LRIR frames. Two main analysis strategies are explored for HAR, including (1) manual feature extraction using texture-based and orthogonal-transformation-based techniques, followed by classification using support vector machine (SVM), random forest (RF), k-nearest neighbor (k-NN), and logistic regression (LR), and (2) deep neural network (DNN) strategy based on a convolutional long short-term memory (LSTM). The proposed periodic noise reduction technique showcases an increase of up to 14.15% using different models. In addition, for the first time, the optimum number of sensors, sensor layout, and distance to subjects are studied, indicating the optimum results based on a single side sensor at a close distance. Reasonable accuracies are achieved in the case of sensor displacement and robustness in detection of multiple subjects. Furthermore, the models show suitability for data collected in different environments.
published_date 2023-01-02T04:21:59Z
_version_ 1763754449958862848
score 11.013731