A Vision-based Transfer Learning Approach for Recognizing Behavioral Symptoms in People with Dementia

Wharton, Zachary, Thomas, Erik, Debnath, Bappaditya and Behera, Ardhendu (2018) A Vision-based Transfer Learning Approach for Recognizing Behavioral Symptoms in People with Dementia. 15th IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS) Proceedigs. (In Press)

[img]
Preview
Text
Vision-based-Behera.pdf - Accepted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (691kB) | Preview
[img]
Preview
Text
Supplementary-PID-67.pdf - Supplemental Material
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (1MB) | Preview

Abstract

With an aging population that continues to grow, dementia is a major global health concern. It is a syndrome in which there is a deterioration in memory, thinking, behavior and the ability to perform activities of daily living. Depression and aggressive behavior are the most upsetting and challenging symptoms of dementia. Automatic recognition of these behaviors would not only be useful to alert family members and caregivers, but also helpful in planning and managing daily activities of people with dementia (PwD). In this work, we propose a vision-based approach that unifies transfer learning and deep convolutional neural network (CNN) for the effective recognition of behavioral symptoms. We also compare the performance of state-of-the-art CNN features with the hand-crafted HOG-feature, as well as their combination using a basic linear SVM. The proposed method is evaluated on a newly created dataset, which is based on the dementia storyline in ITVs Emmerdale episodes. The Alzheimer’s Society has described it as a “realistic portrayal” of the condition to raise awareness of the issues surrounding dementia.

Item Type: Article
Uncontrolled Keywords: Aggressive and depressive behavior recognition, Human-robot social interactions, Assistive technology for dementia, Health and social care, Video analysis and recognition, Transfer learning, Deep learning, CNN features
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Computing and Information Systems
Related URLs:
Date Deposited: 29 Oct 2018 11:42
URI: http://repository.edgehill.ac.uk/id/eprint/10786

Archive staff only

Item control page Item control page