Intelligent Assistive Technology and Systems Lab - click to go to homepage
IATSL develops assistive technology that is adaptive, flexible, and intelligent, enabling users to participate fully in their daily lives. Learn more about our research

Visit us:

Room 438

500 University Ave.

Toronto, Canada

P 416.946.8573

F 416.946.8570

 

Send us mail:

160 - 500 University Ave.

Toronto, ON, M5G 1V7

Canada

 

email us!

 

Follow IATSL on Twitter

Projects

Automatic Detection of Abnormal Gait on Stairs

Keywords: 3D human motion, gait on stairs, classification abnormal events, automated detection.


Overview of Research

It is estimated that between 25-35% of people 65 years or older fall each year. Although only a small percentage of those falls cause severe injury, a percentage that increases with age, falls among the elderly are a major health concern [1].  Taking into account the amount of time people spend on stairs, this makes stairs the most dangerous component of any home [2]. Therefore,  understanding the reasons why people fall on the stairs, may help to prevent such accidents. Also, it may help to increase the possibility for elder people to age at their homes, and to develop intelligent assistants for their comfort.

Therefore, the objective of this project is to develop a system that can monitor stairs and automatically detect any abnormal event that may occur. Previous work was develop by Jasper Snoek [3] at IATSL. However, it is the motivation of this project to explore the use of 3D information, retrieved by a Kinect, to analyze gaits on stairs and to extract useful information capable of detecting abnormal events. 

Handrail Analysis

The handrail is located using computer vision techniques (Figure 1), later using the hand tracking provided by the Kinect sensor, it is determined if it is being used (Figure 2). 

Image of handrail analysisFigure 1: Handrail localization (click to enlarge Fig. 1).

 

Image of handrail use analysisFigure 2: Handrail use detection (click to enlarge Fig. 2).

Gait Acquisition

Using a Kinect, normal (Figure 3)and abnormal (Figure 4)gaits on stairs are recorded in a home laboratory environment, where 20 different joints are tracked on each sequence.

Example images of normal gait on stairsFigure 3: Normal gait on stairs (click to enlarge Fig. 3).
 

Example images of abnormal gait on stairsFigure 4: Abnormal gait on stairs (click to enlarge Fig. 4).

Future Work

Future work will focus on gait classification, with the position signal of the lower-limb analyzed using a Fourier transform. Later, using machine learning techniques, gaits will be classified as normal or abnormal.


Research Team

Gemma Parra, University of Toronto

Alex Mihailidis, University of Toronto

Babak Taati, University of Toronto


References

  1. Stone, E.E.; Skubic, M.; , "Passive in-home measurement of stride-to-stride gait variability comparing vision and Kinect sensing," Engineering in Medicine and Biology Society,EMBC, 2011 Annual International Conference of the IEEE , vol., no., pp.6491-6494, Aug. 30 2011-Sept. 3 2011 doi: 10.1109/IEMBS.2011.6091602.
  2. Michael S Roys, Serious stair injuries can be prevented by improved stair design, Applied Ergonomics, Volume 32, Issue 2, April 2001, Pages 135-139, ISSN 0003-6870, 10.1016/S0003-6870(00)00049-1.
  3. Jasper Snoek, Jesse Hoey, Liam Stewart, Richard S. Zemel, and Alex Mihailidis. Automated detection of unusual events on stairs. Image and Vision Computing, 27(1-2):153 – 166, 2009.