+ - 0:00:00
Notes for current slide
Notes for next slide

Occupant Activity Profiles from Smart Home Sensor Event Streams

Garrick Aden-Buie
University of South Florida

Ali Yalcin, Ph.D.
Carla VandeWeerd, Ph.D.

INFORMS Annual Meeting
Oct 25, 2017

1

Older adults live longer but have more chronic health issues

  • Life expectancy +3 months every year since 1840

  • 75% older adults report being in good to excellent health

  • 70% report chronic health conditions

Wouters 2017; Christensen 2009; Older Americans 2012

2

Growing older population need assistance leading to care gaps

  • US health care system faces shortfalls in primary care physicians and paid caregivers

  • 50% need or receive help with routine activities

  • Baby boomers: 45M adults 65+ as of 2015

Bodenheimer 2009; Scommegna 2016; US Census 2015

3

Aging in Place

The ability to live in one's own home and community safely, independently, and comfortably.
6

96% of older adults live independently in homes/apartments

75% strongly agree: want to stay in current residence for as long as possible

Need help: majority of the help is family. Changes in family dynamics: more older adults without living spouses, or adult children within 10 miles.

"Self-care of chronic conditions will therefore be an important component of the aging process, while family members will feel increased pressure to make up for gaps in care availability"

Aging in Place

96% of older adults live independently in homes/apartments

75% want to stay in current residence for as long as possible

Benefits

  • Maintain independence, autonomy and social connections
  • Reduce health care costs
  • Increase quality of life, limit effects of aging

Trade-Offs

  • Inconsistent monitoring
  • Delayed health assessments

CDC Healthy Places; Mather2015

7

reduced health care costs: avoid expensive institutional care

limit aging effects: cognitive decline and depression

inconsistent monitoring: not seeing physician regularly, fear of institutionalization, etc.

Lifestyle Reassurance Systems

  • Use in-home, passive wireless motion, contact and appliance sensors

  • Allow older adults to age in place

  • Monitor health and daily activities of older adult

  • Connect caregivers and health- and elder-care providers

8

In order to enable long-term management of chronic conditions while aging in place, there is a need for technological solutions in the home that facilitate self-care activities, connect older adults with primary care physicians and elder care service providers as well as informal family caregivers.

In-home sensor systems face significant challenges

  1. Difficult to capture and label realistic, nature patterns of daily living

  2. Passive sensor systems need to be minimally invasive

  3. Low-cost and easy to deploy and maintain at large scales

9

Research Objective

Can we effectively use passively-recorded, unlabelled sensor data to characterize
lifestyle activity patterns to enable
detection of changes in routine?

10

Research Objective

Can we effectively use passively-recorded, unlabelled sensor data to characterize
lifestyle activity patterns to enable
detection of changes in routine?

11

Overview

  1. HomeSense

  2. Activity Profiles

  3. Occupant Identification using
    Activity Profiles

12

HomeSense

13

Study Participants

Health BOOST, University of South Florida

  • Recruitment

    • 55+ resident of The Villages
    • Living alone in pet-free home with internet access
    • Do not exhibit signs of cognitive impairment
  • 14 total participants (7 ongoing)

    • 5,450 total days of observation
  • 12 have completed at least 6 months

14

Participants considered for comparison of Activity Profiles

  • 7 Participants

  • Completed at least 196 days (~7 months):

    • Excluding vacations, maintenance days
    • At "home" for most of the day
    • Avoiding guests and visitors
  • Similar floorplan and sensor layout

15

Sensor Layout & Coverage

16

Daily Activity Heatmap

17

Activity Profiles

18

Activity Profile Process

  • Gather sensor event sequences

  • Group into day-length event sequences

  • Build activity profiles from day-event sequences

19

Sensor Event Sequences

Timestamp Sensor Encoded
2017-10-01 14:01:44 InLivingRoom A
2017-10-01 14:05:28 InLivingRoom A
2017-10-01 14:26:25 InKitchen E
2017-10-01 14:28:34 OpenedGarageDoor G
2017-10-01 14:28:35 InLivingRoom A
2017-10-01 14:28:58 ClosedGarageDoor g
2017-10-01 14:29:07 InBedroomMaster I
2017-10-01 14:29:16 InBathroomMaster i
2017-10-01 14:36:39 InBathroomMaster i
20

Insert pauses for activity lulls

Pauses

Type Length Character
Short 15 to 60 minutes 1
Medium 1 to 3 hours 2
Long 3+ hours 3
21

Identify start of day

Day Start Marker: 5 sequential active events after 4am


22

Day Event Sequence



IiIAEFfFfA2AE1EGAgEAIiIAEIiIiOiIGAgEIIIAE1AE2AEAAE1A1AAEIiIFfFfAEA2AEAE1AEEAAEAEAA1AIiI2AEIiI3IIiI2

23

Day Event Sequence



IiIAEFfFfA2AE1EGAgEAIiIAEIiIiOiIGAgEIIIAE1AE2AEAAE1A1AAEIiIFfFfAEA2AEAE1AEEAAEAEAA1AIiI2AEIiI3IIiI2

24

Activity Profiles: Inspired by text mining & document classification

Similar to document categorization [Cavnar1994]

  • Counted and ranked n-grams in category documents

  • Compared n-grams from unknown document to category profiles

Activity Profile

  • For m day-event sequences:

    • Count all n-grams from nmin to nmax
    • Calculate relative frequency p of each n-gram
25

Gather n-grams from day event sequence

Event Sequence

IiIAEF ... 3IIiI2

Bigrams

_I iI IA AE EF ... 3I II Ii iI 2_

Trigrams

_Ii iIA IAE AEF ... 3II IIi IiI I2_

...

26

Activity Profile: bag of n-grams representation of day event sequences

Day Activity Profile

ngram count freq
AE 15 0.02618
iI 8 0.01396
EA 7 0.01222
Ii 7 0.01222
IiI 6 0.01047
1A 5 0.00873
AEA 5 0.00873
2A 4 0.00698
2AE 4 0.00698
AA 4 0.00698

450 n-grams

27

Activity Profile: bag of n-grams representation of day event sequences

Day Activity Profile

ngram count freq
AE 15 0.02618
iI 8 0.01396
EA 7 0.01222
Ii 7 0.01222
IiI 6 0.01047
1A 5 0.00873
AEA 5 0.00873
2A 4 0.00698
2AE 4 0.00698
AA 4 0.00698

450 n-grams

Activity Profile

ngram count freq
AE 329 0.01541
1A 283 0.01326
Gg 208 0.00974
EA 193 0.00904
AA 170 0.00796
iI 168 0.00787
1AE 146 0.00684
Ff 139 0.00651
A1 134 0.00628
A1A 132 0.00618

7,840 n-grams

27

Use KL Distance to measure distance between Activity Profiles

Comparing Activity Profile P to Daily Activity Profile Q

Kullback-Leibler Distance (Symmetric)

D(PQ)=xχ((P(x)Q(x))logP(x)Q(x))

with back-off

P(tk,dj)={βP(tk|dj)if tk occurs in document djϵotherwiseβ=1kdi,kPϵ

Bigi 2003

28

KL divergence is a measure of the difference between two probability distributions over the same event space

KLJ or KL distance is symmetric version

Identifying Occupants Using Activity Profiles

  1. Do Activity Profiles capture occupant's unique patterns?

  2. How many days of activity are needed?

  3. Can we use a activity profiles as baseline as occupant ages?

29

Build Activity Profiles for each occupant from N day event sequences

30

Compare unknown single-day profile with all Activity Profiles to predict occupant

31

Experimental Setup

  • 196 total days of data
  • How well do Activity Profiles work?

    • Build profile for each occupant from N training days

    • Use profiles to identify occupant of test day

    • 7-fold modified cross validation:

      • 28 testing days (~ 1 month) per fold
      • 168 training days available for profile
  • How many days are needed for quality Activity Profiles?

    • N profile days:

      • From 14 days to 3 months
32

Testing days from contiguous days

33

Profiles built from N sampled days

34

Samples are repeated for equal number of profile day trials

Profiles: 168 days (~6 months)

Test: 28 days

Profile Days Months Iterations Reps Total Trials
14 0.5 12 1 12
28 1.0 6 2 12
42 1.5 4 3 12
56 2.0 3 4 12
70 2.5 2 6 12
84 3.0 2 6 12
35

Results

14 Days 28 Days 42 Days 56 Days 70 Days 84 Days
Accuracy 0.944 0.959 0.962 0.960 0.959 0.954
Precision 0.949 0.962 0.965 0.962 0.962 0.957
Recall 0.944 0.959 0.962 0.960 0.959 0.954
F Meas. 0.944 0.959 0.962 0.960 0.959 0.954
36

Average Accuracy

37

Average Accuracy by Occupant

38

First 42 days as baseline profile
compared with remaining 154 days

39

Summary

Activity Profiles

  • Accurately characterize smart home occupant daily activities

  • Useful for long-term monitoring of older adults as they age

  • Use simple, passive sensors emebedded in home environment

  • Do not require expensive activity labelling for training

Future Work

Questions? gadenbuie@mail.usf.edu

40

Future work: clustering for unsupervised activity discovery

Limitations: obviously, no labels, etc.

References

Wouters (2017). Handbook of Smart Homes, Health Care and Well-Being

Christensen et al. (2009). doi:10.1016/S0140-6736(09)61460-4

Federal Interagency Forum on Aging-Related Statistics (2012). Older Americans 2012

Bodenheimer et al. (2009). doi:10.1377/hlthaff.28.1.64

Scommegna (2016). Today’s Research on Aging

U. S. Census Bureau (2017). https://factfinder.census.gov/bkmk/table/1.0/en/ACS/15_5YR/S0103/0100000US

Centers for Disease Control and Prevention (2017). https://www.cdc.gov/healthyplaces/terminology.htm

Mather et al. (2015). Aging in the United States

Cavnar & Trenkle (1994). N Proceedings of SDAIR-94, 3rd Annual Symposium on Document Analysis and Information Retrieval

Bigi (2003). Advances in Information Retrieval

41

Older adults live longer but have more chronic health issues

  • Life expectancy +3 months every year since 1840

  • 75% older adults report being in good to excellent health

  • 70% report chronic health conditions

Wouters 2017; Christensen 2009; Older Americans 2012

2
Paused

Help

Keyboard shortcuts

, , Pg Up, k Go to previous slide
, , Pg Dn, Space, j Go to next slide
Home Go to first slide
End Go to last slide
Number + Return Go to specific slide
b / m / f Toggle blackout / mirrored / fullscreen mode
c Clone slideshow
p Toggle presenter mode
t Restart the presentation timer
?, h Toggle this help
Esc Back to slideshow