+ - 0:00:00
Notes for current slide
Notes for next slide

Thank you: Drs. Brandon and Jim, Dr. Businelle

  • Recently joined Moffitt
  • Cancer new, learning everyday
  • Doctoral candidate USF IE
  • Wondering what is IE?

    • Decision Engineering
    • Data and math. models to improve decision making
    • Inventory allocation
    • vehicle routing
    • optimizing patient flows in ER
    • choosing the best medical option under uncertainty
  • Last 4 years: how we age, aging in US

The Passive Smart Home:
Unobtrusive At-Home Behavior Monitoring

Garrick Aden-Buie

Utilizing Technology for Data Collection and Intervention

October 29, 2018

1

Aging in the United States

2

Thank you: Drs. Brandon and Jim, Dr. Businelle

  • Recently joined Moffitt
  • Cancer new, learning everyday
  • Doctoral candidate USF IE
  • Wondering what is IE?

    • Decision Engineering
    • Data and math. models to improve decision making
    • Inventory allocation
    • vehicle routing
    • optimizing patient flows in ER
    • choosing the best medical option under uncertainty
  • Last 4 years: how we age, aging in US

US Population by Age

3

The first reason is summarized in this population pyramid.

Population of US by 5-year age range, by percentage, non-gendered.

US Population by Age

4
  • Baby-boomers: born mid-40s through late 60s

  • Millennials, Gen X, echo boomers in the 80s-90s.

  • Life expectancy has increased by 3 mon/year since 1840*

    • and while 75% of seniors report being in good to excellent health,
    • a majority are managing chronic health conditions.

US Population by Age

5

US Population by Age

6

US Population by Age

7

Interesting: dependency ratio

Number of working force aged adults to number of dependents.

Work force classically defined as 15-64.

US Elder Dependency Ratio

8

Look at how this ratio changes over time

Ratio of older adults to work-force age adults

US Elder Dependency Ratio

9

US Elder Dependency Ratio

10

So our population growth is occurring along two dimensions:

  • Increase in absolute number of older adults
  • Increase in the relative number of older adults

US Dependency Ratio

11

Include children in the dependency ratio

  • Giant Baby Boomer bump
  • Older adults driving trends in dep. ratio

Doesn't take into account:

  • More older adults are divorced or live alone than ever before, which in conjunction with demogrph. changes leads to decreased availability of traditional family caregivers
  • of 75+ without a spouse will x2 between 2010 and 2030 and without an adult child within 10 miles x6

US Dependency Ratio

12
13

14

Early in 2012, just after her 80th birthday my grandmother was diagnosed with Alzheimer’s.

Same time: grandfather hospitalized for heart failure. Also COPD.

They had just re-retired to Florida, 1200 miles from Chicago where my parents were living.

My mom left a full-time position and for a while would fly back and forth.

My grandparents were highly independent, very much wanted to live on their own, but it was very difficult for my mom to monitor them from a distance.

As Alz progressed, tougher to know if they ate, showered, left the house, slept normally, etc.

Two highlights from their story

  1. Not uncommon
  2. Highlighting the need and value for passive technologies that link caregivers and seniors
15

My parents would have benefited from a system like the one we installed in "Dorothy's" house

Uses passive, wireless sensors installed throughout the home

Collects basic information about her movements and interactions with objects

16

Summarized and reported on a web interface that she shared with her daughter

HomeSense

CREATE Health, USF
Dr. Carla VandeWeerd and Dr. Ali Yalcin
usf.edu/engineering/create-health/

Goals

  • Leverage commerical low-cost
    home monitoring technology

  • Support older adults to age in place

  • Improve quality of life
    throught the use of technology

17

Aging in Place: Overwhelming majority of OA want to stay in current homes, live independently

Increase QoL by mitigating the impact of inconsistent monitoring and delayed health assessments.

HomeSense

CREATE Health, USF
Dr. Carla VandeWeerd and Dr. Ali Yalcin
usf.edu/engineering/create-health/

Goals

  • Leverage commerical low-cost
    home monitoring technology

  • Support older adults to age in place

  • Improve quality of life
    throught the use of technology

Lifestyle Reassurance

  • Monitor health and daily activities

  • Provide safety and security around
    changes in health and routine

  • Alleviate burden of chronic disease

18

Aging in Place: Overwhelming majority of OA want to stay in current homes, live independently

Increase QoL by mitigating the impact of inconsistent monitoring and delayed health assessments.

  • The largest retirement community in US
  • 75 miles north of Tampa, FL
  • 115,000 residents in 50,000 homes
  • Average age: 62 (M) and 60 (F)
19

A major community partner in CREATE Health's work is The Villages...

  • 32 sq miles
  • 3 town squares
  • 63 rec centers
  • legend has it a Villager can play 18 holes of gold for 30 straight days without repeating

Study Participants

  • Residents 55+ from The Villages
  • Living alone in pet-free home
    with internet access
  • Not exhibiting signs of
    cognitive impairment
20

Overview of Study Participation

  • 14 total participants (7 ongoing) with 5,944 total days of observation
21

Overview of Study Participation

  • 14 total participants (7 ongoing) with 5,944 total days of observation
  • Participant gender and age at study start

22

Overview of Study Participation

  • 14 total participants (7 ongoing) with 5,944 total days of observation
  • Participant gender and age at study start

  • Days of participation in study

23
  • Minimum days is 48, newest has 75 days
  • Minimum (included) days is just over 181
  • Max days is 786.7916667
  • Median (> 180) is 446.4166667

Reasons for leaving:

  • 2 participants moved (002, and 010)
  • 1 participant died
  • 1 participant faced medical challenges
  • 2 participants did not continue after 6 months
  • 1 participant did not like the sensors

Timeline

24

Most at once: 11 participants

Sensor System

25

Sensor System

26

Sensor System

27

Sensor System

28

Challenges

Sensors in the home

  • Real occupants in unscripted situations
    performing unknown actions

  • Remote sensing in low-visibility locations

  • Balance between high density of sensors and
    cost-efficiency and acceptance

  • Cameras and wearable devices perceived as
    too invasive or too difficult to use

29

Challenges

Sensors in the home

Reliability issues

  • Low-power wireless network — communication issues

  • Battery powered sensors

  • Human interaction with sensors

  • Various devices, device types and manufacturers

  • Non-failure related messiness

30

“Homes [. . . ] can be hazardous for sensors, particularly when hundreds of sensors are deployed over long time durations” Hnat et al. (2011)

Hnat et al. (2011). The hitchhiker’s guide to successful residential sensing deployments. doi:10.1145/2070942.2070966.

Challenges

Sensors in the home

Reliability issues

Record Keeping

  • Inherent heirarchy of sensor data as a function of floor plan

  • Physical location of sensors critical to interpretation

  • System needs to be resilient to changes

31

Very important to keep track of where sensors are located

This is not something that's carried around with the data

Systems need to be resilient agains changes in devices, locations and human interactions

Inventory and System Management

  • Inventory Management

  • Installation Preparation

  • System Configuration

  • Planning and Review

  • Maintenance Visits

  • Data Export

32

Inventory and System Management

  • Inventory Management

  • Installation Preparation

  • System Configuration

  • Planning and Review

  • Maintenance Visits

  • Data Export

33

Inventory and System Management

  • Inventory Management

  • Installation Preparation

  • System Configuration

  • Planning and Review

  • Maintenance Visits

  • Data Export

34

Inventory and System Management

  • Inventory Management

  • Installation Preparation

  • System Configuration

  • Planning and Review

  • Maintenance Visits

  • Data Export

35

Inventory and System Management

  • Inventory Management

  • Installation Preparation

  • System Configuration

  • Planning and Review

  • Maintenance Visits

  • Data Export

36
37
38
39

Notifications

Activity Validation App

40

Activity Profiles

41

Activity
Recognition

  • Generative
    • Hidden Markov Models
    • Naive Bayes
  • Discriminative
    • Machine learning methods
    • NN, ANN, SVM, etc.
  • Ontological Models

  • Require labelled training data

  • Accurate annotations very difficult

42

Activity
Recognition

  • Generative
    • Hidden Markov Models
    • Naive Bayes
  • Discriminative
    • Machine learning methods
    • NN, ANN, SVM, etc.
  • Ontological Models

  • Require labelled training data

  • Accurate annotations very difficult

Activity
Profiles

  • Summarize occupant's activities

  • Do not require labelled training data

  • Maintaining lifestyle
    (and smart home system)

  • Enable detection of changes or anomalies in routine, behavior

43

Example Day of Sensor Activity

44

Example Day of Sensor Activity

  • Use only active sensor firings

  • Day begins at first 5 active

  • Insert pause event: no activity in 15 min

  • Summarize as bag-of-event n-grams

45

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPpPpgDdPpPpEPpPpDdPpDdDdPpIiEE1EPaA1AaEaEIiIDdDdDd1aEIiaAIia1AaEDdDdpPDdDdDdDdDdDdDdEDdDd1EIpaAGgaAP1EaAAa1EaA1AaEEIipDdPp1EPpaA1AE1aEIiDdGgGEgEIP1EIDdDdDdDdEEEaAEaApPpGgIPaA1AaEpDdIBiiI1ii1

46

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

47

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

In Bathroom Master

48

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

In Bathroom MasterIn Bedroom Master

49

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

In Bathroom MasterIn Bedroom MasterOpened Bedroom Door

50

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

In Bathroom MasterIn Bedroom MasterOpened Bedroom DoorIn Kitchen

51

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

In Bathroom MasterIn Bedroom MasterOpened Bedroom DoorIn KitchenIn Living Room

52

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

In Bathroom MasterIn Bedroom MasterOpened Bedroom DoorIn KitchenIn Living RoomIn Front Door Area

53

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

In Bathroom MasterIn Bedroom MasterOpened Bedroom DoorIn KitchenIn Living RoomIn Front Door AreaOpened Fridge

54

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

In Bathroom MasterIn Bedroom MasterOpened Bedroom DoorIn KitchenIn Living RoomIn Front Door AreaOpened FridgeClosed Fridge

55

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

In Bathroom MasterIn Bedroom MasterOpened Bedroom DoorIn KitchenIn Living RoomIn Front Door AreaOpened FridgeClosed FridgeOpened Fridge

56

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

In Bathroom MasterIn Bedroom MasterOpened Bedroom DoorIn KitchenIn Living RoomIn Front Door AreaOpened FridgeClosed FridgeOpened FridgeClosed Fridge

57

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

58

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

    

59

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

    

Bag of event n-grams

iIbEA

60

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

    

Bag of event n-grams

iIbEA IbEAa

61

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

    

Bag of event n-grams

iIbEA IbEAa bEAaD

62

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

    

Bag of event n-grams

iIbEA IbEAa bEAaD EAaDd

63

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

    

Bag of event n-grams

iIbEA IbEAa bEAaD EAaDd AaDdD

64

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

    

Bag of event n-grams

iIbEA IbEAa bEAaD EAaDd AaDdD aDdDd

65

Example Day of Sensor Activity

iIbEAaDdDdDdPpPpPIiEIiIIIEpDdDdiPpIiIEPpIiEPDpdIiiIEDdDdiIPpEPpIiPpDdIiiIE1EGgAaIiDdPpGg1GEgGDdDdPp

    

Bag of event n-grams

iIbEA IbEAa bEAaD EAaDd AaDdD aDdDd DdDdD

66

Example Day of Sensor Activity

Bag-of-event n-grams

  • Repeat process for n from 1 to 1

  • Calculate relative frequency p of each n-gram

  • Can be used to summarize m days

Compare two profiles

  • Using Kullback-Leibler Symmetric Distance

  • DKL (P || Q) = 0.331

n-gram Count Rank Freq.
I 16 1 0.0239
D 12 2 0.0179
d 12 3 0.0179
i 12 4 0.0179
Dd 11 5 0.0164
P 11 6 0.0164
E 10 7 0.0149
p 10 8 0.0149
Ii 8 9 0.0119
Pp 8 10 0.0119
67

KL Distance provides a distance measure between probability distributions.

We use KL dist to compare frequencies across b-o-e n-grams (activity profiles)

DKL(PQ)=i(piqi)logpiqi

Baseline Profile Comparison

68

Baseline Profile Comparison

69

Baseline Profile Comparison

70

Baseline Profile Comparison

71

Baseline Profile Comparison

72

Baseline Profile Comparison

73

Baseline Profile Comparison

74

Baseline Profile Comparison

75

Behavior Change Detection

  • Complementary method to find changes in behavior

  • Permutation-based methods for change detection1

1: Sprint, Cook, and Schmitter-Edgecombe (2016)

76
  • Having validated that the activity profiles are capable
    of summarizing the activity patterns of an occupant,
    we now turn to the task of behavior change detection

  • compare occupant's recent activity to previous behavior
    previous behavior is either a baseline period of normalcy
    or sliding windows

  • Given that KL-dist is a scale-less distance metric,
    need to establish bounds guidelines for expected similarity What is normal variation vs. anomaly/change?

  • Overall, our goal is to bring abnormalities to the attention of caregiver
    human review and intervention is expected
    and system issues are equally requiring of attention

Behavior Change Detection

  • Complementary method to find changes in behavior

  • Permutation-based methods for change detection1

1: Sprint, Cook, and Schmitter-Edgecombe (2016)

77
  • Having validated that the activity profiles are capable
    of summarizing the activity patterns of an occupant,
    we now turn to the task of behavior change detection

  • compare occupant's recent activity to previous behavior
    previous behavior is either a baseline period of normalcy
    or sliding windows

  • Given that KL-dist is a scale-less distance metric,
    need to establish bounds guidelines for expected similarity What is normal variation vs. anomaly/change?

  • Overall, our goal is to bring abnormalities to the attention of caregiver
    human review and intervention is expected
    and system issues are equally requiring of attention

Behavior Change Detection

  • Complementary method to find changes in behavior

  • Permutation-based methods for change detection1

1: Sprint, Cook, and Schmitter-Edgecombe (2016)

78
  • Having validated that the activity profiles are capable
    of summarizing the activity patterns of an occupant,
    we now turn to the task of behavior change detection

  • compare occupant's recent activity to previous behavior
    previous behavior is either a baseline period of normalcy
    or sliding windows

  • Given that KL-dist is a scale-less distance metric,
    need to establish bounds guidelines for expected similarity What is normal variation vs. anomaly/change?

  • Overall, our goal is to bring abnormalities to the attention of caregiver
    human review and intervention is expected
    and system issues are equally requiring of attention

Permutation-Based Comparison

79

Permutation-Based Comparison

80

Conclusions

81

Conclusions

Passive sensor systems can address challenges faced by aging population

System, inventory, and data management infrastructure are critical

82

Conclusions

Passive sensor systems can address challenges faced by aging population

System, inventory, and data management infrastructure are critical

Local leaders at the University of South Florida:

  • CREATE Health (VandeWeerd, Yalcin)
  • Dr. Bill Kearns
83

Conclusions

Passive sensor systems can address challenges faced by aging population

System, inventory, and data management infrastructure are critical

Local leaders at the University of South Florida:

  • CREATE Health (VandeWeerd, Yalcin)
  • Dr. Bill Kearns

CASAS "Smart Home in a Box"

  • Washington State University
  • casas.wsu.edu/smart-homes
84

Aging in the United States

2

Thank you: Drs. Brandon and Jim, Dr. Businelle

  • Recently joined Moffitt
  • Cancer new, learning everyday
  • Doctoral candidate USF IE
  • Wondering what is IE?

    • Decision Engineering
    • Data and math. models to improve decision making
    • Inventory allocation
    • vehicle routing
    • optimizing patient flows in ER
    • choosing the best medical option under uncertainty
  • Last 4 years: how we age, aging in US

Paused

Help

Keyboard shortcuts

, , Pg Up, k Go to previous slide
, , Pg Dn, Space, j Go to next slide
Home Go to first slide
End Go to last slide
Number + Return Go to specific slide
b / m / f Toggle blackout / mirrored / fullscreen mode
c Clone slideshow
p Toggle presenter mode
t Restart the presentation timer
?, h Toggle this help
Esc Back to slideshow