to read

D Wyatt, M Philipose, T Choudhury. Unsupervised Activity Recognition Using Automatically Mined Common Sense . Proc. AAAI, 2005.
about extracting instructions --> objects related to activity --> common sense

few more reference

for kitchen
- ("watch for patterns in how people move things") EM Tapia, SS Intille, K Larson. Activity Recognition in the Home
Using Simple and Ubiquitous Sensors. Proc. Pervasive, 2004 - Springer.
- Objective Remote Assessment of Activities of Daily Living (ADL)
Barger, Alwan, Kell, Turner, Wood, Naidu. CBI Steps to Success (2002)

-K. Tee et al, “A visual recipe book for persons with language impairments”, ACM SIGCHI2004 [link]