Paper by Jaewook Lee and Jon E. Froehlich earns recognition

October 8, 2024

People with low vision face hazards in the kitchen – namely sharp knives and hot pans. A research team led by CREATE Ph.D. student Jaewook Lee and including CREATE associate director Jon E. Froehlich authored CookAR: Affordance Augmentations in Wearable AR to Support Kitchen Tool Interactions for People with Low Vision. CookAR is a head-mounted augmented reality (AR) system designed to support safe and efficient interactions with kitchen tools.

The team collected and annotated the first egocentric dataset of kitchen tool affordances, focusing on the relationship between the user and the object. Their paper has earned recognition at the UIST Conference in Pittsburgh this month.

Image from the CookAR prototype: kitchen items scattered on a table. Green color over handles shows grabbable areas. Red/pink overlays indicate hazards such as blades or potentially hot and food-containing areas. — The CookAR prototype with whole object augmentations. Green overlays indicate grabbable areas and red/pink overlays indicate hazards.

Interested in a plain language version of the research paper? Let us know!