Audio Walkthrough for Busy Reviewers
16-minute deep dive into the research process and design decisions
Context and Problem
Many adults with Down Syndrome want to cook for themselves but struggle with complex interfaces, sequencing multiple steps, and staying safe around heat and appliances.
Existing smart-kitchen tools target tech-confident users, not neurodiverse people who need clearer guidance, reassurance, and cognitive support.
Design ChallengeHow might we design a smart kitchen that supports independent cooking for adults with Down Syndrome, without sacrificing safety or dignity?
Literature Review
Approach
What I Did
- 8–10 participants: people with Down Syndrome, caregivers, educators
- Methods: interviews, contextual inquiry in real kitchens, light diary studies
- Synthesis: personas, journey maps, and “day-in-the-kitchen” scenarios
Key Insights
Safety and reassurance must be visible at all times, not hidden in settings.
Step-by-step, single-task focus reduces overwhelm and errors.
Voice, visuals, and simple language together work better than any one channel alone.
Caregivers need a way to support remotely without taking control away.
Full Design Process (Miro Board)
Solution
I designed an AI-powered, IoT-connected kitchen assistant that guides users through cooking tasks one clear step at a time.
Intelligent Cooking Devices
Connected appliances with built-in safety features and accessible APIs for seamless integration
Smart Hob/Oven System
Built-in temperature and timer controls with Wi-Fi and Zigbee modules for real-time monitoring and control through accessible APIs.
- Precise temperature control
- Wi-Fi & Zigbee connectivity
- Automated timer alerts
Weight/Pressure Sensors
Detect pan presence on hob surfaces to trigger intelligent alerts for “pan left on” or “heat without pan” scenarios.
- Pan presence detection
- Weight-based triggers
- Real-time notifications
Contact/Magnetic Sensors
Monitor cupboard and fridge doors to detect if left open, providing gentle reminders to prevent food spoilage and energy waste.
- Door status tracking
- Gentle reminder system
- Energy optimization
Smart Plugs & Relays
Control non-smart devices with intelligent power management, automatically cutting power when risk thresholds are reached.
- Remote power control
- Risk-based auto shut-off
- Legacy device support
Advanced Safety Systems
Multi-layered protection with intelligent sensors and automated response mechanisms
Motion/Presence Sensors
Detect when users walk away from active cooking zones, enabling automatic nudges or emergency shut-off protocols.
Smoke/Heat Detectors
Integrated system escalates from soft prompts to loud alerts and automatic shut-off based on threat level assessment.
Emergency Cut-Off
Smart relays provide instant power termination when predefined risk thresholds are exceeded across any monitored device.
Intuitive Control Systems
Multiple interaction methods for seamless cooking guidance and real-time feedback
Central Touchscreen Hub
Eye-level mounted tablet with large, high-contrast UI providing step-by-step cooking guidance and system control.
- Large touch targets
- High contrast display
- Recipe integration
Voice Assistant
Smart speaker with advanced mic array for clear voice pickup in noisy environments, featuring physical mute and help buttons.
- Noise cancellation
- Hands-free control
- Emergency commands
Multisensory Feedback
LED light strips with color-coded status indicators plus haptic vibration feedback via wearables.
- Visual status alerts
- Haptic notifications
- Color-coded safety
Color-Coded Status System
SafeAll systems normal
AttentionRequires monitoring
RiskImmediate action needed
Voice-First Navigation
“Speak to navigate” as a primary control, with large, simple confirmation states.
Guided Cooking Flows
Stepwise video with short text, and optional audio narration.
Safety by Design
Smart appliance control with auto-shutoff concepts, visible timers, and high-contrast alerts for heat, smoke, or inactivity.
Caregiver Mode
Shared routines, remote monitoring, and personalized voice prompts while keeping the user in charge.
CookPal, Smart. Supportive. Yours.
CookPal
Smart. Supportive. Yours.
Typography
Colors
UI Icons
Grid
Speak to navigate
Appliances
Routine Building
Grocery
Appliances
Routine
Just speak
CookPal
Validation and Learnings
What Testing Showed
- Layout and hierarchy felt clear and “less scary” than typical cooking apps.
- Some duplicate controls created hesitation; simplifying primary actions improved flow.
- Early safety alerts were too subtle; bolder visual treatment and plain-language copy helped.
- Embedding short, video-like guidance increased confidence and reduced missed steps.
- A task-focused dashboard outperformed an “everything at once” home screen.
What I'd Do Next
Run structured accessibility testing against WCAG plus cognitive-access heuristics.
Integrate with real IoT hardware to validate safety flows in live environments.
Implemented routine-building (e.g., “My breakfast flow”) to reinforce independence over time.
I vibe coded for Prototype & MVP
I built a high-fidelity prototype and an MVP using Figma MCP and vibe-coding to test flows, responsiveness, and voice interactions in something that felt close to a real product.
Why the MVP existed
Validate interaction logic and accessibility in something that feels “live”
Check responsiveness, hierarchy, and content density across breakpoints
Prototype voice commands and safety alerts in realistic cooking scenarios
https://github.com/shubhb-ux/smart-kitchen-designs.git
Why This Project Matters
This project shows how inclusive UX, AI, and IoT can work together to make everyday tasks like cooking more independent and
emotionally safe for neurodiverse adults.
For me, it's also a proof point that assistive products don't have to look "medical" to be
empowering, they can feel warm, familiar, and genuinely user-led.