Skip to content

Commit 8f75f4b

Browse files
committed
Added Jesse's paper, Fixed some other issues too
1 parent a5e3834 commit 8f75f4b

47 files changed

Lines changed: 714 additions & 280 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

_publications/2023-11-blend-mr.html

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,8 +15,7 @@
1515
- Full Paper
1616
- Peer-reviewed
1717
tags:
18-
- Human Scale Interaction
19-
- Shape-Changing Devices
18+
- Augmented Reality
2019
awards:
2120
- Best Paper Award at ISS'23
2221

_publications/2025-09-laymo.html

Lines changed: 2 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -35,22 +35,8 @@
3535
---
3636

3737
<p>
38-
Dynamic physical interfaces are often dedicated devices designed
39-
to adapt their physical properties to user needs. In this paper, we
40-
present an actuation system that allows users to transform their
41-
existing objects into dynamic physical user interfaces. We design
42-
our actuation system to integrate as a self-contained locomotion
43-
layer into existing objects that are small-scale, i.e., hand-size rather
44-
than furniture-size. We envision that such objects can act as col-
45-
laborators: as a studio assistant in a painter’s palette, as tutors in a
46-
student’s ruler, or as caretakers for plants evading direct sunlight.
38+
Dynamic physical interfaces are often dedicated devices designed to adapt their physical properties to user needs. In this paper, we present an actuation system that allows users to transform their existing objects into dynamic physical user interfaces. We design our actuation system to integrate as a self-contained locomotion layer into existing objects that are small-scale, i.e., hand-size rather than furniture-size. We envision that such objects can act as collaborators: as a studio assistant in a painter’s palette, as tutors in a student’s ruler, or as caretakers for plants evading direct sunlight.
4739
</p>
4840
<p>
49-
The key idea is to decompose the actuation into (1) energy input
50-
and (2) steering to achieve a flat form factor. The energy input
51-
is provided by simple vibration. We implement steering through
52-
differential friction controlled by flat-foldable compliant structures
53-
that can be activated electrically. We study the mechanism and its
54-
performance, and show its application scenarios enabling dynamic
55-
interactions with objects.
41+
The key idea is to decompose the actuation into (1) energy input and (2) steering to achieve a flat form factor. The energy input is provided by simple vibration. We implement steering through differential friction controlled by flat-foldable compliant structures that can be activated electrically. We study the mechanism and its performance, and show its application scenarios enabling dynamic interactions with objects.
5642
</p>

_publications/2025-09-object-agents.html

Lines changed: 1 addition & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -38,21 +38,5 @@
3838
---
3939

4040
<p>
41-
Users constantly interact with physical, most often passive, objects.
42-
Consider if familiar objects instead proactively assisted users, e.g.,
43-
a stapler moving across the table to help users organize documents,
44-
or a knife moving away to prevent injury as the user is inatten-
45-
tively about to lean against the countertop. In this paper, we build
46-
on the qualities of tangible interaction and focus on recognizing
47-
user needs in everyday tasks to enable ubiquitous yet unobtrusive
48-
tangible interaction. To achieve this, we introduce an architecture
49-
that leverages large language models (LLMs) to perceive users’
50-
environment and activities, perform spatial-temporal reasoning,
51-
and generate object actions aligned with inferred user intentions
52-
and object properties. We demonstrate the system’s utility provid-
53-
ing proactive assistance with multiple objects and in various daily
54-
scenarios. To evaluate our system components, we compare our
55-
system-generated output for user goal estimation and object action
56-
recommendation with human-annotated baselines, with results
57-
indicating good agreement.
41+
Users constantly interact with physical, most often passive, objects. Consider if familiar objects instead proactively assisted users, e.g., a stapler moving across the table to help users organize documents, or a knife moving away to prevent injury as the user is inattentively about to lean against the countertop. In this paper, we build on the qualities of tangible interaction and focus on recognizing user needs in everyday tasks to enable ubiquitous yet unobtrusive tangible interaction. To achieve this, we introduce an architecture that leverages large language models (LLMs) to perceive users’ environment and activities, perform spatial-temporal reasoning, and generate object actions aligned with inferred user intentions and object properties. We demonstrate the system’s utility providing proactive assistance with multiple objects and in various daily scenarios. To evaluate our system components, we compare our system-generated output for user goal estimation and object action recommendation with human-annotated baselines, with results indicating good agreement.
5842
</p>
Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,40 @@
1+
---
2+
layout: article
3+
4+
publication-date: 2026-04-13
5+
title: "Towards Fluent Interaction with Cyber-Physical Architecture"
6+
authors:
7+
- Jesse T Gonzalez
8+
- Neeta M Khanuja
9+
- Michael Mingxuan Li
10+
- Maggie Guo
11+
- Layomi Olaitan
12+
- Emily Lau
13+
- Jenny Pugh
14+
- Alexandra Ion
15+
- Scott E Hudson
16+
venue: In Proceedings of CHI ’26. Barcelona, Spain. April 13–17, 2026.
17+
type:
18+
- Conference
19+
- Full Paper
20+
- Peer-reviewed
21+
tags:
22+
- Ubiquitous Robotics
23+
- Physical AI
24+
- Human Scale Interaction
25+
- Shape-Changing Devices
26+
awards:
27+
- Best Paper Award at CHI'26
28+
29+
video: https://youtu.be/xvUrNpQRYok
30+
video-thumb: https://youtu.be/xvUrNpQRYok
31+
32+
image: teaser.jpg
33+
pdf: paper.pdf
34+
doi: https://doi.org/10.1145/3772318.3791787
35+
36+
37+
---
38+
<p>
39+
What happens when your walls begin to move? This paper explores the design of human-robot interaction for architectural-scale, shape-changing environments. We present findings from two studies: (1) a series of speculative design workshops (N=20) that uncovered aspirational visions for these spaces, and (2) a task-based Wizard-of-Oz elicitation study (N=12) that grounded these visions in the challenges of practical interaction. Our workshop findings reveal a complex landscape of user desires, exposing critical tensions between proactive automation and the preservation of user autonomy, and between personalization and public ownership. Our elicitation study reveals a set of core interaction challenges related to multimodal collaboration; and, most critically: suggests the need for a modality-agnostic model of evolving user intent. We conclude with a set of grounded proposals for creating robotic environments that are collaborative and trusted partners in everyday life.
40+
</p>

_publications/2026-04-knee-exoskeleton.html

Lines changed: 2 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -30,21 +30,8 @@
3030
---
3131

3232
<p>
33-
Walking aids are critical for people with mobility impairments,
34-
yet current options remain unsatisfactory. Static knee braces are
35-
lightweight and affordable, but their rigid joints force users into
36-
unnatural gait patterns, leading to fatigue, reduced safety, and high
37-
abandonment rates. Robotic exoskeletons, in contrast, offer dynamic
38-
assistance that adapts to gait phases but rely on sensors, motors,
39-
and batteries that make them heavy, complex, and prohibitively expensive.
33+
Walking aids are critical for people with mobility impairments, yet current options remain unsatisfactory. Static knee braces are lightweight and affordable, but their rigid joints force users into unnatural gait patterns, leading to fatigue, reduced safety, and high abandonment rates. Robotic exoskeletons, in contrast, offer dynamic assistance that adapts to gait phases but rely on sensors, motors, and batteries that make them heavy, complex, and prohibitively expensive.
4034
</p>
4135
<p>
42-
In this paper, we propose a fully passive knee exoskeleton design
43-
that combines the accessibility of static braces with the adaptive
44-
functionality of robotic systems. Our design employs a mechanical
45-
trigger under the foot to lock and release the knee joint in sync with the gait cycle,
46-
enabling more natural walking without electronics or actuation.
47-
Using human-centered methods, we conducted interviews
48-
with clinicians and orthosis users to guide our design and
49-
evaluated an early prototype as a design probe with stakeholders.
36+
In this paper, we propose a fully passive knee exoskeleton design that combines the accessibility of static braces with the adaptive functionality of robotic systems. Our design employs a mechanical trigger under the foot to lock and release the knee joint in sync with the gait cycle, enabling more natural walking without electronics or actuation. Using human-centered methods, we conducted interviews with clinicians and orthosis users to guide our design and evaluated an early prototype as a design probe with stakeholders.
5037
</p>

_site/404.html

Lines changed: 3 additions & 2 deletions
Large diffs are not rendered by default.
Binary file not shown.
399 KB

_site/contact.html

Lines changed: 3 additions & 2 deletions
Large diffs are not rendered by default.

_site/index.html

Lines changed: 28 additions & 2 deletions
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)