Skip to main navigation Skip to search Skip to main content

MagicPen: Enabling Dynamic Physical Scaffolding through Haptic Feedback for 3D Content Creation in VR with a Variable-length Stylus

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Stylus interaction is widely used for 3D content creation. In VR, it is typically mid-air, offering spatial freedom while lacking the grounded haptic feedback required for both shape perception and active geometric editing. To address this, we present MagicPen, a variable-length stylus that delivers grounded haptic feedback and enables active 3D editing through on-surface interaction. MagicPen operates through dynamic physical scaffolding, an interaction approach that adjusts the length to the interaction context: compliantly rendering geometry the user is actively creating, or resistively rendering predefined virtual geometry as a rigid constraint. We conducted three user studies comparing MagicPen with mid-air interaction in terms of accuracy, task load, and user preference: (1) single-axis positioning for depth precision; (2) freeform 3D planar drawing in compliant mode; and (3) drawing on rendered geometry in rigid mode. Results show MagicPen improves depth positioning. MagicPen better supports 3D content creation by enabling grounded shape perception.
Original languageEnglish
Title of host publicationUIST '26: Proceedings of the 39th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery (ACM)
Number of pages15
ISBN (Print)97984007-2856-[...]
DOIs
Publication statusAccepted/In press - 31 Jul 2026
Event39th Annual ACM Symposium on User Interface Software and Technology - Detroit Marriott at the Renaissance Center, Detroit, United States
Duration: 2 Nov 2026 → 5 Nov 2026
Conference number: 39th
https://uist.acm.org/2026/

Conference

Conference39th Annual ACM Symposium on User Interface Software and Technology
Abbreviated titleUIST '26
Country/TerritoryUnited States
CityDetroit
Period2/11/26 → 5/11/26
Internet address

Bibliographical note

Not yet published as of 12/10/2026. Expected in late October 2026.

Keywords

  • Haptics
  • Styluses
  • Human Computer Interaction
  • Input devices

Fingerprint

Dive into the research topics of 'MagicPen: Enabling Dynamic Physical Scaffolding through Haptic Feedback for 3D Content Creation in VR with a Variable-length Stylus'. Together they form a unique fingerprint.

Cite this