Skip to main navigation Skip to search Skip to main content

MoST: Motion Style Transformer Between Diverse Action Contents

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

While existing motion style transfer methods are effective between two motions with identical content, their performance significantly diminishes when transferring style between motions with different contents. This challenge lies in the lack of clear separation between content and style of a motion. To tackle this challenge, we propose a novel motion style transformer that effectively disentangles style from content and generates a plausible motion with transferred style from a source motion. Our distinctive approach to achieving the goal of disentanglement is twofold: (1) a new architecture for motion style transformer with 'part-attentive style modulator across body parts' and ‘Siamese encoders that encode style and content features separately’; (2) style disentanglement loss. Our method outperforms existing methods and demonstrates exceptionally high quality, particularly in motion pairs with different contents, without the need for heuristic post-processing. Codes are available at https://github.com/Boeun-Kim/MoST.
Original languageEnglish
Title of host publication2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages1705-1714
Number of pages10
ISBN (Electronic)9798350353006
ISBN (Print)9798350353013
DOIs
Publication statusPublished - 16 Sept 2024
Event2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition - Seattle Convention Center, Seattle, United States
Duration: 16 Jun 202422 Jun 2024
https://cvpr.thecvf.com
https://cvpr.thecvf.com/Conferences/2024

Publication series

NameConference on Computer Vision and Pattern Recognition (CVPR)
PublisherIEEE
ISSN (Print)1063-6919
ISSN (Electronic)2575-7075

Conference

Conference2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition
Abbreviated titleCVPR 2024
Country/TerritoryUnited States
CitySeattle
Period16/06/2422/06/24
Internet address

Keywords

  • Computational modeling
  • Data acquisition
  • Modulation
  • Computer architecture
  • Transformers
  • Data models
  • Pattern recognition

Fingerprint

Dive into the research topics of 'MoST: Motion Style Transformer Between Diverse Action Contents'. Together they form a unique fingerprint.

Cite this