Abstract
While existing motion style transfer methods are effective between two motions with identical content, their performance significantly diminishes when transferring style between motions with different contents. This challenge lies in the lack of clear separation between content and style of a motion. To tackle this challenge, we propose a novel motion style transformer that effectively disentangles style from content and generates a plausible motion with transferred style from a source motion. Our distinctive approach to achieving the goal of disentanglement is twofold: (1) a new architecture for motion style transformer with 'part-attentive style modulator across body parts' and ‘Siamese encoders that encode style and content features separately’; (2) style disentanglement loss. Our method outperforms existing methods and demonstrates exceptionally high quality, particularly in motion pairs with different contents, without the need for heuristic post-processing. Codes are available at https://github.com/Boeun-Kim/MoST.
| Original language | English |
|---|---|
| Title of host publication | 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) |
| Publisher | Institute of Electrical and Electronics Engineers (IEEE) |
| Pages | 1705-1714 |
| Number of pages | 10 |
| ISBN (Electronic) | 9798350353006 |
| ISBN (Print) | 9798350353013 |
| DOIs | |
| Publication status | Published - 16 Sept 2024 |
| Event | 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition - Seattle Convention Center, Seattle, United States Duration: 16 Jun 2024 → 22 Jun 2024 https://cvpr.thecvf.com https://cvpr.thecvf.com/Conferences/2024 |
Publication series
| Name | Conference on Computer Vision and Pattern Recognition (CVPR) |
|---|---|
| Publisher | IEEE |
| ISSN (Print) | 1063-6919 |
| ISSN (Electronic) | 2575-7075 |
Conference
| Conference | 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition |
|---|---|
| Abbreviated title | CVPR 2024 |
| Country/Territory | United States |
| City | Seattle |
| Period | 16/06/24 → 22/06/24 |
| Internet address |
Keywords
- Computational modeling
- Data acquisition
- Modulation
- Computer architecture
- Transformers
- Data models
- Pattern recognition
Fingerprint
Dive into the research topics of 'MoST: Motion Style Transformer Between Diverse Action Contents'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver