The First Visual Object Tracking Segmentation VOTS2023 Challenge Results

Matej Kristan; Jiří Matas; Martin Danelljan; Michael Felsberg; Hyung Jin Chang; Luka Čehovin Zajc; Alan Lukežič; Ondrej Drbohlav; Zhongqun Zhang; Khanh-Tung Tran; Xuan-Son Vu; Johanna Björklund; Christoph Mayer; Yushan Zhang; Lei Ke; Jie Zhao; Gustavo Fernández; Noor Al-Shakarji; Dong An; Michael Arens; Stefan Becker; Goutam Bhat; Sebastian Bullinger; Antoni B. Chan; Shijie Chang; Hanyuan Chen; Xin Chen; Yan Chen; Zhenyu Chen; Yangming Cheng; Yutao Cui; Chunyuan Deng; Jiahua Dong; Matteo Dunnhofer; Wei Feng; Jianlong Fu; Jie Gao; Ruize Han; Zeqi Hao; Jun-Yan He; Keji He; Zhenyu He; Xiantao Hu; Kaer Huang; Yuqing Huang; Yi Jiang; Ben Kang; Jin-Peng Lan; Hyungjun Lee; Chenyang Li; Jiahao Li; Ning Li; Wangkai Li; Xiaodi Li; Xin Li; Pengyu Liu; Yue Liu; Huchuan Lu; Bin Luo; Ping Luo; Yinchao Ma; Deshui Miao; Christian Micheloni; Kannappan Palaniappan; Hancheol Park; Matthieu Paul; HouWen Peng; Zekun Qian; Gani Rahmon; Norbert Scherer-Negenborn; Pengcheng Shao; Wooksu Shin; Elham Soltani Kazemi; Tianhui Song; Rainer Stiefelhagen; Rui Sun; Chuanming Tang; Zhangyong Tang; Imad Eddine Toubal; Jack Valmadre; Joost van de Weijer; Luc Van Gool; Jash Vira; Stèphane Vujasinović; Cheng Wan; Jia Wan; Dong Wang; Fei Wang; Feifan Wang; He Wang; Limin Wang; Song Wang; Yaowei Wang; Zhepeng Wang; Gangshan Wu; Jiannan Wu; Qiangqiang Wu; Xiaojun Wu; Anqi Xiao; Jinxia Xie; Chenlong Xu; Min Xu; Tianyang Xu; Yuanyou Xu; Bin Yan; Dawei Yang; Ming-Hsuan Yang; Tianyu Yang; Yi Yang; Zongxin Yang; Xuanwu Yin; Fisher Yu; Hongyuan Yu; Qianjin Yu; Weichen Yu; YongSheng Yuan; Zehuan Yuan; Jianlin Zhang; Lu Zhang; Tianzhu Zhang; Guodongfang Zhao; Shaochuan Zhao; Yaozong Zheng; Bineng Zhong; Jiawen Zhu; Xuefeng Zhu; Yueting Zhuang; ChengAo Zong; Kunlong Zuo

doi:10.1109/ICCVW60793.2023.00195

The First Visual Object Tracking Segmentation VOTS2023 Challenge Results

Matej Kristan
, Jiří Matas
, Martin Danelljan
, Michael Felsberg
, Hyung Jin Chang
, Luka Čehovin Zajc
, Alan Lukežič
, Ondrej Drbohlav
, Zhongqun Zhang
, Khanh-Tung Tran
, Xuan-Son Vu
, Johanna Björklund
, Christoph Mayer
, Yushan Zhang
, Lei Ke
, Jie Zhao
, Gustavo Fernández
, Noor Al-Shakarji
, Dong An
, Michael Arens

Stefan Becker, Goutam Bhat, Sebastian Bullinger, Antoni B. Chan, Shijie Chang, Hanyuan Chen, Xin Chen, Yan Chen, Zhenyu Chen, Yangming Cheng, Yutao Cui, Chunyuan Deng, Jiahua Dong, Matteo Dunnhofer, Wei Feng, Jianlong Fu, Jie Gao, Ruize Han, Zeqi Hao, Jun-Yan He, Keji He, Zhenyu He, Xiantao Hu, Kaer Huang, Yuqing Huang, Yi Jiang, Ben Kang, Jin-Peng Lan, Hyungjun Lee, Chenyang Li, Jiahao Li, Ning Li, Wangkai Li, Xiaodi Li, Xin Li, Pengyu Liu, Yue Liu, Huchuan Lu, Bin Luo, Ping Luo, Yinchao Ma, Deshui Miao, Christian Micheloni, Kannappan Palaniappan, Hancheol Park, Matthieu Paul, HouWen Peng, Zekun Qian, Gani Rahmon, Norbert Scherer-Negenborn, Pengcheng Shao, Wooksu Shin, Elham Soltani Kazemi, Tianhui Song, Rainer Stiefelhagen, Rui Sun, Chuanming Tang, Zhangyong Tang, Imad Eddine Toubal, Jack Valmadre, Joost van de Weijer, Luc Van Gool, Jash Vira, Stèphane Vujasinović, Cheng Wan, Jia Wan, Dong Wang, Fei Wang, Feifan Wang, He Wang, Limin Wang, Song Wang, Yaowei Wang, Zhepeng Wang, Gangshan Wu, Jiannan Wu, Qiangqiang Wu, Xiaojun Wu, Anqi Xiao, Jinxia Xie, Chenlong Xu, Min Xu, Tianyang Xu, Yuanyou Xu, Bin Yan, Dawei Yang, Ming-Hsuan Yang, Tianyu Yang, Yi Yang, Zongxin Yang, Xuanwu Yin, Fisher Yu, Hongyuan Yu, Qianjin Yu, Weichen Yu, YongSheng Yuan, Zehuan Yuan, Jianlin Zhang, Lu Zhang, Tianzhu Zhang, Guodongfang Zhao, Shaochuan Zhao, Yaozong Zheng, Bineng Zhong, Jiawen Zhu, Xuefeng Zhu, Yueting Zhuang, ChengAo Zong, Kunlong Zuo

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

The Visual Object Tracking Segmentation VOTS2023 challenge is the eleventh annual tracker benchmarking activity of the VOT initiative. This challenge is the first to merge short-term and long-term as well as single-target and multiple-target tracking with segmentation masks as the only target location specification. A new dataset was created; the ground truth has been withheld to prevent overfitting. New performance measures and evaluation protocols have been created along with a new toolkit and an evaluation server. Results of the presented 47 trackers indicate that modern tracking frameworks are well-suited to deal with convergence of short-term and long-term tracking and that multiple and single target tracking can be considered a single problem. A leaderboard, with participating trackers details, the source code, the datasets, and the evaluation kit are publicly available at the challenge website1.

Original language	English
Title of host publication	2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)
Publisher	IEEE
Pages	1788-1810
Number of pages	23
ISBN (Electronic)	9798350307443
ISBN (Print)	9798350307450
DOIs	https://doi.org/10.1109/ICCVW60793.2023.00195
Publication status	Published - 25 Dec 2023
Event	2023 International Conference on Computer Vision - Paris Convention Centre, Paris, France Duration: 2 Oct 2023 → 6 Oct 2023 https://iccv2023.thecvf.com/

Publication series

Name	International Conference on Computer Vision Workshops (ICCV Workshops)
Publisher	IEEE
ISSN (Print)	2473-9936
ISSN (Electronic)	2473-9944

Conference

Conference	2023 International Conference on Computer Vision
Abbreviated title	ICCV 2023
Country/Territory	France
City	Paris
Period	2/10/23 → 6/10/23
Internet address	https://iccv2023.thecvf.com/

Keywords

Visualization
Computer vision
Target tracking
Protocols
Conferences
Robustness
Servers

Access to Document

10.1109/ICCVW60793.2023.00195Licence: None: All rights reserved

Cite this

Kristan, M., Matas, J., Danelljan, M., Felsberg, M., Chang, H. J., Zajc, L. Č., Lukežič, A., Drbohlav, O., Zhang, Z., Tran, K.-T., Vu, X.-S., Björklund, J., Mayer, C., Zhang, Y., Ke, L., Zhao, J., Fernández, G., Al-Shakarji, N., An, D., ... Zuo, K. (2023). The First Visual Object Tracking Segmentation VOTS2023 Challenge Results. In 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) (pp. 1788-1810). (International Conference on Computer Vision Workshops (ICCV Workshops)). IEEE. https://doi.org/10.1109/ICCVW60793.2023.00195

@inproceedings{e7113b5bc451440292e2f4875ef9d955,

title = "The First Visual Object Tracking Segmentation VOTS2023 Challenge Results",

abstract = "The Visual Object Tracking Segmentation VOTS2023 challenge is the eleventh annual tracker benchmarking activity of the VOT initiative. This challenge is the first to merge short-term and long-term as well as single-target and multiple-target tracking with segmentation masks as the only target location specification. A new dataset was created; the ground truth has been withheld to prevent overfitting. New performance measures and evaluation protocols have been created along with a new toolkit and an evaluation server. Results of the presented 47 trackers indicate that modern tracking frameworks are well-suited to deal with convergence of short-term and long-term tracking and that multiple and single target tracking can be considered a single problem. A leaderboard, with participating trackers details, the source code, the datasets, and the evaluation kit are publicly available at the challenge website1.",

keywords = "Visualization, Computer vision, Target tracking, Protocols, Conferences, Robustness, Servers",

author = "Matej Kristan and Ji{\v r}{\'i} Matas and Martin Danelljan and Michael Felsberg and Chang, \{Hyung Jin\} and Zajc, \{Luka {\v C}ehovin\} and Alan Luke{\v z}i{\v c} and Ondrej Drbohlav and Zhongqun Zhang and Khanh-Tung Tran and Xuan-Son Vu and Johanna Bj{\"o}rklund and Christoph Mayer and Yushan Zhang and Lei Ke and Jie Zhao and Gustavo Fern{\'a}ndez and Noor Al-Shakarji and Dong An and Michael Arens and Stefan Becker and Goutam Bhat and Sebastian Bullinger and Chan, \{Antoni B.\} and Shijie Chang and Hanyuan Chen and Xin Chen and Yan Chen and Zhenyu Chen and Yangming Cheng and Yutao Cui and Chunyuan Deng and Jiahua Dong and Matteo Dunnhofer and Wei Feng and Jianlong Fu and Jie Gao and Ruize Han and Zeqi Hao and Jun-Yan He and Keji He and Zhenyu He and Xiantao Hu and Kaer Huang and Yuqing Huang and Yi Jiang and Ben Kang and Jin-Peng Lan and Hyungjun Lee and Chenyang Li and Jiahao Li and Ning Li and Wangkai Li and Xiaodi Li and Xin Li and Pengyu Liu and Yue Liu and Huchuan Lu and Bin Luo and Ping Luo and Yinchao Ma and Deshui Miao and Christian Micheloni and Kannappan Palaniappan and Hancheol Park and Matthieu Paul and HouWen Peng and Zekun Qian and Gani Rahmon and Norbert Scherer-Negenborn and Pengcheng Shao and Wooksu Shin and Kazemi, \{Elham Soltani\} and Tianhui Song and Rainer Stiefelhagen and Rui Sun and Chuanming Tang and Zhangyong Tang and Toubal, \{Imad Eddine\} and Jack Valmadre and Weijer, \{Joost van de\} and Gool, \{Luc Van\} and Jash Vira and St{\`e}phane Vujasinovi{\'c} and Cheng Wan and Jia Wan and Dong Wang and Fei Wang and Feifan Wang and He Wang and Limin Wang and Song Wang and Yaowei Wang and Zhepeng Wang and Gangshan Wu and Jiannan Wu and Qiangqiang Wu and Xiaojun Wu and Anqi Xiao and Jinxia Xie and Chenlong Xu and Min Xu and Tianyang Xu and Yuanyou Xu and Bin Yan and Dawei Yang and Ming-Hsuan Yang and Tianyu Yang and Yi Yang and Zongxin Yang and Xuanwu Yin and Fisher Yu and Hongyuan Yu and Qianjin Yu and Weichen Yu and YongSheng Yuan and Zehuan Yuan and Jianlin Zhang and Lu Zhang and Tianzhu Zhang and Guodongfang Zhao and Shaochuan Zhao and Yaozong Zheng and Bineng Zhong and Jiawen Zhu and Xuefeng Zhu and Yueting Zhuang and ChengAo Zong and Kunlong Zuo",

year = "2023",

month = dec,

day = "25",

doi = "10.1109/ICCVW60793.2023.00195",

language = "English",

isbn = "9798350307450",

series = "International Conference on Computer Vision Workshops (ICCV Workshops)",

publisher = "IEEE",

pages = "1788--1810",

booktitle = "2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)",

note = "2023 International Conference on Computer Vision, ICCV 2023 ; Conference date: 02-10-2023 Through 06-10-2023",

url = "https://iccv2023.thecvf.com/",

}

Kristan, M, Matas, J, Danelljan, M, Felsberg, M, Chang, HJ, Zajc, LČ, Lukežič, A, Drbohlav, O, Zhang, Z, Tran, K-T, Vu, X-S, Björklund, J, Mayer, C, Zhang, Y, Ke, L, Zhao, J, Fernández, G, Al-Shakarji, N, An, D, Arens, M, Becker, S, Bhat, G, Bullinger, S, Chan, AB, Chang, S, Chen, H, Chen, X, Chen, Y, Chen, Z, Cheng, Y, Cui, Y, Deng, C, Dong, J, Dunnhofer, M, Feng, W, Fu, J, Gao, J, Han, R, Hao, Z, He, J-Y, He, K, He, Z, Hu, X, Huang, K, Huang, Y, Jiang, Y, Kang, B, Lan, J-P, Lee, H, Li, C, Li, J, Li, N, Li, W, Li, X, Li, X, Liu, P, Liu, Y, Lu, H, Luo, B, Luo, P, Ma, Y, Miao, D, Micheloni, C, Palaniappan, K, Park, H, Paul, M, Peng, H, Qian, Z, Rahmon, G, Scherer-Negenborn, N, Shao, P, Shin, W, Kazemi, ES, Song, T, Stiefelhagen, R, Sun, R, Tang, C, Tang, Z, Toubal, IE, Valmadre, J, Weijer, JVD, Gool, LV, Vira, J, Vujasinović, S, Wan, C, Wan, J, Wang, D, Wang, F, Wang, F, Wang, H, Wang, L, Wang, S, Wang, Y, Wang, Z, Wu, G, Wu, J, Wu, Q, Wu, X, Xiao, A, Xie, J, Xu, C, Xu, M, Xu, T, Xu, Y, Yan, B, Yang, D, Yang, M-H, Yang, T, Yang, Y, Yang, Z, Yin, X, Yu, F, Yu, H, Yu, Q, Yu, W, Yuan, Y, Yuan, Z, Zhang, J, Zhang, L, Zhang, T, Zhao, G, Zhao, S, Zheng, Y, Zhong, B, Zhu, J, Zhu, X, Zhuang, Y, Zong, C & Zuo, K 2023, The First Visual Object Tracking Segmentation VOTS2023 Challenge Results. in 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW). International Conference on Computer Vision Workshops (ICCV Workshops), IEEE, pp. 1788-1810, 2023 International Conference on Computer Vision, Paris, France, 2/10/23. https://doi.org/10.1109/ICCVW60793.2023.00195

The First Visual Object Tracking Segmentation VOTS2023 Challenge Results. / Kristan, Matej; Matas, Jiří; Danelljan, Martin et al.
2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW). IEEE, 2023. p. 1788-1810 (International Conference on Computer Vision Workshops (ICCV Workshops)).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - The First Visual Object Tracking Segmentation VOTS2023 Challenge Results

AU - Kristan, Matej

AU - Matas, Jiří

AU - Danelljan, Martin

AU - Felsberg, Michael

AU - Chang, Hyung Jin

AU - Zajc, Luka Čehovin

AU - Lukežič, Alan

AU - Drbohlav, Ondrej

AU - Zhang, Zhongqun

AU - Tran, Khanh-Tung

AU - Vu, Xuan-Son

AU - Björklund, Johanna

AU - Mayer, Christoph

AU - Zhang, Yushan

AU - Ke, Lei

AU - Zhao, Jie

AU - Fernández, Gustavo

AU - Al-Shakarji, Noor

AU - An, Dong

AU - Arens, Michael

AU - Becker, Stefan

AU - Bhat, Goutam

AU - Bullinger, Sebastian

AU - Chan, Antoni B.

AU - Chang, Shijie

AU - Chen, Hanyuan

AU - Chen, Xin

AU - Chen, Yan

AU - Chen, Zhenyu

AU - Cheng, Yangming

AU - Cui, Yutao

AU - Deng, Chunyuan

AU - Dong, Jiahua

AU - Dunnhofer, Matteo

AU - Feng, Wei

AU - Fu, Jianlong

AU - Gao, Jie

AU - Han, Ruize

AU - Hao, Zeqi

AU - He, Jun-Yan

AU - He, Keji

AU - He, Zhenyu

AU - Hu, Xiantao

AU - Huang, Kaer

AU - Huang, Yuqing

AU - Jiang, Yi

AU - Kang, Ben

AU - Lan, Jin-Peng

AU - Lee, Hyungjun

AU - Li, Chenyang

AU - Li, Jiahao

AU - Li, Ning

AU - Li, Wangkai

AU - Li, Xiaodi

AU - Li, Xin

AU - Liu, Pengyu

AU - Liu, Yue

AU - Lu, Huchuan

AU - Luo, Bin

AU - Luo, Ping

AU - Ma, Yinchao

AU - Miao, Deshui

AU - Micheloni, Christian

AU - Palaniappan, Kannappan

AU - Park, Hancheol

AU - Paul, Matthieu

AU - Peng, HouWen

AU - Qian, Zekun

AU - Rahmon, Gani

AU - Scherer-Negenborn, Norbert

AU - Shao, Pengcheng

AU - Shin, Wooksu

AU - Kazemi, Elham Soltani

AU - Song, Tianhui

AU - Stiefelhagen, Rainer

AU - Sun, Rui

AU - Tang, Chuanming

AU - Tang, Zhangyong

AU - Toubal, Imad Eddine

AU - Valmadre, Jack

AU - Weijer, Joost van de

AU - Gool, Luc Van

AU - Vira, Jash

AU - Vujasinović, Stèphane

AU - Wan, Cheng

AU - Wan, Jia

AU - Wang, Dong

AU - Wang, Fei

AU - Wang, Feifan

AU - Wang, He

AU - Wang, Limin

AU - Wang, Song

AU - Wang, Yaowei

AU - Wang, Zhepeng

AU - Wu, Gangshan

AU - Wu, Jiannan

AU - Wu, Qiangqiang

AU - Wu, Xiaojun

AU - Xiao, Anqi

AU - Xie, Jinxia

AU - Xu, Chenlong

AU - Xu, Min

AU - Xu, Tianyang

AU - Xu, Yuanyou

AU - Yan, Bin

AU - Yang, Dawei

AU - Yang, Ming-Hsuan

AU - Yang, Tianyu

AU - Yang, Yi

AU - Yang, Zongxin

AU - Yin, Xuanwu

AU - Yu, Fisher

AU - Yu, Hongyuan

AU - Yu, Qianjin

AU - Yu, Weichen

AU - Yuan, YongSheng

AU - Yuan, Zehuan

AU - Zhang, Jianlin

AU - Zhang, Lu

AU - Zhang, Tianzhu

AU - Zhao, Guodongfang

AU - Zhao, Shaochuan

AU - Zheng, Yaozong

AU - Zhong, Bineng

AU - Zhu, Jiawen

AU - Zhu, Xuefeng

AU - Zhuang, Yueting

AU - Zong, ChengAo

AU - Zuo, Kunlong

PY - 2023/12/25

Y1 - 2023/12/25

N2 - The Visual Object Tracking Segmentation VOTS2023 challenge is the eleventh annual tracker benchmarking activity of the VOT initiative. This challenge is the first to merge short-term and long-term as well as single-target and multiple-target tracking with segmentation masks as the only target location specification. A new dataset was created; the ground truth has been withheld to prevent overfitting. New performance measures and evaluation protocols have been created along with a new toolkit and an evaluation server. Results of the presented 47 trackers indicate that modern tracking frameworks are well-suited to deal with convergence of short-term and long-term tracking and that multiple and single target tracking can be considered a single problem. A leaderboard, with participating trackers details, the source code, the datasets, and the evaluation kit are publicly available at the challenge website1.

AB - The Visual Object Tracking Segmentation VOTS2023 challenge is the eleventh annual tracker benchmarking activity of the VOT initiative. This challenge is the first to merge short-term and long-term as well as single-target and multiple-target tracking with segmentation masks as the only target location specification. A new dataset was created; the ground truth has been withheld to prevent overfitting. New performance measures and evaluation protocols have been created along with a new toolkit and an evaluation server. Results of the presented 47 trackers indicate that modern tracking frameworks are well-suited to deal with convergence of short-term and long-term tracking and that multiple and single target tracking can be considered a single problem. A leaderboard, with participating trackers details, the source code, the datasets, and the evaluation kit are publicly available at the challenge website1.

KW - Visualization

KW - Computer vision

KW - Target tracking

KW - Protocols

KW - Conferences

KW - Robustness

KW - Servers

U2 - 10.1109/ICCVW60793.2023.00195

DO - 10.1109/ICCVW60793.2023.00195

M3 - Conference contribution

SN - 9798350307450

T3 - International Conference on Computer Vision Workshops (ICCV Workshops)

SP - 1788

EP - 1810

BT - 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)

PB - IEEE

T2 - 2023 International Conference on Computer Vision

Y2 - 2 October 2023 through 6 October 2023

ER -

The First Visual Object Tracking Segmentation VOTS2023 Challenge Results

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this