• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

Siyu-C/ACAR-Net: [CVPR 2021] Actor-Context-Actor Relation Network for Spatio-tem ...

原作者: [db:作者] 来自: 网络 收藏 邀请

开源软件名称(OpenSource Name):

Siyu-C/ACAR-Net

开源软件地址(OpenSource Url):

https://github.com/Siyu-C/ACAR-Net

开源编程语言(OpenSource Language):

Python 100.0%

开源软件介绍(OpenSource Introduction):

[CVPR 2021] Actor-Context-Actor Relation Network for Spatio-temporal Action Localization

This repository gives the official PyTorch implementation of Actor-Context-Actor Relation Network for Spatio-temporal Action Localization (CVPR 2021) - 1st place solution of AVA-Kinetics Crossover Challenge 2020. This codebase also provides a general pipeline for training and evaluation on AVA-style datasets, as well as state-of-the-art action detection models.

Junting Pan Siyu Chen Zheng Shou Jing Shao Hongsheng Li
Junting Pan Siyu Chen Zheng Shou Jing Shao Hongsheng Li

Requirements

Some key dependencies are listed below, while others are given in requirements.txt.

  • Python >= 3.6
  • PyTorch >= 1.3, and a corresponding version of torchvision
  • ffmpeg (used in data preparation)
  • Download pre-trained models, which are listed in pretrained/README.md, to the pretrained folder.
  • Prepare data. Please refer to DATA.md.
  • Download annotations files to the annotations folder. See annotations/README.md for detailed information.

Usage

Default values for arguments nproc_per_node, backend and master_port are 8, nccl and 31114 respectively.

python main.py --config CONFIG_FILE [--nproc_per_node N_PROCESSES] [--backend BACKEND] [--master_addr MASTER_ADDR] [--master_port MASTER_PORT]

Running with Multiple Machines

In this case, the master_addr argument must be provided. Moreover, arguments nnodes and node_rank can be additionally specified (similar to torch.distributed.launch), otherwise the program will try to obtain their values from environment variables. See distributed_utils.py for details.

Model Zoo

Trained models are provided in model_zoo/README.md.

To-Do List

  • Our detections for AVA
  • Data preparation for Kinetics dataset, and training on AVA-Kinetics
  • Implementation for ACFB

License

ACAR-Net is released under the Apache 2.0 license.

CVPR 2020 AVA-Kinetics Challenge

Find slides and video presentation of our winning solution on [Google Slides] [Youtube Video] [Bilibili Video] (Starting from 18:20).

About Our Paper

Find our work on arXiv. architecture-fig

Please cite with the following Bibtex code:

@inproceedings{pan2021actor,
  title={Actor-context-actor relation network for spatio-temporal action localization},
  author={Pan, Junting and Chen, Siyu and Shou, Mike Zheng and Liu, Yu and Shao, Jing and Li, Hongsheng},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages={464--474},
  year={2021}
}

You may also want to refer to our publication with the more human-friendly Chicago style:

Pan, Junting, Siyu Chen, Mike Zheng Shou, Yu Liu, Jing Shao, and Hongsheng Li. "Actor-context-actor relation network for spatio-temporal action localization." In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 464-474. 2021.

Contact

If you have any general question about our work or code which may be of interest to other researchers, please use the public issues section of this repository. Alternatively, drop us an e-mail at siyuchen@pku.edu.cn and junting.pa@gmail.com .




鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap