Research


Action Detection & Recognition

MEID: Mixture-of-Experts with Internal Distillation for Long-Tailed Video Recognition
Xinjie Li, Huijuan Xu
Thirty-Seven AAAI Conference on Artificial Intelligence (AAAI), 2023
Paper (coming soon) Code

Weakly-Supervised Temporal Action Detection for Fine-Grained Videos with Hierarchical Atomic Actions
Zhi Li, Lu He, Huijuan Xu
European Conference on Computer Vision (ECCV), 2022
Paper Code

Temporal Action Detection with Multi-level Supervision
Baifeng Shi, Qi Dai, Judy Hoffman, Kate Saenko, Trevor Darrell, Huijuan Xu
International Conference on Computer Vision (ICCV), 2021
Paper Code

Weakly-Supervised Action Localization with Expectation-Maximization Multi-Instance Learning
Zhekun Luo, Devin Guillory, Baifeng Shi, Wei Ke, Fang Wan, Trevor Darrell, Huijuan Xu
European Conference on Computer Vision (ECCV), 2020
Paper Code Demo1 Demo2

Two-Stream Region Convolutional 3D Network for Temporal Activity Detection
Huijuan Xu, Abir Das, Kate Saenko
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2019
Paper Code

R-C3D: Region Convolutional 3D Network for Temporal Activity Detection
Huijuan Xu, Abir Das, Kate Saenko
International Conference on Computer Vision (ICCV), 2017
Paper Code Demo Project page


Compositional Scene Understanding

Disentangled Action Recognition with Knowledge Bases
Zhekun Luo, Shalini Ghosh, Devin Guillory, Keizo Kato, Trevor Darrell, Huijuan Xu
North American Chapter of the Association for Computational Linguistics (NAACL), 2022
Paper Code

Learning Canonical Representations for Scene Graph to Image Generation
Roei Herzig*, Amir Bar*, Huijuan Xu, Gal Chechik, Trevor Darrell, Amir Globerson
European Conference on Computer Vision (ECCV), 2020
Paper Code Project page

Something-Else: Compositional Action Recognition with Spatial-Temporal Interaction Networks
Joanna Materzynska, Tete Xiao, Roei Herzig, Huijuan Xu†, Xiaolong Wang†, Trevor Darrell†
Computer Vision and Pattern Recognition (CVPR), 2020
Paper Dataset Project page

TwoStreamVAN: Improving Motion Modeling in Video Generation
Ximeng Sun, Huijuan Xu, Kate Saenko
IEEE Winter Conference on Applications of Computer Vision (WACV), 2020
Paper Code Demo

Spatio-Temporal Action Graph Networks
Roei Herzig*, Elad Levi*, Huijuan Xu*, Hang Gao, Eli Brosh, Xiaolong Wang, Amir Globerson, Trevor Darrell
International Conference on Computer Vision Workshop (ICCVW), 2019
Paper Code


Vision and Language

Syntax Controlled Knowledge Graph-to-Text Generation with Order and Semantic Consistency
Jin Liu, Chongfeng Fan, Fengyu Zhou, Huijuan Xu
North American Chapter of the Association for Computational Linguistics (NAACL Findings), 2022
Paper Code

LoGAN: Latent Graph Co-Attention Network for Weakly-Supervised Video Moment Retrieval
Reuben Tan, Huijuan Xu, Kate Saenko, Bryan A. Plummer
IEEE Winter Conference on Applications of Computer Vision (WACV), 2021
Paper

Multilevel Language and Vision Integration for Text-to-Clip Retrieval
Huijuan Xu, Kun He, Bryan A. Plummer, Leonid Sigal, Stan Sclaroff, Kate Saenko
Thirty-Third AAAI Conference on Artificial Intelligence (AAAI), 2019
Paper Code Demo1 Demo2

Joint Event Detection and Description in Continuous Video Streams
Huijuan Xu, Boyang Li, Vasili Ramanishka, Leonid Sigal, Kate Saenko
IEEE Winter Conference on Applications of Computer Vision (WACV), 2019
Paper Code Demo1 Demo2

Ask, Attend and Answer: Exploring Question-Guided Spatial Attention for Visual Question Answering
Huijuan Xu, Kate Saenko
European Conference on Computer Vision (ECCV), 2016
Paper Code Video spotlight

Translating Videos to Natural Language Using Deep Recurrent Neural Networks
Subhashini Venugopalan, Huijuan Xu, Jeff Donahue, Marcus Rohrbach, Raymond Mooney, Kate Saenko
North American Chapter of the Association for Computational Linguistics (NAACL), 2015
Paper Project page


Learning with Less Labels

Meta-Baseline: Rethinking the Effectiveness of Simple Meta-Learning for Few-Shot Learning
Yinbo Chen, Zhuang Liu, Huijuan Xu, Trevor Darrell, Xiaolong Wang
International Conference on Computer Vision (ICCV), 2021
Paper Code

Auxiliary Task Reweighting for Minimum-data Learning
Baifeng Shi, Judy Hoffman, Kate Saenko, Trevor Darrell, Huijuan Xu
Neural Information Processing Systems (NeurIPS), 2020
Paper Code Project page

Learning Instance Activation Maps for Weakly Supervised Instance Segmentation
Yi Zhu, Yanzhao Zhou, Huijuan Xu, Qixiang Ye, David Doermann, Jianbin Jiao
Computer Vision and Pattern Recognition (CVPR), 2019
Paper Project page