Greetings! Welcome to my homepage!

I am a 5th 4th 3rd year Ph.D. student in Computer Science at Georgia Tech, advised by Prof. Devi Parikh, and work closely with Prof. Dhruv Batra. Prior to my Ph.D. study, I did my master study in CBSR & NLPR, CASIA and BUPT, under the supervision of Prof. Stan Z. Li and mentored by Prof. Zhen Lei. I earned my Bachelor degree from Central South University, Changsha, China. Here is my full CV.

Email: jw2yang at gatech dot edu

My research interests mainly span in computer vision, machine learning and vision and language. My primary research is about structural visual understanding and how to leverage it for intelligent interactions with human (language) and environment (embodiment).

I am seeking full-time research job on computer vision, machine learning, vision and language. Feel free to drop me an email!


News

[09/2019] Our paper on Cross-Channel Communication for complementary neurons is accepted by NeurIPS 2019!
[09/2019] Honored to be on Program Committee at two NeurIPS 2019 workshops Graph Representation Learning and Robot Learning!
[09/2019] Honored to be a top-ranked reviewer in NeurIPS 2019, appreciate for registration reservation!
[08/2019] Our paper on Embodied Amodal Recognition is accepted by ICCV 2019!
[08/2019] Honored to be a PC member in ICCV 2019 Workshop Scene Graph Representation Learning. Welcome to submit!
[09/2018] Our paper Visual Curiosity is accepted by CoRL 2018 as an oral presentation!
[09/2018] Honored to be a top-ranked reviewer in NIPS 2018, appreciate for the free registration!

Publications [google scholar]

Cross-Channel Communication Networks.
Jianwei Yang, Zhile Ren, Hongyuan Zhu, Ji Lin, Chuang Gan, Devi Parikh
Neural Information Processing Systems (NeurIPS) 2019.
[pdf][code]
Embodied Amodal Recognition: Learning to Move to Perceive Objects.
Jianwei Yang*, Zhile Ren*, Mingze Xu, Xinlei Chen, David Crandall, Devi Parikh, Dhruv Batra. (* = equal contribution)
International Conference on Computer Vision (ICCV) 2019.
[pdf]
Visual Curiosity: Learning to Ask Questions to Learn Visual Recognition.
Jianwei Yang*, Jiasen Lu*, Stefan Lee, Dhruv Batra, Devi Parikh. (* = equal contribution)
Conference on Robot Learning (CoRL) 2018.
(Oral Presentation)
[pdf]
Graph R-CNN for Scene Graph Generation.
Jianwei Yang*, Jiasen Lu*, Stefan Lee, Dhruv Batra, Devi Parikh. (* = equal contribution)
European Conference on Computer Vision (ECCV) 2018.
[pdf] [code] [poster]
Neural Baby Talk.
Jiasen Lu*, Jianwei Yang*, Dhruv Batra, Devi Parikh. (* = equal contribution)
Computer Vision and Pattern Recognition (CVPR) 2018.
(Spotlight Presentation)
[pdf] [code]
Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model
Jiasen Lu, Anitha Kannan, Jianwei Yang, Devi Parikh, Dhruv Batra.
Neural Inforamtion Processing Systems (NIPS) 2017.
[pdf] [code]
LR-GAN: Layered Recursive Generative Adversarial Networks for Image Generation.
Jianwei Yang, Anitha Kannan, Dhruv Batra, Devi Parikh.
International Conference on Learning Representations (ICLR) 2017.
[pdf] [code]
Hierarchical Question-Image Co-Attention for Visual Question Answering.
Jiasen Lu, Jianwei Yang, Dhruv Batra, Devi Parikh.
Proceeding of Neural Inforamtion Processing Systems (NIPS) 2016.
[pdf] [code]
Joint Unsupervised Learning of Deep Representations and Image Clusters.
Jianwei Yang, Devi Parikh, Dhruv Batra.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016
[pdf] [torch code] [caffe code] [poster] [presentation]
Person-Specific Face Anti-Spoofing with Subject Domain Adaptation.
Jianwei Yang, Zhen Lei, Dong Yi, Stan Z. Li.
IEEE Transaction on Information Forensics and Security (TIFS), 2015
[pdf] [code]
Learn Convolutional Neural Network for Face Anti-Spoofing.
Jianwei Yang, Zhen Lei, Stan Z. Li.
Technical report, arXiv:1408.5601, 2014
[pdf]
Face Liveness Detection with Component Dependent Descriptor.
Jianwei Yang, Zhen Lei, Shengcai Liao, Stan Z. Li.
6th IAPR International Conference on Biometrics (ICB), 2013
[pdf] [code]
The 2nd Competition on Counter Measures to 2D Face Spoofing Attacks.
Team: Jianwei Yang, Zhen Lei, Dong Yi, Stan Z. Li.
6th IAPR International Conference on Biometrics (ICB), 2013
(Winner of Competition)
[pdf]
A New Projection Space for Separation of Specular and Diffuse Reflection Components in Color Images.
Jianwei Yang, Zhaowei Cai, Longyin Wen, Zhen Lei, Guodong Guo, Stan Z. Li.
11th Asian Conference on Computer Vision (ACCV), 2012.
[pdf]
Spatio-Temporal LBP-Based Moving Object Segmentation In Compressed Domain.
Jianwei Yang, Shizhen Wang, Zhen Lei, Yanyun Zhao, Stan Z. Li.
9th IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS), 2012
(Oral Presentation)
[pdf]

Projects [github]

A faster implementation of faster R-CNN for object detection. It supports multi-GPU, batched training and multiple pooling methods.

Reproduced 3000 fps face alignment algorithm proposed in CVPR 2014 paper "Face alignment at 3000 fps via regressing local binary features.", Ren et al.

Face Anti-Spoofing
Improved our works in "The 2nd Competition on Counter Measures to 2D Face Spoofing Attacks" to more realistic application environments.
Face Verification

Developed a real-time face verification system (99.02% on LFW) proposed in "Deep Learning Face Representation by Joint Identification-Verification.", Sun et al.


Activities

Reviewer for Neural Information Processing Systems (NIPS) 2017
Reviewer for IEEE International Conference on Computer Vision (ICCV) 2017
Reviewer for LSSB Workshop joint with IEEE Winter Conference on Applications of Computer Vision (WACV) 2017, Jan. 2017
Reviewer for IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017, Jan. 2017
Reviewer for IEEE Transaction on Information Forensics and Security (TIFS) 2016, Nov. 2016
Reviewer for Neural Information Processing Systems (NIPS) 2016, June-July 2016
Reviewer for Image and Vision Computing (IVC) Journal 2016, April 2016
Reviewer for International Joint Conference on Biometrics (IJCB) 2014, May 2014
Reviewer for International Conference on Pattern Recognition (ICPR) 2014, Jan. 2014
Reviewer for IEEE Transaction on Information Forensics and Security (TIFS) 2014, Mar. 2014