Jan Kautz
Vice President of Learning and Perception Research @ NVIDIA

I lead the Learning and Perception Research Team at NVIDIA, working predominantly on computer vision problems — from low-level vision (denoising, super-resolution, computational photography) and geometric vision (structure from motion, SLAM, optical flow) to visual perception (detection, recognition, classification), as well as machine learning problems (deep learning, reinforcement learning, generative models).

News
dec
2020
NeurIPS
My team has 8 papers at NeurIPS 2020. We hope to see you at our presentations!
jul
2020
ECCV
My team has 9 papers (including an oral and several spotlights) at ECCV 2020. We hope to see you online!
feb
2020
CVPR
My team has 9 papers accepted (including two orals) at CVPR 2020. Please stop by our posters and talks.
dec
2019
AWARD
GauGAN won a 2019 Popular Science "Best of What's New Award". You can try GauGAN yourself in your browser, see NVIDIA's AI playground.
oct
2019
ICCV
At ICCV, we won the HANDS 2019 competition (Task 3). With our collaborators from ETH, we won the Synthetic Eye Generation Challenge at the OpenEDS workshop.
oct
2019
PRESS
Our GANimals work is being covered by Engadget, Digital Trends, PetaPixel, New Scientist, and more.
sep
2019
NeurIPS
NVIDIA has 9 accepted papers at NeurIPS'19, including 4 from my team.
jul
2019
ICCV
Together with our internal and external collaborators, we have over 10 papers accepted at ICCV'19, including 6 orals.
jun
2019
DEMO
You can now try our work on GauGAN in your browser. Please head to over to NVIDIA's AI playground and launch the first demo.
apr
2019
CVPR
My team has over 10 papers accepted at CVPR 2019, including four orals. Please stop by our posters and talks.
mar
2019
PRESS
Our work on GauGAN is been covered by a number of outlets, including TechCrunch, ZDNet, Engadget, The Verge, and MIT Technology Review.
dec
2018
PRESS
Many outlets, including The Verge, Engadget, and MIT Technology Review, are reporting on the first video game demo using AI-generated graphics, which we demonstrated at NeurIPS.
dec
2018
NeurIPS
We are presenting several papers at the Conference on Neural Information Processing Systems. Please stop by our posters and see our demos at the NVIDIA booth!
aug
2018
NVIDIA
Our work on slow motion is now part of NVIDIA's NGX library, which also includes image inpainting, up-scaling, and deep learning super-sampling.
jun
2018
CVPR
Our paper SPLATNet: Sparse Lattice Networks for Point Cloud Processing received a Best Paper Honorable Mention Award at CVPR 2018.
jun
2018
PRESS
Our CVPR 2018 work on Super SloMo (blog) has been picked up by The Verge, VentureBeat, ZDNet, CNET, PetaPixel and many others (1,2,3,...).
may
2018
PRESS
Our ICRA 2018 work on learning human-readable plans from demonstrations (blog) has been picked up by VentureBeat, Engadget, ZDNet, and others (1,2,3,...).
apr
2018
CVPR
My team has eleven papers accepted at CVPR 2018, including three orals and three spotlights. See here for all NVIDIA papers.
mar
2018
PRESS
Our work on photorealistic image stylization has been picked up by PetaPixel, Ubergizmo and DesignTaxi. Code is on GitHub.
feb
2018
ICCP
Our paper on video deblurring via self-supervised learning was accepted at ICCP 2018.
feb
2018
ICRA
Our a paper on learning human-readable plans from real-world demonstrations was accepted at ICRA 2018.
Research Areas & Areas
Deep Learning
Deep learning is an active area for us. We are interested in efficient deep learning, for both training and inferencing, which includes pruning, neural architecture search, and so forth.
Visual Perception
Solving perception tasks is an important aspect of our work. In particular, we have recently focused on perception from videos as well as image collections using deep learning approaches.
Geometric Vision
My team is investigating deep learning-based approaches for efficient 3D reconstruction methods, processing of 3D data, as well as stereo and optical flow.
Deep Imagination
We investigate machine learning methods that can synthesize new images and videos, mostly based on generative adversarial networks.
Publications
2020
NeurIPS
NVAE: A Deep Hierarchical Variational Autoencoder
A. Vahdat, J. Kautz
Neural Information Processing Systems (NeurIPS)
December 2020 (spotlight)
PDF
NeurIPS
Online Adaptation for Consistent Mesh Reconstruction in the Wild
X. Li, S. Liu, S. D. Mello, K. Kim, X. Wang, M.-H. Yang, J. Kautz
Neural Information Processing Systems (NeurIPS)
December 2020
PDF
NeurIPS
Convolutional Tensor-Train LSTM for Spatio-Temporal Learning
J. Su, W. Byeon, J. Kossaifi, F. Huang, J. Kautz, A. Anandkumar
Neural Information Processing Systems (NeurIPS)
December 2020
PDF
ECCV
Contrastive Learning for Weakly Supervised Phrase Grounding
T. Gupta, A. Vahdat, G. Chechik, X. Yang, J. Kautz, D. Hoiem
European Conference on Computer Vision (ECCV)
August 2020 (spotlight)
PDF
ECCV
DeepGMR: Learning Latent Gaussian Mixture Models for Registration
W. Yuan, B. Eckart, K. Kim, V. Jampani, D. Fox, J. Kautz
European Conference on Computer Vision (ECCV)
August 2020 (spotlight)
PDF
ECCV
Joint Disentangling and Adaptation for Cross-Domain Person Re-Identification
Y. Zou, X. Yang, Z. Yu, B. V. K. V. Kumar, J. Kautz
European Conference on Computer Vision (ECCV)
August 2020 (oral)
PDF
ECCV
Self-supervised Single-view 3D Reconstruction via Semantic Consistency
X. Li, S. Liu, K. Kim, S. D. Mello, V. Jampani, M.-H. Yang, J. Kautz
European Conference on Computer Vision (ECCV)
August 2020
PDF
ECCV
Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraints
A. Spurr, P. Molchanov, U. Iqbal, O. Hilliges, J. Kautz
European Conference on Computer Vision (ECCV)
August 2020
PDF
ECCV
UFO2: A Unified Framework towards Omni-supervised Object Detection
Z. Ren, Z. Yu, X. Yang, M.-Y. Liu, A. Schwing, J. Kautz
European Conference on Computer Vision (ECCV)
August 2020
PDF
ICML
Angular Visual Hardness
B. Chen, W. Liu, A. Garg, Z. Yu, A. Shrivastava, J. Kautz, A. Anandkumar
International Conference on Machine Learning (ICML)
July 2020
PDF
CVPR
Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion
H. Yin, P. Molchanov, J. M. Alvarez, Z. Li, A. Mallya, D. Hoiem, N. Jha, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2020 (oral)
CVPR
UNAS: Differentiable Architecture Search Meets Reinforcement Learning
A. Vahdat, A. Mallya, M.-Y. Liu, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2020 (oral)
CVPR
Self-Supervised Viewpoint Learning from Image Collections
S. K. Mustikovela, V. Jampani, S. D. Mello, U. Iqbal, S. Liu, C. Rother, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2020
CVPR
Bi3D: Stereo Depth Estimation via Binary Classifications
A. Badki, O. Gallo, A. Troccoli, K. Kim, P. Sen, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2020
CVPR
Meshlet Priors for 3D Mesh Reconstruction
A. Badki, O. Gallo, P. Sen, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2020
CVPR
Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild
U. Iqbal, P. Molchanov, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2020
CVPR
Two-shot Spatially-varying BRDF and Shape Estimation
M. Boss, V. Jampani, K. Kim, H. Lensch, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2020
CVPR
Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Camera
J. S. Yoon, K. Kim, O. Gallo, H. S. Park, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2020
CVPR
Instance-aware, Context-focused, and Memory-efficient Weakly-Supervised Object Detection
Z. Ren, Z. Yu, X. Yang, M.-Y. Liu, Y. J. Lee, A. Schwing, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2020
WACV
NRMVS: Non-Rigid Multi-View Stereo
M. Innmann, K. Kim, J. Gu, M. Niessner, C. Loop, M. Stamminger, J. Kautz
IEEE Winter Conference on Applications of Computer Vision (WACV)
March 2020, pages 2754-2763
TPAMI
Domain Stylization: A Fast Covariance Matching Framework towards Domain Adaptation
A. Dundar, M.-Y. Liu, Z. Yu, T.-C. Wang, J. Zedlewski, J. Kautz
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
?(?), ? 2020
2019
NeurIPS
Joint-task Self-supervised Learning for Temporal Correspondence
X. Li, S. Liu, S. D. Mello, X. Wang, M.-H. Yang, J. Kautz
Neural Information Processing Systems (NeurIPS)
December 2019
NeurIPS
Dancing to Music
H.-Y. Lee, X. Yang, M.-Y. Liu, T.-C. Wang, Y.-D. Lu, M.-H. Yang, J. Kautz
Neural Information Processing Systems (NeurIPS)
December 2019
NeurIPS
Few-shot Video-to-Video Synthesis
T.-C. Wang, M.-Y. Liu, A. Tao, G. Liu, J. Kautz, B. Catanzaro
Neural Information Processing Systems (NeurIPS)
December 2019
ICCV
Extreme View Synthesis
I. Choi, O. Gallo, A. Troccoli, M. H. Kim, J. Kautz
IEEE International Conference on Computer Vision (ICCV)
October 2019 (oral)
ICCV
SENSE: A Shared Encoder Network for Scene-flow Estimation
H. Jiang, D. Sun, V. Jampani, Z. Lv, E. Learned-Miller, J. Kautz
IEEE International Conference on Computer Vision (ICCV)
October 2019 (oral)
ICCV
Few-shot Adaptive Gaze Estimation
S. Park, S. D. Mello, P. Molchanov, U. Iqbal, O. Hilliges, J. Kautz
IEEE International Conference on Computer Vision (ICCV)
October 2019 (oral)
ICCV
Learning Propagation for Arbitrarily-structured Data
S. Liu, X. Li, V. Jampani, S. D. Mello, J. Kautz
IEEE International Conference on Computer Vision (ICCV)
October 2019
ICCV
Few-shot Unsupervised Image-to-Image Translation
M.-Y. Liu, X. Huang, A. Mallya, T. Karras, T. Aila, J. Lehtinen, J. Kautz
IEEE International Conference on Computer Vision (ICCV)
October 2019
ICCV
Neural Inverse Rendering of an Indoor Scene from a Single Image
S. Sengupta, J. Gu, K. Kim, G. Liu, D. Jacobs, J. Kautz
IEEE International Conference on Computer Vision (ICCV)
October 2019
PDF
ICCV
Unsupervised Video Interpolation Using Cycle Consistency
F. Reda, D. Sun, A. Dundar, M. Shoeybi, G. Liu, K. Shih, A. Tao, J. Kautz, B. Catanzaro
IEEE International Conference on Computer Vision (ICCV)
October 2019
BMVC
Few-Shot Viewpoint Estimation
H.-Y. Tseng, S. D. Mello, J. Tremblay, S. Liu, S. Birchfield, M.-H. Yang, J. Kautz
British Machine Vision Conference (BMVC)
September 2019
PDF
BMVC
Video Stitching for Linear Camera Arrays
W.-S. Lai, O. Gallo, J. Gu, D. Sun, M.-H. Yang, J. Kautz
British Machine Vision Conference (BMVC)
September 2019
CVPR
Joint Discriminative and Generative Learning for Person Re-identification
Z. Zheng, X. Yang, Z. Yu, L. Zheng, Y. Yang, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2019 (oral)
CVPR
STEP: Spatio-Temporal Progressive Learning for Video Action Detection
X. Yang, X. Yang, M.-Y. Liu, F. Xiao, L. Davis, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2019 (oral)
CVPR
PlaneRCNN: 3D Plane Detection and Reconstruction from a Single View
C. Liu, K. Kim, J. Gu, Y. Furukawa, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2019 (oral)
CVPR
Neural RGB → D Sensing: Depth and Uncertainty from a Video Camera
C. Liu, J. Gu, K. Kim, S. Narasimhan, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2019 (oral)
CVPR
SCOPS: Self-Supervised Co-Part Segmentation
W.-C. Hung, V. Jampani, S. Liu, P. Molchanov, M.-H. Yang, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2019
CVPR
Pixel Adaptive Convolutional Neural Networks
H. Su, V. Jampani, D. Sun, O. Gallo, E. Learned-Miller, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2019
CVPR
Learning Linear Transformations for Fast Image and Video Style Transfer
X. Li, S. Liu, J. Kautz, M.-H. Yang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2019
CVPR
Putting Humans in a Scene: Learning Affordance in 3D Indoor Environments
X. Li, S. Liu, K. Kim, M.-H. Yang, X. Wang, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2019
CVPR
Importance Estimation for Neural Network Pruning
P. Molchanov, A. Mallya, S. Tyree, I. Frosio, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2019
TPAMI
Models Matter, So Does Training: An Empirical Study of CNNs for Optical Flow Estimation
D. Sun, X. Yang, M.-Y. Liu, J. Kautz
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
?(?), ? 2019
TIP
Statistical Nearest Neighbors for Image Denoising
I. Frosio, J. Kautz
IEEE Transactions on Image Processing
28(2), February 2019, pages 723-728
WACV
A Fusion Approach for Multi-Frame Optical Flow Estimation
Z. Ren, O. Gallo, D. Sun, M.-H. Yang, E. Sudderth, J. Kautz
IEEE Winter Conference on Applications of Computer Vision (WACV)
January 2019
PDF
2018
NeurIPS
Context-aware Synthesis and Placement of Object Instances
D. Lee, S. Liu, J. Gu, M. Liu, M.-H. Yang, J. Kautz
Neural Information Processing Systems (NeurIPS)
December 2018
NeurIPS
Video-to-Video Synthesis
T.-C. Wang, M.-Y. Liu, J.-Y. Zhu, G. Liu, A. Tao, J. Kautz, B. Catanzaro
Neural Information Processing Systems (NeurIPS)
December 2018
ECCV
Separating Reflection and Transmission Images in the Wild
P. Wieschollek, O. Gallo, J. Gu, J. Kautz
European Conference on Computer Vision (ECCV)
September 2018
PDF
ECCV
Hand Pose Estimation via Latent 2.5D Heatmap Regression
U. Iqbal, P. Molchanov, T. Breuel, J. Gall, J. Kautz
European Conference on Computer Vision (ECCV)
September 2018
PDF
ECCV
Multimodal Unsupervised Image-to-image Translation
X. Huang, M.-Y. Liu, S. Belongie, J. Kautz
European Conference on Computer Vision (ECCV)
September 2018
ECCV
Switchable Temporal Propagation Network
S. Liu, J. Gu, S. D. Mello, V. Jampani, G. Zhong, M.-H. Yang, J. Kautz
European Conference on Computer Vision (ECCV)
September 2018
PDF
ECCV
Tackling 3D ToF Artifacts Through Learning and the FLAT Dataset
Q. Guo, I. Frosio, O. Gallo, T. Zickler, J. Kautz
European Conference on Computer Vision (ECCV)
September 2018
PDF
ECCV
SEAL: A Framework Towards Simultaneous Edge Alignment and Learning
Z. Yu, W. Liu, Y. Zou, C. Feng, S. Ramalingam, B. V. K. V. Kumar, J. Kautz
European Conference on Computer Vision (ECCV)
September 2018
ECCV
Superpixel Sampling Networks
V. Jampani, D. Sun, M.-Y. Liu, M.-H. Yang, J. Kautz
European Conference on Computer Vision (ECCV)
September 2018
ECCV
A Closed-form Solution to Photorealistic Image Stylization
Y. Li, M.-Y. Liu, X. Li, M.-H. Yang, J. Kautz
European Conference on Computer Vision (ECCV)
September 2018
ECCV
Learning Rigidity in Dynamic Scenes with a Moving Camera for 3D Motion Field Estimation
Z. Lv, K. Kim, A. Troccoli, D. Sun, J. Rehg, J. Kautz
European Conference on Computer Vision (ECCV)
September 2018
ECCV
HGMR: Hierarchical Gaussian Mixtures for Adaptive 3D Registration
B. Eckart, K. Kim, J. Kautz
European Conference on Computer Vision (ECCV)
September 2018
PDF
BMVC
EOE: Expected Overlap Estimation Over Unstructured Point Cloud Data
B. Eckart, K. Kim, J. Kautz
International Conference on 3D Vision (3DV)
September 2018
PDF
BMVC
Budget-Aware Activity Detection with A Recurrent Policy Network
B. Mahesseni, X. Yang, P. Molchanov, J. Kautz
British Machine Vision Conference (BMVC)
September 2018
CVPR
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume
D. Sun, X. Yang, M.-Y. Liu, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2018 (oral)
CVPR
SPLATNet: Sparse Lattice Networks for Point Cloud Processing
H. Su, V. Jampani, D. Sun, S. Maji, E. Kalogerakis, M.-H. Yang, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2018 (oral -- best paper honorable mention award)
CVPR
High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
T.-C. Wang, M.-Y. Liu, J.-Y. Zhu, A. Tao, J. Kautz, B. Catanzaro
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2018 (oral)
CVPR
Geometry-Aware Learning of Maps for Camera Localization
S. Brahmbhatt, J. Gu, K. Kim, J. Hays, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2018 (spotlight)
CVPR
Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation
H. Jiang, D. Sun, V. Jampani, M.-H. Yang, E. Learned-Miller, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2018 (spotlight)
CVPR
Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals
S. Yuan, G. Garcia-Hernando, B. Stenger, G. Moon, J. Y. Chang, K. M. Lee, P. Molchanov, J. Kautz, S. Honari, L. Ge, J. Yuan, X. Chen, G. Wang, F. Yang, K. Akiyama, Y. Wu, Q. Wan, M. Madadi, S. Escalera, S. Li, D. Lee, I. Oikonomidis, A. Argyros, T.-K. Kim
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2018 (spotlight)
PDF
CVPR
Learning Superpixels with Segmentation-Aware Affinity Loss
W.-C. Tu, M.-Y. Liu, V. Jampani, D. Sun, S.-Y. Chien, M.-H. Yang, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2018
CVPR
Deep Semantic Face Deblurring
Z. Shen, W.-S. Lai, T. Xu, J. Kautz, M.-H. Yang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2018
CVPR
MoCoGAN: Decomposing Motion and Content for Video Generation
S. Tulyakov, M.-Y. Liu, X. Yang, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2018
PDF
CVPR
Improving Landmark Localization with Semi-Supervised Learning
S. Honari, P. Molchanov, S. Tyree, C. Pal, P. Vincent, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2018
CVPR
Making Convolutional Networks Recurrent for Visual Sequence Learning
X. Yang, P. Molchanov, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2018
ICCP
ReBlur2Deblur: Deblurring Videos via Self-Supervised Learning
H. Chen, J. Gu, O. Gallo, M.-Y. Liu, A. Veeraraghavan, J. Kautz
International Conference on Computational Photography (ICCP)
May 2018
ICRA
Synthetically Trained Networks for Learning Human-Readable Plans from Real-World Demonstrations
J. Tremblay, T. To, A. Molchanov, S. Tyree, J. Kautz, S. Birchfield
International Conference on Robotics and Automation (ICRA)
May 2018
PDF
AAAI
Learning Binary Residual Representations for Domain-specific Video Streaming
Y.-H. Tsai, M.-Y. Liu, D. Sun, M.-H. Yang, J. Kautz
AAAI Conference on Artificial Intelligence (AAAI)
February 2018 (spotlight)
EI
Learning Adaptive Parameter Tuning for Image Processing
J. Dong, I. Frosio, J. Kautz
Electronic Imaging, Image Processing: Algorithms and Systems XVI
January 2018
PDF
2017
NIPS
Unsupervised Image-to-Image Translation
M.-Y. Liu, T. Breuel, J. Kautz
Neural Information Processing Systems (NIPS)
December 2017 (spotlight)
NIPS
Learning Affinity via Spatial Propagation Networks
S. Liu, S. De Mello, J. Gu, G. Zhong, M.-S. Yang, J. Kautz
Neural Information Processing Systems (NIPS)
December 2017
ICCV
Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting
R. Maier, K. Kim, D. Cremers, J. Kautz, M. Niessner
IEEE International Conference on Computer Vision (ICCV)
October 2017, pages 3133-3141
ICCV
A Lightweight Approach for On-The-Fly Reflectance Estimation
K. Kim, J. Gu, S. Tyree, P. Molchanov, M. Niessner, J. Kautz
IEEE International Conference on Computer Vision (ICCV)
October 2017, pages 20-28 (oral)
3DV
Cascaded Scene Flow Prediction using Semantic Segmentation
Z. Ren, D. Sun, J. Kautz, E. Sudderth
International Conference on 3D Vision
October 2017 (oral)
3DV
Multiframe Scene Flow with Piecewise Rigid Motion
V. Golyanik, K. Kim, R. Maier, M. Niessner, D. Stricker, J. Kautz
International Conference on 3D Vision
October 2017 (spotlight)
SIGGRAPH
Computational Zoom: A Framework for Post-Capture Image Composition
A. Badki, O. Gallo, J. Kautz, P. Sen
ACM Transactions on Graphics (Proceedings SIGGRAPH 2017)
36(4), July 2017, pages 46:1-46:14
SIGGRAPH
Mixed-primary Factorization for Dual-frame Computational Displays
F.-C. Huang, D. Pajak, J. Kim, J. Kautz, D. Luebke
ACM Transactions on Graphics (Proceedings SIGGRAPH 2017)
36(4), July 2017, pages 149:1-149:13
PDF
CVPRW
Reconstructing Intensity Images from Binary Spatial Gradient Cameras
S. Jayasuriya, O. Gallo, J. Gu, T. Aila, J. Kautz
IEEE CVPR Embedded Vision Workshop
July 2017
PDF
CVPR
Dynamic Facial Analysis: From Bayesian Filtering to Recurrent Neural Network
J. Gu, S. De Mello, X. Yang, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
July 2017, pages 1531-1540
CVPR
Polarimetric Multi-View Stereo
Z. Cui, J. Gu, B. Shi, P. Tan, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
July 2017, pages 369-378
ICLR
GA3C: GPU-based A3C for Deep Reinforcement Learning
M. Babaeizadeh, I. Frosio, S. Tyree, J. Clemons, J. Kautz
International Conference on Learning Representations
April 2017
ICLR
Pruning Convolutional Neural Networks for Resource Efficient Transfer Learning
P. Molchanov, S. Tyree, T. Karras, T. Aila, J. Kautz
International Conference on Learning Representations
April 2017
PDF
IEEE TCI
Loss Functions for Neural Networks for Image Processing
H. Zhao, O. Gallo, I. Frosio, J. Kautz
IEEE Transactions on Computational Imaging
3(1), March 2017, pages 47-57
2016
SIGGRAPH ASIA
Computational Bounce Flash for Indoor Portraits
L. Murmann, A. Davis, J. Kautz, F. Durand
ACM Transactions on Graphics (Proceedings SIGGRAPH Asia 2016)
35(6), December 2016, pages 190:1-190:9
NIPSW
GA3C: GPU-based A3C for Deep Reinforcement Learning
M. Babaeizadeh, I. Frosio, S. Tyree, J. Clemons, J. Kautz
NIPS Workshop on Efficient Methods for Deep Neural Networks
December 2016
NIPSW
Pruning Convolutional Neural Networks for Resource Efficient Transfer Learning
P. Molchanov, S. Tyree, T. Karras, T. Aila, J. Kautz
NIPS Workshop on Efficient Methods for Deep Neural Networks
December 2016
PDF
ACM MM
Multilayer and Multimodal Fusion of Deep Neural Networks for Video Classification
X. Yang, P. Molchanov, J. Kautz
ACM Multimedia
October 2016, pages 978-987 (oral)
PDF
CVPR
Accelerated Generative Models for 3D Point Cloud Data
B. Eckart, K. Kim, A. Troccoli, A. Kelly, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2016, pages 5497-5505 (spotlight oral)
CVPR
Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks
P. Molchanov, X. Yang, S. Gupta, K. Kim, S. Tyree, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2016, pages 4207-4215
IEEE IVS
Towards Selecting Robust Hand Gestures for Automotive Interfaces
S. Gupta, P. Molchanov, X. Yang, K. Kim, S. Tyree, J. Kautz
IEEE Intelligent Vehicles Symposium 2016
June 2016
PDF
2015
ICCV
Robust Model-based 3D Head Pose Estimation
G. P. Meyer, S. Gupta, I. Frosio, D. Reddy, J. Kautz
IEEE International Conference on Computer Vision (ICCV)
December 2015, pages 3649-3657
CGF
Interactive Sketch-Driven Image Synthesis
D. Turmukhambetov, N. Campbell, D. Goldman, J. Kautz
Computer Graphics Forum
34(8), December 2015, pages 130-142
UIST
Joint 5D Pen Input for Light Field Displays
J. Tompkin, S. Muff, J. McCann, H. Pfister, J. Kautz, M. Alexa, W. Matusik
ACM User Interface Software and Technology (UIST)
November 2015
3DV
MLMD: Maximum Likelihood Mixture Decoupling for Fast and Accurate Point Cloud Registration
B. Eckart, K. Kim, A. Troccoli, A. Kelly, J. Kautz
International Conference on 3D Vision
October 2015, pages 241-249
HPG
An Adaptive Acceleration Structure for Screen-space Ray Tracing
S. Widmer, D. Pajak, A. Schulz, K. Pulli, J. Kautz, M. Goesele, D. Luebke
High-Performance Graphics 2015
August 2015, pages 67-76
EGSR
Filtering Environment Illumination for Interactive Physically-Based Rendering in Mixed Reality
S. Mehta, K. Kim, D. Pajak, K. Pulli, J. Kautz, R. Ramamoorthi
Eurographics Symposium on Rendering 2015
June 2015
CVPR
Modeling Object Appearance using Context-Conditioned Component Analysis
D. Turmukhambetov, N. Campbell, S. Prince, J. Kautz
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
June 2015, pages 4156-4164
PDF
CVPRW
Hand Gesture Recognition with 3D Convolutional Neural Networks
P. Molchanov, S. Gupta, K. Kim, J. Kautz
IEEE CVPR Workshop on Observing and Understanding Hands in Action
June 2015, winner of the VIVA hand gesture challenge
PDF
CVPRW
Locally Non-rigid Registration for Mobile HDR Photography
O. Gallo, A. Troccoli, J. Hu, K. Pulli, J. Kautz
IEEE CVPR Embedded Vision Workshop
June 2015
PDF
APP. OPTICS
Slim Near Eye Display Using Pinhole Aperture Arrays
K. Aksit, J. Kautz, D. Luebke
Applied Optics
54(11), April 2015, pages 3422-3427
CACM
Local Laplacian Filters: Edge-aware Image Processing with a Laplacian Pyramid
S. Paris, S. Hasinoff, J. Kautz
Communications of the ACM – Research Highlight
58(3), March 2015, pages 81-91
ACM MM
Speaker-Following Video Subtitles
Y. Hu, J. Kautz, Y. Yu, and W. Wang
ACM Transactions on Multimedia Computing, Communications, and Applications
11(2), January 2015, pages 32:1-32:17
CV
oct 2018

Vice President of Learning and Perception Research, NVIDIA, USA

Head of the learning and perception research group at NVIDIA.

apr 2017

Senior Director of Visual Computing and Machine Learning Research, NVIDIA, USA

oct 2015

Director of Visual Computing Research, NVIDIA, USA

oct 2014

Senior Research Manager, NVIDIA, USA

Head of the visual computing research group at NVIDIA.

sep 2013

Senior Research Scientist, NVIDIA, USA

Research in comp. photography and computer vision.

oct 2012

Professor of Visual Computing, University College London, UK

oct 2011

Associate Professor (Reader), University College London, UK

oct 2009

Associate Professor (Senior Lecturer), University College London, UK

mar 2006

Assistant Professor (Lecturer), University College London, UK

Research in visual computing, teaching and supervision of students (BSc, MSc, PhD).

jul 2003

Post-Doctoral Researcher, Massachusetts Institute of Technology, USA

Working on appearance editing and realistic, real-time rendering.

sep 1999

PhD Student, Max-Planck-Institut fur Informatik, Germany

Received PhD (summa cum laude).

may 1998

Graduate Student, University of Waterloo, Canada

Received MMath.

oct 1993

Student, University Erlangen-Nurnberg, Germany

Received Diplom-Informatiker (MSc in Computer Science).

Contact
Jan Kautz
NVIDIA | Learning and Perception Research Group
2 Technology Park Drive | Westford, MA 01886