Calibration-Free Rolling Shutter Removal

Two examples rectified using our calibration free rolling shutter technique. Original frames on the left, our rectified result on the right. Our model accounts for frame global distortions such as skew (left example) as well as local wobble distortions which compress and stretch different parts of the frame (right example). Please see accompanying video.

Publication

Matthias Grundmann, Vivek Kwatra, Daniel Castro, Irfan Essa
"Calibration-Free Rolling Shutter Removal"
in Proceedings of IEEE Conference on Computational Photography

Abstract

We present a novel algorithm for efficient removal of rolling shutter distortions in uncalibrated streaming videos. Our proposed method is calibration free as it does not need any knowledge of the camera used, nor does it require calibration using specially recorded calibration sequences. Our algorithm can perform rolling shutter removal under varying focal lengths, as in videos from CMOS cameras equipped with an optical zoom. We evaluate our approach across a broad range of cameras and video sequences demonstrating robustness, scaleability, and repeatability. We also conducted a user study, which demonstrates preference for the output of our algorithm over other state-of-the art methods. Our algorithm is computationally efficient, easy to parallelize, and robust to challenging artifacts introduced by various cameras with differing technologies.

Paper

Download PDF

Supplementary Files

Click here to download them.

Video
Citation
@article{GrundmannKwatra2012,
   author = {Matthias Grundmann and Vivek Kwatra and Daniel Castro and Irfan Essa},
   title = {Effective Calibration Free Rolling Shutter Removal},
   journal = {IEEE ICCP},
   year = {2012},
 }  
Dataset
Request the original videos used in our video and paper per e-mail.
Funding
This research is supported by:
  • Google Grant
Copyright

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without explicit permission of the copyright holder.