Camera Shake Removal using Weighted Fourier Burst Accumulation and NLmeans Denoising

Sreelakshmi P M, Federal Institute Of Science And Technology; Paul P Mathai ,Federal Institute of Science And Technology

Deblurring,SURF algorithm, Burst registration,NLMeans Denoising

Taking photos under dim lighting conditions using a hand-held camera is very challenging. If the camera is set to a large exposure time, the image is blurred due to camera shake. On the other hand, if it is taken with a short exposure time, the image is dark and noisy. Various approaches try to remove image blur due to camera shake, either with one or multiple input images. Blur introduced in an image from camera shake is mostly due to the 3D rotation of the camera. This results in a blur kernel which is non-uniform throughout the image. In this method a new algorithm is proposed which do not estimate the blur kernel instead use an align and average like technique. Burst images are considered because each image in the burst is blurred differently. The proposed algorithm performs a weighted average, for the burst images, in the Fourier domain, with weights depending on the Fourier spectrum magnitude. Rationale is that camera shake has a random nature, and therefore, each image in the burst is generally blurred differently. First, the burst of images are registered. Then, for that image correspondences are considered to estimate the dominant homograph relating every image of the burst and a reference image (the first one in the burst).Image correspondences are found using SURF algorithm. Then, Fourier Burst Accumulation is done channel by channel using the same Fourier weights for all channels. Then a noise removal is done using NLMEANS denoising algorithm and finally, a Gaussian sharpening is done on the filtered image. To avoid removing fine details, a percentage of what has been removed during the denoising step is added back finally. Experiments with real camera data show that the proposed burst accumulation algorithm achieves faster and better results.
    [1] O.Whyte, J. Sivic, A. Zisserman, and J. Ponce, Non-uniform deblurring for shaken images,” Int. J. Comput. Vis., vol. 98, no. 2, pp. 168–186, 2012. [2] T. Buades, Y. Lou, J.-M. Morel, and Z. Tang, A note on multi-image denoising,” in Proc. Int. Workshop Local Non-Local Approx. Image Process. (LNLA), Aug. 2009, pp. 1–15. [3] H. Zhang, D. Wipf, and Y. Zhang,Multi-image blind deblurring using a coupled adaptive sparse prior, in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 1051–1058. [4] Boracchi and A. Foi, Modeling the performance of image restoration from motion blur, IEEE Trans. Image Process., vol. 21, no. 8,pp. 3502–3517, Aug. 2012. [5] B. Zitová and J. Flusser, Image registration methods: A survey, Image Vis. Comput. vol. 21, no. 11, pp. 977–1000, 2003. [6] M. Lebrun, A. Buades, and J.-M. Morel, Implementation of the‘non-local Bayes’ (NL-Bayes) image denoising algorithm Image Process. Line, vol. 3, pp. 1–42, Jul. 2013. [7] A. Rav-Acha and S. Peleg, Two motion-blurred images are better than one,Pattern Recognit. Lett., vol. 26, no. 3, pp. 311–317, 2005. [8] R. Fergus, B. Singh, A. Hertzmann, S. T. Roweis, and W. T. Freeman,Removing camera shake from a single photograph, ACM Trans. Graph., vol. 25, no. 3, pp. 787–794, 2006. [9] L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, Image deblurring with blurred/noisy image pairs, ACM Trans. Graph., vol. 26, no. 3, 2007, Art. ID 1. [10] Q. Shan, J. Jia, and A. Agarwala, High-quality motion deblurring froma single image, ACM Trans. Graph., vol. 27, no. 3, 2008, Art. ID 73. [11] S. Cho and S. Lee, Fast motion deblurring ACM Trans. Graph.,vol. 28, no. 5, 2009, Art. ID 145. [12] X. Zhu, F. Šroubek, and P. Milanfar, Deconvolving PSFs for a better motion deblurring using multiple images, in Proc. IEEE 12th Eur. Conf. Comput. Vis. (ECCV), Oct. 2012, pp. 636–647. [13] F. Sroubek and P. Milanfar Robust multichannel blind deconvolution via fast alternating minimization, IEEE Trans. Image Process., vol. 21, no. 4, pp. 1687–1700, Apr. 2012. [14] H. Zhang, D. Wipf, and Y. Zhang, Multi-image blind deblurring using a coupled adaptive sparse prior}, in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 1051–1058. [15] L. Xu, S. Zheng, and J. Jia,Unnatural L0 sparse representation for natural image deblurring, in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 1107–1114. [16] A. Ito, A. C. Sankaranarayanan, A. Veeraraghavan, and R. G. Baraniuk, Blurburst: Removing blur due to camera shake using multiple images,ACM Trans. Graph., to be published. [17] Mauricio Delbracio and Guillermo Sapiro, Removing Camera Shake via Weighted Fourier Burst Accumulation, IEEE Tans.on Image Processing, VOL. 24, NO. 11, November 2015 3293. [18] A. Ito, A. C. Sankaranarayanan, A. Veeraraghavan, and R. G. Baraniuk, \Blurburst: Removing blur due to camera shake using multiple images",ACM Trans. Graph., to be published. [19] Mauricio Delbracio and Guillermo Sapiro, \Removing Camera Shake via Weighted Fourier Burst Accumulation", IEEE Tans.on Image Processing, VOL. 24, NO. 11, November 2015 3293 [20] Jacob Toft Pedersen \Study group SURF: Feature detection and description", Image Process. Line, vol. 24, No.12, Dec. 2015.Department.
Paper ID: GRDJEV01I100040
Published in: Volume : 1, Issue : 10
Publication Date: 2016-10-01
Page(s): 41 - 53