Copyright © 2008 The Institute of Electronics, Information and Communication Engineers
Special Section on Image Media Quality - Papers |
A Masking Model for Motion Sharpening Phenomenon in Video Sequences
1 The authors are with Research Laboratories, NTT DoCoMo, Co. Ltd., Yokosuka-shi, 239-8536 Japan. E-mail: fujibayashi{at}nttdocomo.co.jp
In this paper, we show that motion sharpening phenomenon can be explained as a form of visual masking for a special case where a video sequence is composed of alternate frames with different level of sharpness. A frame of higher sharpness behaves to mask the ambiguity of a subsequent frame of lower sharpness and hence preserves the perceptive quality of the whole sequence. Borrowing the mechanism for visual masking, we formulated a quantitative model for deriving the minimum spatial frequency conditions which preserves the subjective quality of the frames being masked. The quantitative model takes into account three fundamental properties of the video signals, namely the size of motion, average luminance and the power of each frequency components. The psychophysical responses towards the changes of these properties are obtained through subjective assessment tests using video sequences of simple geometrical patterns. Subjective experiments on natural video sequences show that more than 75% of viewers could make no distinction between the original sequence and the one processed using the quantitative model.
Key Words: motion sharpening, subjective assessment, visual masking, human vision, quantitative model
Manuscript received June 5, 2007. Manuscript revised November 27, 2007.
References
[1] T. Takeuchi, "Ugoki niyoru eizo no senmeika," http://www.ntt.co.jp/journal/0510/files/jn200510050.pdf [2] M.A. Georgeson and S.T. Hammett, "Seeing blur: ‘Motion sharpening’ without motion," Proc. Royal Society of London, Series B, vol.269, pp.1429–1434, 2002. [3] S.T. Hammett, M.A. Georgeson, and A. Gorea, "Motion blur and motion sharpening: Temporal smear and local contrast non-linearity," Vision Research, vol.38, pp.2099–2108, 1998. [4] M.A. Georgeson, S.T. Hammett, S. Bedingham, and G.S. Barbieri-Hesse, "Motion sharpening and contrast: Gain control precedes compressive non-linearity?," Vision Research, vol.43, pp.1187–1199, 2003. [5] T. Takeuchi and K.K. De Valois, "Sharpening image motion based on the spatio-temporal characteristics of human vision," Proc. SPIE-IS&T Electronic Imaging: Human Vision and Electronic Imaging X, vol.5666, pp.83–94, 2005. [6] Nihon Shikaku gakkai, ed., Shikaku jyouhou shori guidebook, Asakura shoten, Japan, 2000. [7] T. Ooyama, S. Imai, and T. Wake, ed., Shinpen Kankaku Chikaku Shinrigaku handbook, Seishin shoten, Japan, 1994. [8] B.H. Crawford, "Visual adaptation in relation to brief conditioning stimuli," in Shinpen Kankaku Chikaku Shinrigaku handbook, ed. T. Ooyama, S. Imai, and T. Wake, pp.661–663, Seishin shoten, Japan, 1994. [9] F.W. Cambell and J.G. Robson, "Application of Fourier analysis to the visibility of gratings," in Shinpen Kankaku Chikaku Shinrigaku handbook, ed. T. Ooyama, S. Imai, and T. Wake, pp.561–562, Seishin shoten, Japan, 1994. [10] B.G. Breitmeyer and L. Ganz, "Implication of sustained and transient channels for theories of visual pattern masking, saccadic suppression, and information processing," in Shinpen Kankaku Chikaku Shinrigaku handbook, ed. T. Ooyama, S. Imai, and T. Wake, pp.666–667, Seishin shoten, Japan, 1994. [11] H.R. Wilson and J.R. Bergen, "A four mechanism model for threshold spatial vision," in Shinpen Kankaku Chikaku Shinrigaku handbook, ed. T. Ooyama, S. Imai, and T. Wake, pp.576–579, Seishin shoten, Japan, 1994. [12] R.E. Fredericksen and R.F. Hess, "Temporal detection in human vision: Dependence on stimulus energy," Journal of the Optical Society of America, vol.14, pp.2557–2569, 1997. [13] A. Fujibayashi, S. Kato, C.S. Boon, S. Hangai, and T. Hamamoto, "A measurement of viewing distance for video on mobile terminals," Proc. Second International Workshop on Image Media Quality and Applications, P.11, Nagoya, Japan, Sept. 2005. [14] A. Fujibayashi, S. Kato, and C.S. Boon, "Modeling of perceptual sensitivity towards motion sharpening phenomenon of video sequences," Proc. Second International Workshop on Image Media Quality and Applications, F.2, Chiba, Japan, March 2006. [15] T. Takeuchi and K.K. De Valois, "Modulation of perceived contrast by a moving surround," Vision Research, vol.40, pp.2697–2709, 2000.
CiteULike 
Connotea 
Del.icio.us What's this?
This Article 
Abstract
Full Text (PDF)
Alert me when this article is cited
Alert me if a correction is posted
Services
Email this article to a friend
Similar articles in this journal
Alert me to new issues of the journal
Add to My Personal Archive
Download to citation manager
Request Permissions
Google Scholar
Articles by FUJIBAYASHI, A.
Articles by BOON, C. S.
Social Bookmarking
What's this?