Copyright © 2006 The Institute of Electronics, Information and Communication Engineers
Special Section on Information Theory and Its Applications -- Papers -- Signal Processing |
Filtering for Simple Threshold Systems: Self-Tuning, Mutual Information and Applications
1 The author was with Department of Applied Mathematics and Physics, Graduate School of Informatics, Kyoto University, Kyoto-shi, 606-8501 Japan. E-mail: hada{at}amp.i.kyoto-u.ac.jp, 2 The author is with the Department of Applied Mathematics and Physics, Graduate School of Informatics, Kyoto University, Kyoto-shi, 606-8501 Japan.
In this paper we discuss an adaptive process, which is based on the so-called self-tuning mechanism. We simplify this mechanism and apply it to a threshold system. From view points of information quantity and estimation accuracy we show this mechanism enhances information transmission through the threshold system. In addition we extend our theory so that it could be applied to a truncation coding.
Key Words: adaptive process, data processing, filtering, mutual information, self-tuning, truncation coding
Manuscript received January 23, 2006. Manuscript revised March 29, 2006. Final manuscript received May 23, 2006.