ECE Colloquium

September 11, 2017

ECE Colloquium

Dr. Shlomo Shamai

Distinguished Professor

The Andrew and Erna Viterbi Department of Electrical Engineering

Technion-Israel Institute of Technology


TITLE:    A View of Information-Estimation Relations in Gaussian Networks

ABTRACT: This talk will focus on the recent applications of Information-Estimation Relations to Gaussian Networks. In the first part of the talk, we will go over recent connections between estimation theoretic and information theoretic measures. The estimation theoretic measures that would be of importance to us are the Minimum Means p-th Error (MMPE) and its special case the Minimum Mean Square Error (MMSE). As will be demonstrated, the MMSE can be very useful in bounding mutual information via the I-MMSE relationship of Guo-Shamai-Verdu, and the MMPE can be used to bound the conditional entropy via the moment entropy inequality. In the second part of the talk, we will discuss several applications of Information-Estimation Relations in Gaussian noise networks. As the first application, we show how the I-MMSE relationship can be used to determine the behavior, for every signal-to-noise ratio (SNR), of the mutual information and the MMSE of the transmitted codeword for the setting of the Gaussian Broadcast Channel and the Gaussian Wiretap Channel. As a second application, the notion of the MMPE is used to generalize the Ozarow-Wyner lower bound on the mutual information for discrete inputs on Gaussian noise channels. A short outlook of future applications concludes the presentation. This work is in collaboration with R. Bustin, A. Dytso, H. Vincent Poor, Daniela Tuninetti, Natasha Devroye, and it is supported by the European Union's Horizon 2020 Research And Innovation Programme, grant agreement no. 694630.


BIO: Dr. Shlomo Shamai (Shitz) received the B.Sc., M.Sc., and Ph.D. degrees in electrical engineering from the Technion—Israel Institute of Technology, in 1975, 1981 and 1986 respectively. During 1975-1985 he was with the Communications Research Labs in the capacity of a Senior Research Engineer. Since 1986 he is with the Department of Electrical Engineering, Technion-Israel Institute of Technology, where he is now a Technion Distinguished Professor, and holds the William Fondiller Chair of Telecommunications. Dr. Shamai (Shitz) is an IEEE Fellow, a Member of the Israeli Academy of Sciences and Humanities and a Foreign Member of the US National Academy of Engineering. He is the recepient of the 2011 Claude E. Shannon Award, the 2014 Rothschild Prize in Mathematics/Computer Sciences and Engineering and the 2017 IEEE Richard W. Hamming Medal. His research work encompasses a wide spectrum of topics in information theory and statistical communications to which he has contributed fundamentally. Some highlights of his scientific work comprise: Conclusive results on the capacity of the multi-input-multi-output broadcast Channels; Establishing basic connections between information theory and statistical estimation theory; Introducing pioneering concepts of interference alignment for communications networks and currently providing a unified information theoretic framework of cloud and fog radio access networks. He has been awarded the 1999 van der Pol Gold Medal of the Union Radio Scientifique Internationale (URSI), and is a co-recipient of the 2000 IEEE Donald G. Fink Prize Paper Award, the 2003, and the 2004 joint IT/COM societies paper award, the 2007 IEEE Information Theory Society Paper Award, the 2009 and 2015 European Commission FP7, Network of Excellence in Wireless COMmunications Best Paper Awards, the 2010 Thomson Reuters Award for International Excellence in Scientific Research, the 2014 Europian Association for Signal Processing (EURASIP) Best Paper Award, and the 2015 IEEE Communications Society Best Tutorial Paper Award. He is a Highly Cited researcher and is listed in the 2015 Thomson Reuters “The World’s Most Influential Scientific Minds”. He is also the recipient of 1985 Alon Grant for distinguished young scientists and the 2000 Technion Henry Taub Prize for Excellence in Research. He has served as Associate Editor for the Shannon Theory of the IEEE Transactions on Information Theory, and twice on the Board of Governors of the Information Theory Society. He has also served on the Executive Editorial Board of the IEEE Transactions on Information Theory and on the IEEE Information Theory Society Nominations and Appointments Committee.