Home
•
Student Resources
•
Info. Theory Society
•
Media Services
Committee
Events
• Future
Events
• Past
Events
Volunteering
Getting
Started
• Info.
Theory Textbook
• Info. Theory
Tutorials
•
Interference Channel
• Comm.
Networks
• Cooperative
Comm.
•
Cryptography
• Multiuser
Info. Theory
• Network Coding
• Biology & Info.
Theory
• Quantum Info.
Theory
Doctoral
Dissertations
Finding Your
Career
• Job
Resources
• Job
Opportunities
• Pool of
Candidates
Useful Links
• Writing Papers
• Journals
•
Conferences
•
Resources
Committee
Members

The research discussion will be held at ISIT
2007. Here is the agenda for the discussions:
Table #1:
Multiantenna and Multiuser Channels
Recent Results on the Capacity Regions and Degrees of Freedom
Leader: Hanan Weingarten (The Technion)
This will be an open talk on recent
advances in multiuser communications with emphasis on new results on
degrees of freedom. Some relevant results:

S. A. Jafar and S. Shamai "Degrees
of Freedom Region for the MIMO X Channel"

A. Lapidoth, S. Shamai and M. A. Wigger "On
the capacity of fading MIMO broadcast channels with imperfect
transmitter side information"
Table #2:
Rate Distortion Theory for Multiterminal
Networks
Leader: Haim Permuter (Stanford)
The theme of our table is reconstructing
sources of information in a network. We will discuss problem that
students will suggest such as:
SlepianWolf problem:
D. Slepian and J. K. Wolf, "Noiseless coding of correlated
information sources," IEEE Trans. Inform. Theory, vol. IT19, pp.
471480, July 1973.
T. M. Cover, "A proof of data compression theorem of Slepian and Wolf
for ergodic sources," IEEE Trans. Inform. Theory, vol. IT21, pp.
226228, Mar. 1975.
WynerZiv problem
A. D. Wyner and J. Ziv, "The ratedistortion function for source
coding with side information at the decoder," IEEE Trans. Inform.
Theory, vol. IT22, pp. 110, Jan. 1976.
Two terminal Source Coding
T. Berger, "Multiterminal source coding," in The Information Theory
Approach to Communications, ser. CISM Courses and Lectures, G. Longo,Ed.
SpringerVerlag, 1978, vol. 229, pp. 171231.
S.Y. Tung, "Multiterminal source coding," Ph.D. dissertation, School of
Electrical Engineering, Cornell University, Ithaca, NY, May 1978.
A. B. Wagner, S. Tavildar, and P. Viswanath, "The Rate Region of the
Quadratic Gaussian TwoTerminal SourceCoding Problem." Submitted to
IEEE Trans. on Inf. Theory. arXiv:cs.IT/0510095
Multiple Description
A. A. El Gamal and T. M. Cover, "Achievable rates for multiple
descriptions," IEEE Trans. Inform. Theory, vol. IT28, pp. 851857, Nov.
1982.
Successive Refinement
W. H. R. Equitz and T. M. Cover, "Successive refinement of
information," IEEE Trans. Inform. Theory, vol. 37, pp. 269275, Mar.
1991.
CEO problem
T. Berger, Z. Zhang, and H. Viswanathan, "The CEO problem," IEEE
Trans. Inf. Theory, vol. 42, no. 3, pp. 887902, May 1996.
Table #3:
Cognitive Radios and Universal IT
Leader: Krish Eswaran (Berkeley)
The focus of this discussion
will be universality in information theory. This area considers
questions of source coding, prediction, and channel coding when the
model for the distribution of the source/channel is unknown in advance.
While much of the work in this area has been on source coding and
prediction, there have also been recent advancements in universal
channel coding. The hope for the discussion is to review work in the
area and brainstorm interesting research directions and applications for
future exploration. Here are some accessible references that should be a
good starting point for discussion.

Willems, Shtarkov, Tjalkens. "The
contexttree weighting method: basic properties," IEEE Transactions
on Information Theory, May 1995.

Willems, Shtarkov, Tjalkens. "Reflections
on 'The contexttree weighting method: basic properties'," IEEE
Information Theory Society Newsletter, Mar. 1997.

Merhav, Feder. "Universal
prediction," IEEE Transactions on Information Theory, Oct 1998.

Shayevitz and Feder. "Communicating
using feedback over a binary channel with arbitrary noise sequence,"
Proceedings of the International Symposium on Information Theory,
Melbourne, Australia, Sept. 2005.

Shayevitz and Feder. "Achieving
the Empirical Capacity Using Feedback  Part I: Memoryless Additive
Models," submitted to IEEE Transactions on Information Theory.
Other references:

Lempel and Ziv. "A
universal algorithm for sequential data compression," IEEE
Transactions on Information Theory, May 1977.

Effros, Visweswariah, Kulkarni, Verdu. "Universal
lossless source coding with the Burrows Wheeler transform," IEEE
Trans. on Info. Theory, May 2002.

Tchamkerten, Telatar. "Variable
length coding over an unknown channel," IEEE Transactions on
Information Theory, May 2006.
Table #4:
Neuroscience and IT
Leader: Bobak Nazer (Berkeley)
The brain is an information processing system
whose components, neurons, are subject to noise processes and energy
constraints. At a first glance, this bears a striking similarity to the
types of problems considered in communications and information theory.
As a result, many researchers have been tempted to directly apply the
results of information theory to neurons. For instance, many works have
focused on computing the mutual information across a neuron and arguing
that this implies something about the representational power of the
neural code. However, neurons are not standard communications blocks and
they most certainly do not implement a block code so these naive
arguments fall far short. Yet, an informationtheoretic approach may
still be fruitful. Intuitively, one can potentially assume the brain is
optimal in terms of some yet unknown energydelaycomputation tradeoff.
Given this assumption, one can use ideas such as capacityperunitcost
and measure matching to connect data collected from neural experiments
to certain aspects of the ``neural code.'' At this roundtable, we will
consider these issues and discuss what place information theory can
and/or should have in theoretical neuroscience.
Couple of papers:

L. R. Varshney, P. J. Sjostrom, D. B. Chklovskii,
Optimal Information Storage in Noisy Synapses Under Resource Constraints,
Neuron, 52, 409423, Nov 9 2006

V. Balasubramanian, D. Kimber, M. J. Berry,
Metabolically Efficient Information Processing, Neural Computation,
13, 799815, 2001

S. B. Laughlin, R. R. de Ruyter van Steveninck, J. C. Anderson,
The Metabolic Cost of Neural Information, Nature Neuroscience, v.1
no. 1, may 1998, 3641
Table #5:
Multiaccess Channels with Feedback
Leader: Michele Wigger (ETHZ)
Following are two papers that will be discussed:

"The capacity of white
Gaussian multipleaccess channel with feedback. " IEEE Trans. Inform.
Theory 30(4):623629, July 1985.

"An achievable rate region for the multipleaccess channel with
feedback." IEEE Trans. Inform. Theory, 27(3):292298, May 1981.
Table #6:
IT Security
Leader: Prasanth Ananthapadmanabhan (UMD/UMCP)
The
theme will be wireless informationtheoretic security. Following are a
couple of recent papers (preprints) on this topic.

M. Bloch, J. Barros, M. R. D. Rodrigues and S. W. McLaughlin, "Wireless
InformationTheoretic Security  Part I: Theoretical Aspects,"
Submitted to the IEEE Transactions on Information Theory, Special Issue
on InformationTheoretic Security, November 2006.

Y. Liang, H. V. Poor and S. Shamai (Shitz), "Secure
communication over fading channels," Submitted to IEEE Transactions
on Information Theory, Special Issue on information theoretic security,
November 2006.
Table #7:
Transmission of Correlated Data in Wireless
Networks
Leader: Stephan Tinguely (ETHZ)
In
view of these two papers, would it be possible to change the title of
the topic to "Transmission of Correlated Data in Networks", rather than
"Transmission of Correlated Data in Wireless Networks"?

T.
M. Cover, A. El Gamal, M. Salehi, "Multiple Access Channels with
Arbitrarily Correlated Sources", IEEE Transactions on Information
Theory, Vol. IT26(6), November 1980.

T. S. Han, M. H. M. Costa, "Broadcast Channels with Arbitrarily
Correlated Sources", IEEE Transactions on Information Theory, Vol.
IT33(5), September 1987.
Table #8:
Joint SourceChannel Coding
Leader: Deniz Gunduz (Brooklyn Poly)
will be posted soon.
Table #9:
Information Theoretical Aspects of
Decentralized Detection
Leader: Amichi Sanderovich (The Technion)
The talk can include one of
the following issues:
* Wyner model and joint cellsite processing with fading channels.
* Suboptimal approaches to improve decentralized detection, such as
binary signaling, etc.
* Efficiently combining local and centralized decoding with separated
message sets.
Sample papers are:

Aaron Wyner "Shannon Theoretic Approach to a Gaussian Celluler Multiple
Access Channel," IEEE Transactions on Information Theory, November 1994,
pp. 17131727.

R. Dabora and S. Servetto "Broadcast Channels With Cooperating
Decoders," IEEE Transactions on Information Theory, December, pp.
54385454.
