Program

Wednesday, January 25, 2023

All talks and coffee breaks take place in Room 1.A.08, Puerta de Toledo Campus, Universidad Carlos III de Madrid.

10:00Pick up at Hotel Catalonia Atocha. Walk to the Puerta de Toledo Campus of the Universidad Carlos III de Madrid.
10:30 – 11:00Coffee break.
11:00 – 12:00Talk by Giuseppe Durisi (Chalmers University of Technology).

Title: Seeking information-theoretic bounds that explain generalization

Slides
12:00 – 13:00Talk by Robert Graczyk (Télécom Paris).

Title: Variations on common information

Slides
13:00 – 14:00Talk by Ramji Venkataramanan (University of Cambridge).

Title: Bayes-optimal estimation in generalized linear models

Abstract: We consider the problem of signal estimation in a generalized linear model (GLM). GLMs cover many canonical problems in statistical estimation such as linear regression and phase retrieval. Recent work has precisely characterized the asymptotic minimum mean-squared error (MMSE) for GLMs with i.i.d. Gaussian sensing matrices. However, in many models there is a significant gap between the MMSE and the performance of the best known feasible estimators. To address this, we consider GLMs defined via spatially coupled sensing matrices. We propose an efficient approximate message passing (AMP) algorithm for estimation and prove that the error of a carefully tuned AMP estimator approaches the asymptotic MMSE.

This is joint work with Pablo Pascual Cobo and Kuan Hsieh.

Slides
14:15 – 15:45Lunch at Bipolar Casa de Comidas 2.0.
15:45 – 16:15Coffee break.
16:15 – 17:15Talk by Tobias Koch (Universidad Carlos III de Madrid).

Title: Information theory for low-latency wireless communications

Abstract: The next generations of wireless communication systems may need to meet stringent constraints on data rate, latency, and reliability. The design of low-latency wireless systems is a great challenge, since it requires a fundamentally different design approach than the one used in current systems. Indeed, current systems exchange packets of several thousand bits. For such packet lengths, there are error-correcting codes that can correct transmission errors with high probability at rates close to the capacity. Consequently, the design of such systems is supported by the extensive information-theoretical knowledge we have about wireless communications. In contrast, low-latency systems exchange packets of only several hundred bits, so the rate of the error-correcting code must be significantly below the capacity to achieve the desired reliability. Consequently, for such systems, capacity is not a relevant performance measure, and design guidelines that are based on its behavior will be misleading. In this talk, I will present the results obtained in the ERC Starting Grant “Information theory for low-latency wireless communications (LOLITA)”, whose goal was to establish a information-theoretical framework that describes the fundamental tradeoffs in low-latency wireless communications.

Slides
20:30 –Dinner at Yokaloka.

Thursday, January 26, 2023

All talks and coffee breaks take place in Room 1.A.08, Puerta de Toledo Campus, Universidad Carlos III de Madrid.

10:00Pick up at Hotel Catalonia Atocha. Walk to the Puerta de Toledo Campus of the Universidad Carlos III de Madrid.
10:30 – 11:00Coffee break.
11:00 – 12:00Talk by Alex Alvarado (Eindhoven University of Technology).

Title: First-order asymptotics of mutual information for arbitrary constellations and input distributions
12:00 – 13:00Talk by Hamdi Joudeh (Eindhoven University of Technology)

Title: Soft guessing under logarithmic loss

Slides
13:00 – 14:00Talk by Bernhard Geiger (Know-Center GmbH).

Title: Does IT matter? On architecture and modelling choices in neural IB-type models

Slides
14:30 – 16:00Lunch at Ástor “Puerta Cerrada”.
16:00 – 16:30Coffee break.
16:30 – 17:30Talk by Stefan Moser (ETH Zurich).

Title: Energy-optimal signaling using the example of optical communication

Abstract: In this talk I am trying to show that thinking about energy efficiency is crucial when analyzing capacity or optimal signaling of some communication setup that seemingly has too many “degrees of freedom”. I will demonstrate this in the setup of optical multiple-antenna communication through air (MIMO freespace channel). Even though we focused on a theoretical capacity analysis for this channel model at the time, the insights we gained actually help also in very practical questions regarding how to signal on such channels.

Slides
20:00 –Dinner at Raimunda.

Friday, January 27, 2023

All talks and coffee breaks take place in Room 1.A.08, Puerta de Toledo Campus, Universidad Carlos III de Madrid.

10:00Pick up at Hotel Catalonia Atocha. Walk to the Puerta de Toledo Campus of the Universidad Carlos III de Madrid.
10:30 – 11:00Coffee break.
11:00 – 12:00Talk by Albert Guillén i Fàbregas (University of Cambridge).

Title: Typical error exponents
12:00 – 13:00Talk by Ligong Wang (ETIS Laboratory & CNRS).

Title: State-dependent DMC with a causal helper

Abstract: We study the problem of communication over a state-dependent discrete memoryless channel (DMC), where a helper observes the states, and provides partial channel-state information (CSI) to the transmitter via a rate-limited link. Both the helper and the transmitter are assumed to be causal: at time i, the helper observes state realizations up to time i, and the transmitter has access to information that has been sent by the helper up to time i. We show that it is in general suboptimal for the helper to use a scalar quantizer. However, scalar quantizers become optimal when the receiver has perfect CSI. Furthermore, if the helper knows the message that the transmitter wants to send, then it is again optimal to use a (message-dependent) scalar quantizer.

This is a joint work with Amos Lapidoth.

Slides
13:30 – 16:00Lunch at Mandarosso.
20:45 –Dinner at Bodega de los Secretos.