Showing 1–20 of 21 results
/ Date/ Name
Aug 10, 2025What One Cannot, Two Can: Two-Layer Transformers Provably Represent Induction Heads on Any-Order Markov ChainsJan 30, 2025Leveraging Sparsity for Sample-Efficient Preference Learning: A Theoretical PerspectiveOct 14, 2024Characterising high-order interdependence via entropic conjugationSep 23, 2024Shannon Bounds for Quadratic Rate-Distortion ProblemsAug 7, 2024Could ChatGPT get an Engineering Degree? Evaluating Higher Education Vulnerability to AI AssistantsJul 22, 2024Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language ModelsFeb 14, 2024Software in the natural world: A computational approach to hierarchical emergenceFeb 25, 2022Alpha-NML Universal PredictorsFeb 8, 2022On Sibson's $α$-Mutual InformationFeb 5, 2022Lower-bounds on the Bayesian Risk in Estimation Procedures via $f$-DivergencesNov 3, 2021A Johnson--Lindenstrauss Framework for Randomly Initialized CNNsJun 8, 2021Differential Entropy of the Conditional Expectation under Additive Gaussian NoiseFeb 3, 2020Common Information Components AnalysisMay 16, 2018Remote Source Coding under Gaussian Noise : Dueling Roles of Power and Entropy PowerJan 31, 2018A Novel Centralized Strategy for Coded Caching with Non-uniform DemandsOct 7, 2017Increasing Availability in Distributed Storage Systems via ClusteringJul 26, 2017Communication versus Computation: Duality for multiple access channels and source codingJan 22, 2016Multi-Library Coded CachingMar 11, 2012Minimum Cost Multicast with Decentralized SourcesFeb 24, 2010Approximate Sparsity Pattern Recovery: Information-Theoretic Lower Bounds