Pinboard (mraginsky) https://pinboard.in/u:mraginsky/public/ recent bookmarks from mraginsky Information rate of meaningful communication | PNAS 2026-06-08T17:17:22+00:00 https://www.pnas.org/doi/full/10.1073/pnas.2502353122 mraginsky papers to-read information-theory language large-language-models communication semantic-communication https://pinboard.in/ https://pinboard.in/u:mraginsky/b:c67a307c255b/ [2301.10414] Towards a Unification of Logic and Information Theory 2025-09-17T21:27:23+00:00 https://arxiv.org/abs/2301.10414 mraginsky papers to-read information-theory logic formal-methods https://pinboard.in/ https://pinboard.in/u:mraginsky/b:463dce340e59/ Information-Theoretic Diffusion | OpenReview 2024-08-26T16:03:09+00:00 https://openreview.net/forum?id=UvmDCdSPDOW mraginsky papers to-read diffusions generative-models information-theory estimation https://pinboard.in/ https://pinboard.in/u:mraginsky/b:2d447fa522bf/ [2402.07717] Efficient reductions between some statistical models 2024-02-13T21:20:57+00:00 https://arxiv.org/abs/2402.07717 mraginsky papers to-read statistics Le_Cam-theory information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:8790375ae265/ Temperature as Joules per Bit 2024-01-23T03:58:20+00:00 https://arxiv.org/abs/2401.12119v1 mraginsky papers to-read thermodynamics information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:72bf621c25c1/ Phys. Rev. E 102, 052117 (2020) - Thermodynamics from relative entropy 2023-06-12T17:17:38+00:00 https://journals.aps.org/pre/abstract/10.1103/PhysRevE.102.052117 mraginsky papers to-read thermodynamics information-theory physics-of-information https://pinboard.in/ https://pinboard.in/u:mraginsky/b:73e1f3e391a6/ [2303.07279] Universal coding, intrinsic volumes, and metric complexity 2023-05-05T02:48:23+00:00 https://arxiv.org/abs/2303.07279 mraginsky papers to-read empirical-processes probability information-theory source-coding https://pinboard.in/ https://pinboard.in/u:mraginsky/b:9d5d5e5b6290/ Frontiers | An Enactive-Ecological Approach to Information and Uncertainty 2022-08-03T18:20:56+00:00 https://www.frontiersin.org/articles/10.3389/fpsyg.2020.00588/full mraginsky papers to-read information-theory cognition enactivism perception https://pinboard.in/ https://pinboard.in/u:mraginsky/b:97f48f251ba0/ Information processing, computation, and cognition | SpringerLink 2022-08-03T17:15:40+00:00 https://link.springer.com/article/10.1007/s10867-010-9195-3 mraginsky papers to-read information-theory cognition computation biology neuroscience https://pinboard.in/ https://pinboard.in/u:mraginsky/b:580f27a1f05d/ The algorithmic origins of life | Journal of The Royal Society Interface 2022-08-02T16:00:01+00:00 https://royalsocietypublishing.org/doi/10.1098/rsif.2012.0869 mraginsky papers to-read biogenesis information-theory algorithms causality control-theory dynamical-systems cybernetics https://pinboard.in/ https://pinboard.in/u:mraginsky/b:053e8aa6fdff/ [2108.08198] Dimension-free Bounds for Sums of Independent Matrices and Simple Tensors via the Variational Principle 2022-03-28T01:45:12+00:00 https://arxiv.org/abs/2108.08198 mraginsky papers to-read probability random-matrices empirical-processes information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:654b5de716ce/ Lower Bounds on the Generalization Error of Nonlinear Learning Models 2022-01-27T18:33:42+00:00 https://arxiv.org/abs/2103.14723 mraginsky papers to-read learning-theory random-matrices information-theory statistics https://pinboard.in/ https://pinboard.in/u:mraginsky/b:89ae800369a8/ [2008.10249] Information Constrained Optimal Transport: From Talagrand, to Marton, to Cover 2021-05-03T22:25:44+00:00 https://arxiv.org/abs/2008.10249 mraginsky papers to-read information-theory optimal-transportation measure-concentration probability https://pinboard.in/ https://pinboard.in/u:mraginsky/b:a97b0018567d/ [2104.09557] Learning to Communicate with Strangers via Channel Randomisation Methods 2021-05-03T21:51:38+00:00 https://arxiv.org/abs/2104.09557 mraginskypapers to-read information-theory learning https://pinboard.in/ https://pinboard.in/u:mraginsky/b:f6de54b0e126/ TfE: Information and Energy – DEONTOLOGISTICS 2021-05-03T21:48:52+00:00 https://deontologistics.co/2019/11/01/tfe-information-and-energy/ mraginskyinformation-theory computation cybernetics https://pinboard.in/ https://pinboard.in/u:mraginsky/b:280635a607f3/ [2101.06640] Estimating informativeness of samples with Smooth Unique Information 2021-01-21T19:07:27+00:00 https://arxiv.org/abs/2101.06640 mraginsky papers to-read neural-networks information-theory deep-learning https://pinboard.in/ https://pinboard.in/u:mraginsky/b:e1b35f894124/ [2002.10567] A universal energy accuracy tradeoff in nonequilibrium cellular sensing 2020-07-20T20:21:31+00:00 https://arxiv.org/abs/2002.10567 mraginsky papers to-read biophysics information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:309631e71a0d/ [1808.07593] Pathologies in information bottleneck for deterministic supervised learning 2018-08-24T00:52:02+00:00 https://arxiv.org/abs/1808.07593 mraginskypapers to-read machine-learning information-theory information-bottleneck https://pinboard.in/ https://pinboard.in/u:mraginsky/b:d1dc9b0a893f/ [1805.04625] Strong Converse using Change of Measure Arguments 2018-07-08T14:24:17+00:00 https://arxiv.org/abs/1805.04625 mraginsky papers to-read heard-the-talk information-theory lower-bounds https://pinboard.in/ https://pinboard.in/u:mraginsky/b:cf489de5601a/ [1701.02827] Strong Functional Representation Lemma and Applications to Coding Theorems 2018-06-19T14:26:59+00:00 https://arxiv.org/abs/1701.02827 mraginsky papers to-read information-theory simulation https://pinboard.in/ https://pinboard.in/u:mraginsky/b:24fb2101f0c4/ [1705.00302] Measure concentration and the weak Pinsker property 2017-11-19T04:47:17+00:00 https://arxiv.org/abs/1705.00302 mraginskypapers to-read information-theory ergodic-theory measure-concentration https://pinboard.in/ https://pinboard.in/u:mraginsky/b:2ac303d47cf8/ [1707.05199] Online codes for analog signals 2017-07-19T16:44:40+00:00 https://arxiv.org/abs/1707.05199 mraginsky0$) times the adversary's noise as measured in a time-weighted $\ell_1$ norm. The time-weighted decoding norm forces increasingly accurate reconstruction of the distant past, while the time-weighted noise norm permits only vanishing effect from noise in the distant past. Encoding is linear, and decoding is performed by an LP analogous to those used in compressed sensing.]]> papers to-read random-matrices communication information-theory analog-information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:64ebb3205535/ How biased is your model? Concentration Inequalities, Information and Model Bias 2017-07-04T02:18:14+00:00 https://arxiv.org/abs/1706.10260 mraginsky papers to-read statistics information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:c2da7b1f98ef/ Information, Control, and Learning – The Ingredients of Intelligent Behavior - YouTube 2017-04-04T02:08:08+00:00 https://www.youtube.com/playlist?list=PLYq7WW565SZhPcf5PxsuBUz2PtB7Kfb5X mraginskyinformation-theory machine-learning ai conferences control-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:435fae84aea1/ [1611.00814] Information-theoretic thresholds from the cavity method 2016-11-04T03:20:20+00:00 https://arxiv.org/abs/1611.00814 mraginsky papers to-read statistical-physics information-theory optimization graphical-models https://pinboard.in/ https://pinboard.in/u:mraginsky/b:7682d0661b22/ [1511.01437] The sample size required in importance sampling 2016-10-23T19:33:18+00:00 https://arxiv.org/abs/1511.01437 mraginsky papers to-read statistics simulation information-theory probability https://pinboard.in/ https://pinboard.in/u:mraginsky/b:5cab585a2303/ [1610.03592] On statistical learning via the lens of compression 2016-10-13T01:53:48+00:00 https://arxiv.org/abs/1610.03592 mraginsky papers to-read statistical-learning information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:4c704045bf51/ A theory of local learning, the learning channel, and the optimality of backpropagation 2016-09-20T20:08:49+00:00 http://www.sciencedirect.com/science/article/pii/S0893608016300880 mraginsky papers to-read neural-networks information-theory machine-learning https://pinboard.in/ https://pinboard.in/u:mraginsky/b:9790f163190a/ CONCENTRATION OF MEASURE PRINCIPLE AND ENTROPY-INEQUALITIES 2016-09-20T16:24:15+00:00 https://hal.archives-ouvertes.fr/hal-01365314/ mraginsky papers to-read measure-concentration information-theory optimal-transportation probability https://pinboard.in/ https://pinboard.in/u:mraginsky/b:0ca014389c93/ [1607.06494] Stochastic Control via Entropy Compression 2016-07-25T00:47:49+00:00 http://arxiv.org/abs/1607.06494 mraginsky papers to-read control-theory Markov-decision-processes information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:8e90a8909489/ [1508.04095] Algorithmic Aspects of Optimal Channel Coding 2016-07-12T09:16:48+00:00 http://arxiv.org/abs/1508.04095 mraginsky papers to-read information-theory channel-coding heard-the-talk https://pinboard.in/ https://pinboard.in/u:mraginsky/b:85457006c28d/ [1606.08920] Exact Lower Bounds for the Agnostic Probably-Approximately-Correct (PAC) Machine Learning Model 2016-07-01T03:07:26+00:00 http://arxiv.org/abs/1606.08920 mraginsky papers to-read machine-learning learning-theory lower-bounds information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:7d50ce3dd8e7/ [1605.02818] Brascamp-Lieb Inequality and Its Reverse: An Information Theoretic View 2016-05-12T03:48:52+00:00 http://arxiv.org/abs/1605.02818 mraginsky papers to-read information-theory probability strong-data-processing https://pinboard.in/ https://pinboard.in/u:mraginsky/b:44edfb32b6d6/ [1605.02268] Rate-Distortion Bounds on Bayes Risk in Supervised Learning 2016-05-10T02:39:02+00:00 http://arxiv.org/abs/1605.02268 mraginsky papers to-read information-theory machine-learning rate-distortion bayesian-learning https://pinboard.in/ https://pinboard.in/u:mraginsky/b:57e3011ba13b/ [1205.2628] Multiple Source Adaptation and the Renyi Divergence 2016-03-22T02:48:31+00:00 http://arxiv.org/abs/1205.2628 mraginsky papers to-read machine-learning representation-learning domain-adaptation information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:ce4aed1d2b5a/ [1503.03585] Deep Unsupervised Learning using Nonequilibrium Thermodynamics 2015-12-08T13:38:21+00:00 http://arxiv.org/abs/1503.03585 mraginsky papers deep-learning information-theory statistical-physics have-read meh https://pinboard.in/ https://pinboard.in/u:mraginsky/b:b817112477ae/ [1510.04214] LQG Control with Minimal Information: Three-Stage Separation Principle and SDP-based Solution Synthesis 2015-10-15T03:08:47+00:00 http://arxiv.org/abs/1510.04214 mraginsky papers to-read information-theory control-theory rational-inattention filtering estimation https://pinboard.in/ https://pinboard.in/u:mraginsky/b:268e8ef145e7/ [1509.04555] Understanding interdependency through complex information sharing 2015-10-13T03:21:54+00:00 http://arxiv.org/abs/1509.04555 mraginsky papers to-read information-theory complex-systems complexity distributed-systems https://pinboard.in/ https://pinboard.in/u:mraginsky/b:97ff2c9c459f/ [1510.01844] Bounds between Contraction Coefficients 2015-10-10T05:12:11+00:00 http://arxiv.org/abs/1510.01844 mraginsky papers information-theory have-read https://pinboard.in/ https://pinboard.in/u:mraginsky/b:c7171bffa5b8/ [1510.02190] Data compression with low distortion and finite blocklength 2015-10-10T05:09:45+00:00 http://arxiv.org/abs/1510.02190 mraginsky papers to-read heard-the-talk information-theory rate-distortion https://pinboard.in/ https://pinboard.in/u:mraginsky/b:41cad441378d/ [1510.00764] Strategic Compression and Transmission of Information: Crawford-Sobel Meet Shannon 2015-10-06T05:17:17+00:00 http://arxiv.org/abs/1510.00764 mraginsky papers to-read information-theory economics decision-making decision-theory rational-inattention rate-distortion https://pinboard.in/ https://pinboard.in/u:mraginsky/b:6a5c1240101d/ IEEE Xplore Abstract - Randomized Quantization and Source Coding With Constrained Output Distribution 2015-08-19T04:30:37+00:00 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6963478&searchWithin%5B%5D=%22Authors%22%3A.QT.Saldi%2C+N..QT.&newsearch=true mraginsky papers have-read information-theory source-coding rate-distortion optimal-transportation https://pinboard.in/ https://pinboard.in/u:mraginsky/b:68c4c22d3482/ IEEE Xplore Abstract - Output Constrained Lossy Source Coding With Limited Common Randomness 2015-08-19T04:29:48+00:00 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7138587&punumber%3D18%26filter%3DAND%28p_IS_Number%3A7203188%29%26pageNumber%3D2 mraginsky papers to-read information-theory quantization rate-distortion https://pinboard.in/ https://pinboard.in/u:mraginsky/b:76032a6a91d4/ [1508.00335] Bounds among $f$-divergences 2015-08-04T18:02:24+00:00 http://arxiv.org/abs/1508.00335 mraginsky papers to-read information-theory divergence https://pinboard.in/ https://pinboard.in/u:mraginsky/b:e06fff32e922/ [1506.02629] Generalization in Adaptive Data Analysis and Holdout Reuse 2015-06-28T03:16:36+00:00 http://arxiv.org/abs/1506.02629 mraginsky papers machine-learning overfitting-control information-theory have-read https://pinboard.in/ https://pinboard.in/u:mraginsky/b:de2b426ab45a/ [1506.07216] Communication Lower Bounds for Statistical Estimation Problems via a Distributed Data Processing Inequality 2015-06-26T00:17:20+00:00 http://arxiv.org/abs/1506.07216 mraginsky papers to-read distributed-computing estimation lower-bounds information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:29507eecba65/ Sequential Information Maximization: When is Greedy Near-optimal? 2015-06-25T14:15:12+00:00 http://people.inf.ethz.ch/~shassani/papers/colt2015-mis.pdf mraginsky papers to-read information-theory sequential-inference re:active_feature_selection_project via:arsyed https://pinboard.in/u:mraginsky/b:d0ff0aca4af5/ Information Processing and Thermodynamic Entropy (Stanford Encyclopedia of Philosophy) 2015-06-24T14:18:01+00:00 http://plato.stanford.edu/entries/information-entropy/ mraginskyto-read physics-of-information thermodynamics information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:b4cc92319423/ [1506.06472] The Ebb and Flow of Deep Learning: a Theory of Local Learning 2015-06-24T04:21:06+00:00 http://arxiv.org/abs/1506.06472 mraginsky papers to-read neural-networks deep-learning information-theory feedback https://pinboard.in/ https://pinboard.in/u:mraginsky/b:f6d9164014cf/ [0709.1948] Information theoretic approach to interactive learning 2015-06-23T19:52:43+00:00 http://arxiv.org/abs/0709.1948 mraginsky papers to-read information-theory machine-learning reinforcement-learning via:arsyed https://pinboard.in/u:mraginsky/b:e3e649cb7276/ [1506.05483] Asymptotic Optimality of Myopic Information-Based Strategies for Bayesian Adaptive Estimation 2015-06-19T14:18:14+00:00 http://arxiv.org/abs/1506.05483 mraginsky papers to-read information-theory bayesian-learning experimental-design https://pinboard.in/ https://pinboard.in/u:mraginsky/b:4fa79ef31bcf/ [1504.04419] Wasserstein continuity of entropy and outer bounds for interference channels 2015-06-14T08:36:33+00:00 http://arxiv.org/abs/1504.04419 mraginsky papers have-read information-theory probability measure-concentration optimal-transportation https://pinboard.in/ https://pinboard.in/u:mraginsky/b:19910a388840/ [1312.5276] Integration by parts and representation of information functionals 2015-06-14T01:39:07+00:00 http://arxiv.org/abs/1312.5276 mraginsky papers to-read information-theory probability https://pinboard.in/ https://pinboard.in/u:mraginsky/b:ede85048e82e/ [1403.5855] Stein's method, logarithmic Sobolev and transport inequalities 2015-06-14T01:38:40+00:00 http://arxiv.org/abs/1403.5855 mraginsky papers to-read measure-concentration probability information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:b06c167eb96a/ On entropy and information gain in random fields - Springer 2015-02-08T20:37:21+00:00 http://link.springer.com/article/10.1007%2FBF00532723 mraginskypapers to-read information-theory statistical-physics probability https://pinboard.in/ https://pinboard.in/u:mraginsky/b:bb682501fcd3/ [1310.6391] Robust bounds on risk-sensitive functionals via Renyi divergence 2015-01-03T00:12:40+00:00 http://arxiv.org/abs/1310.6391 mraginsky papers to-read information-theory probability robustness https://pinboard.in/ https://pinboard.in/u:mraginsky/b:a3fdee032e59/ [1412.7172] On the Speed of Social Learning 2014-12-27T14:20:59+00:00 http://arxiv.org/abs/1412.7172 mraginsky papers to-read information-theory social-learning https://pinboard.in/ https://pinboard.in/u:mraginsky/b:bb56025e45d2/ [1205.3756] Achieving the Capacity of any DMC using only Polar Codes 2014-11-06T05:37:17+00:00 http://arxiv.org/abs/1205.3756 mraginsky to-read information-theory coding-theory polar-codes https://pinboard.in/ https://pinboard.in/u:mraginsky/b:bcb397e01ca8/ Inequalities for Csiszár f-Divergences in Information Theory 2014-10-16T17:32:58+00:00 http://rgmia.org/monographs/csiszar.htm mraginskyto-read information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:98757f9e3311/ [1410.0503] On Bayes Risk Lower Bounds 2014-10-03T20:12:24+00:00 http://arxiv.org/abs/1410.0503 mraginsky papers to-read information-theory statistics heard-the-talk https://pinboard.in/ https://pinboard.in/u:mraginsky/b:e8aa46bbcc91/ [1409.6833] Quantized Estimation of Gaussian Sequence Models in Euclidean Balls 2014-09-25T02:29:32+00:00 http://arxiv.org/abs/1409.6833 mraginsky papers to-read statistics information-theory rate-distortion estimation quantization https://pinboard.in/ https://pinboard.in/u:mraginsky/b:13aab932bd81/ [1407.0381] Minimax rates of entropy estimation on large alphabets via best polynomial approximation 2014-07-04T19:07:49+00:00 http://arxiv.org/abs/1407.0381 mraginsky papers have-read information-theory entropy-estimation statistics https://pinboard.in/ https://pinboard.in/u:mraginsky/b:0e74208b419f/ [1406.0767] A generalization of Witsenhausen's zero-error rate for directed graphs 2014-06-04T01:39:05+00:00 http://arxiv.org/abs/1406.0767 mraginsky papers to-read information-theory graph-theory combinatorics https://pinboard.in/ https://pinboard.in/u:mraginsky/b:51e3b12cd4c7/ [1405.3629] Dissipation of information in channels with input constraints 2014-05-15T05:07:33+00:00 http://arxiv.org/abs/1405.3629 mraginsky papers have-read information-theory markov-chains https://pinboard.in/ https://pinboard.in/u:mraginsky/b:ac69dda62b44/ [1405.0608] Approximate tensorization of entropy at high temperature 2014-05-08T18:02:20+00:00 http://arxiv.org/abs/1405.0608 mraginsky papers to-read measure-concentration information-theory probability https://pinboard.in/ https://pinboard.in/u:mraginsky/b:f7ef14163a02/ Convex Relative Entropy Decay in Markov Chains 2014-03-01T23:55:13+00:00 http://www.eecs.berkeley.edu/~ananth/2014+/2014-02-24_VarunCISS.pdf mraginskypapers to-read markov-chains information-theory https://pinboard.in/ https://pinboard.in/u:mraginsky/b:b85757a05e70/ [1402.3067] A Bayesian Characterization of Relative Entropy 2014-02-14T02:29:55+00:00 http://arxiv.org/abs/1402.3067 mraginsky papers to-read information-theory probability categories https://pinboard.in/ https://pinboard.in/u:mraginsky/b:9ca9e338ca19/ [0903.2962] A symmetric entropy bound on the non-reconstruction regime of Markov chains on Galton-Watson trees 2014-01-17T12:55:45+00:00 http://arxiv.org/abs/0903.2962 mraginsky papers to-read information-theory statistical-physics markov-chains https://pinboard.in/ https://pinboard.in/u:mraginsky/b:56ee7d45e679/ Unifying Lower Bounds on the Oracle Complexity of Nonsmooth Convex Optimization (Gábor Braun, Cristóbal Guzmán, and Sebastian Pokutta) 2014-01-02T16:16:38+00:00 http://www2.isye.gatech.edu/~cguzman6/Files/ArxivLBAlgo.pdf mraginskypapers to-read optimization complexity convex-programming information-theory lower-bounds https://pinboard.in/ https://pinboard.in/u:mraginsky/b:682ee7556952/ Information-theoretic lower bounds for distributed statistical estimation with communication constraints, Yuchen Zhang, John C. Duchi, Michael I. Jordan, and Martin Wainwright. 2013-11-17T21:58:08+00:00 http://www.cs.berkeley.edu/~jduchi/projects/ZhangDuJoWa13.pdf mraginsky papers to-read information-theory complexity machine-learning statistics distributed-computing lower-bounds https://pinboard.in/ https://pinboard.in/u:mraginsky/b:69e64df0398d/