Information Theory Entropy

Discussions revolve around concepts from information theory, particularly entropy (Shannon's and Kolmogorov complexity), its distinctions from physical entropy, and implications for physics, intelligence, and compression.

📉 Falling 0.5x Science
3,337
Comments
20
Years Active
5
Top Authors
#9958
Topic ID

Activity Over Time

2007
3
2008
32
2009
37
2010
83
2011
69
2012
72
2013
96
2014
78
2015
136
2016
135
2017
183
2018
216
2019
215
2020
324
2021
283
2022
292
2023
382
2024
388
2025
296
2026
19

Keywords

KC NY hum.uva CDROM teahan.pdf en.m InformationInSpeech FM szabo.best vwh.net entropy information theory bits radiation compression von neumann neumann von mesh

Sample Comments

derbOac • Jun 25, 2023 • View on HN

Wouldn't this have information-theoretic implications?

chx • Nov 16, 2023 • View on HN

that's not how information theory works

tmalsburg2 • Apr 15, 2025 • View on HN

OP is talking about information entropy. Nature isn't relevant there.

whatshisface • Jan 14, 2022 • View on HN

What's the connection to information theory?

Natanael_L • Apr 10, 2016 • View on HN

Study the overlap between information theory / entropy and physics.

nobodyandproud • Mar 29, 2024 • View on HN

I wonder what information theory can tell us here.

jevogel • May 26, 2020 • View on HN

I believe the comment you responded to is referring to the concept of entropy in information theory. https://en.wikipedia.org/wiki/Entropy_(information_theory)

tijsvd • Dec 11, 2022 • View on HN

It's the field of information theory.https://en.m.wikipedia.org/wiki/Information_theory

mxkopy • Oct 22, 2025 • View on HN

Thats the same thing, no?https://en.wikipedia.org/wiki/Entropy_(information_theory)?w...

otabdeveloper4 • Nov 16, 2023 • View on HN

In the information theoretic sense. (Increasing information entropy.)