Information Theory Entropy

Discussions revolve around concepts from information theory, particularly entropy (Shannon's and Kolmogorov complexity), its distinctions from physical entropy, and implications for physics, intelligence, and compression.

📉 Falling 0.5x Science
3,337
Comments
20
Years Active
5
Top Authors
#9958
Topic ID

Activity Over Time

2007
3
2008
32
2009
37
2010
83
2011
69
2012
72
2013
96
2014
78
2015
136
2016
135
2017
183
2018
216
2019
215
2020
324
2021
283
2022
292
2023
382
2024
388
2025
296
2026
19

Keywords

KC NY hum.uva CDROM teahan.pdf en.m InformationInSpeech FM szabo.best vwh.net entropy information theory bits radiation compression von neumann neumann von mesh

Sample Comments

derbOac Jun 25, 2023 View on HN

Wouldn't this have information-theoretic implications?

chx Nov 16, 2023 View on HN

that's not how information theory works

tmalsburg2 Apr 15, 2025 View on HN

OP is talking about information entropy. Nature isn't relevant there.

whatshisface Jan 14, 2022 View on HN

What's the connection to information theory?

Natanael_L Apr 10, 2016 View on HN

Study the overlap between information theory / entropy and physics.

nobodyandproud Mar 29, 2024 View on HN

I wonder what information theory can tell us here.

jevogel May 26, 2020 View on HN

I believe the comment you responded to is referring to the concept of entropy in information theory. https://en.wikipedia.org/wiki/Entropy_(information_theory)

tijsvd Dec 11, 2022 View on HN

It's the field of information theory.https://en.m.wikipedia.org/wiki/Information_theory

mxkopy Oct 22, 2025 View on HN

Thats the same thing, no?https://en.wikipedia.org/wiki/Entropy_(information_theory)?w...

otabdeveloper4 Nov 16, 2023 View on HN

In the information theoretic sense. (Increasing information entropy.)