Beta. Content is under active construction and has not been peer-reviewed. Report errors on
GitHub
.
Disclaimer
Theorem
Path
Curriculum
Paths
Demos
Diagnostic
Search
Quiz Hub
/
Bits, Nats, Perplexity, and BPB
Bits, Nats, Perplexity, and BPB
3 questions
Difficulty 2-4
View topic
Foundation
0 / 3
2 foundation
1 intermediate
Adapts to your performance
1 / 3
foundation (2/10)
compute
Information theory uses both bits (log base 2) and nats (natural log) as units. What is the conversion factor?
Hide and think first
A.
1 nat
=
e
bits, because the natural log base
e
corresponds to an
e
-valued digit
B.
1 nat
=
1 bit, since entropy is dimensionless and the choice of base is purely cosmetic
C.
1 nat
=
1/
ln
2
≈
1.44
bits, so entropy in nats times
1.44
gives entropy in bits
D.
1 nat
=
ln
2
≈
0.693
bits, so entropy in nats times
0.693
gives entropy in bits
Submit Answer