Rényi entropy is defined as:
where , .
As , converges to , which is Shannon's measure of entropy.
Rényi's measure satisfies
for .
Rényi entropy is defined as:
where , .
As , converges to , which is Shannon's measure of entropy.
Rényi's measure satisfies
for .
This entry contributed by Narayan L. Bhamidipati
Bhamidipati, Narayan L. "Rényi Entropy." From MathWorld--A Wolfram Web Resource, created by Eric W. Weisstein. https://mathworld.wolfram.com/RenyiEntropy.html