TSA Entropy - definition of Shannon Entropy

[GregSands]

The definition of Shannon Entropy used in the TSA Entropy VI is defined as -sum(X^2.ln(X^2)) however the common definition is -sum(X.log(X)) where log is typically base 2.  Does anyone know the justification for the formula used in the TSA routine?

Cheers ~ Greg

[Kristen_K.]

Hi Greg,

I am unsure of the reason behind the decision to use the algorithm as stated in the documentation for the TSA Entropy VI.  However, I did take a look at the VI and since it does not make calls into a DLL as some VIs do, you can edit the VI as you would like.  Therefore, you can remove the squares if you desire.  Unfortunately, I do not have experience with the theory, so I cannot offer more information than what LabVIEW is capable of.

I hope this helps