Journal of Research and Development
Open Access

Abstract

Mini-Review on an Entropy-based Measure of Dependence between Two Groups of Random Variables

Nan L. Kong*

In the article an entropy-based measure of dependence between two groups of random variables, the K-dependence coefficient or dependence coefficient is defined with entropy and conditional entropy to measure the degree of dependence of one group of categorical random variables on another group of categorical random variables. Also, the concept of the K-dependence coefficient is extended by defining the partial K-dependence coefficient and the semi-partial K-dependence coefficient with which the K-dependence coefficient decomposition expression is established mathematically. The K-dependence coefficient decomposition expression shows that K-dependence coefficient is of additive structure and therefore, according to measure theory, K-dependence coefficient is a measure of the degree of dependence of one group of categorical random variables on another group of categorical random variables.

Published Date: 2024-09-10; Received Date: 2024-08-09