The entropy region for three Gaussian random variables
- Creators
- Hassibi, Babak
- Shadbakht, Sormeh
Abstract
Given n (discrete or continuous) random variables X_i, the (2^n – 1)-dimensional vector obtained by evaluating the joint entropy of all non-empty subsets of {X_(1,hellip), X_n} is called an entropic vector. Determining the region of entropic vectors is an important open problem in information theory. Recently, Chan has shown that the entropy regions for discrete and continuous random variables, though different, can be determined from one another. An important class of continuous random variables are those that are vector-valued and jointly Gaussian. It is known that Gaussian random variables violate the Ingleton bound, which many random variables such as those obtained from linear codes over finite fields do satisfy, and they also achieve certain non-Shannon inequalities. In this paper we give a full characterization of the entropy region for three jointly-Gaussian vector-valued random variables and, rather surprisingly, show that the region is strictly smaller than the entropy region for three arbitrary random variables. However, we also show the following result. For any given entropic vector h isin R^7, there exists a thetas* > 0, such that for all thetas ges thetas*, the vector 1/thetas h can be generated by three vector-valued jointly Gaussian random variables. This implies that for three random variables the region of entropic vectors can be obtained by considering the cone generated by the space of Gaussian entropic vectors. It also suggests that studying Gaussian random variables for n ges 4 may be a fruitful approach to studying the space of entropic vectors for arbitrary n.
Additional Information
© 2008 IEEE. This work was supported in part by the National Science Foundation under grant CCF-0729203, by the David and Lucille Packard Foundation and by Caltech's Lee Center for Advanced Networking.Attached Files
Published - 04595469.pdf
Submitted - On_the_Entropy_Region_of_Gaussian_Random_Variables.pdf
Files
Name | Size | Download all |
---|---|---|
md5:501294b537dd39c6c7b14936245eb9da
|
831.4 kB | Preview Download |
md5:499f0acf7a6bcdeccb9191bcde56f22e
|
153.7 kB | Preview Download |
Additional details
- Alternative title
- On the Entropy Region of Gaussian Random Variables
- Eprint ID
- 54110
- Resolver ID
- CaltechAUTHORS:20150127-072401829
- NSF
- CCF-0729203
- David and Lucile Packard Foundation
- Caltech Lee Center for Advanced Networking
- Created
-
2015-01-28Created from EPrint's datestamp field
- Updated
-
2021-11-10Created from EPrint's last_modified field