Logo: to the web site of Uppsala University

uu.sePublications from Uppsala University
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Non-Negative Decomposition of Multivariate Information: From Minimum to Blackwell-Specific Information
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Computer Architecture and Computer Communication.
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology.
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology.ORCID iD: 0000-0002-1527-734X
2024 (English)In: Entropy, E-ISSN 1099-4300, Vol. 26, no 5, article id 424Article in journal (Refereed) Published
Abstract [en]

Partial information decompositions (PIDs) aim to categorize how a set of source variables provides information about a target variable redundantly, uniquely, or synergetically. The original proposal for such an analysis used a lattice-based approach and gained significant attention. However, finding a suitable underlying decomposition measure is still an open research question at an arbitrary number of discrete random variables. This work proposes a solution with a non-negative PID that satisfies an inclusion-exclusion relation for any f-information measure. The decomposition is constructed from a pointwise perspective of the target variable to take advantage of the equivalence between the Blackwell and zonogon order in this setting. Zonogons are the Neyman-Pearson region for an indicator variable of each target state, and f-information is the expected value of quantifying its boundary. We prove that the proposed decomposition satisfies the desired axioms and guarantees non-negative partial information results. Moreover, we demonstrate how the obtained decomposition can be transformed between different decomposition lattices and that it directly provides a non-negative decomposition of R & eacute;nyi-information at a transformed inclusion-exclusion relation. Finally, we highlight that the decomposition behaves differently depending on the information measure used and how it can be used for tracing partial information flows through Markov chains.

Place, publisher, year, edition, pages
MDPI, 2024. Vol. 26, no 5, article id 424
Keywords [en]
partial information decomposition, redundancy, synergy, information flow analysis, f-information, R & eacute, nyi-information
National Category
Information Studies
Identifiers
URN: urn:nbn:se:uu:diva-531089DOI: 10.3390/e26050424ISI: 001232879400001PubMedID: 38785673OAI: oai:DiVA.org:uu-531089DiVA, id: diva2:1869753
Available from: 2024-06-13 Created: 2024-06-13 Last updated: 2024-06-13Bibliographically approved

Open Access in DiVA

fulltext(652 kB)167 downloads
File information
File name FULLTEXT01.pdfFile size 652 kBChecksum SHA-512
1b46687771579c04bc85b1afafd775cb043431cf0fd65c74c9c11ba9fe640fbec8cd040291c49b1e954ec6b31a56675ad16c194eec834d49c1aca04d9d1b1e46
Type fulltextMimetype application/pdf

Other links

Publisher's full textPubMed

Authority records

Mages, TobiasRohner, Christian

Search in DiVA

By author/editor
Mages, TobiasAnastasiadi, ElliRohner, Christian
By organisation
Computer Architecture and Computer CommunicationDepartment of Information Technology
In the same journal
Entropy
Information Studies

Search outside of DiVA

GoogleGoogle Scholar
Total: 167 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 264 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf