No Cover Image

Journal article 14 views

On Defining Expressions for Entropy and Cross-Entropy: The Entropic Transreals and Their Fracterm Calculus

Jan A. Bergstra Orcid Logo, John Tucker Orcid Logo

Entropy, Volume: 27, Issue: 1, Start page: 31

Swansea University Author: John Tucker Orcid Logo

Full text not available from this repository: check for access using links below.

Check full text

DOI (Published version): 10.3390/e27010031

Abstract

Classic formulae for entropy and cross-entropy contain operations 0 and log2 that are not defined on all inputs. This can lead to calculations with problematic subexpressions such as 0 log2 0 and uncertainties in large scale calculations; partiality also introduces complications in logical analysis....

Full description

Published in: Entropy
ISSN: 1099-4300
Published: MDPI AG 2025
Online Access: Check full text

URI: https://cronfa.swan.ac.uk/Record/cronfa68639
first_indexed 2025-01-13T20:35:03Z
last_indexed 2025-01-13T20:35:03Z
id cronfa68639
recordtype SURis
fullrecord <?xml version="1.0"?><rfc1807><datestamp>2025-01-13T15:17:22.8124208</datestamp><bib-version>v2</bib-version><id>68639</id><entry>2025-01-02</entry><title>On Defining Expressions for Entropy and Cross-Entropy: The Entropic Transreals and Their Fracterm Calculus</title><swanseaauthors><author><sid>431b3060563ed44cc68c7056ece2f85e</sid><ORCID>0000-0003-4689-8760</ORCID><firstname>John</firstname><surname>Tucker</surname><name>John Tucker</name><active>true</active><ethesisStudent>false</ethesisStudent></author></swanseaauthors><date>2025-01-02</date><deptcode>MACS</deptcode><abstract>Classic formulae for entropy and cross-entropy contain operations 0 and log2 that are not defined on all inputs. This can lead to calculations with problematic subexpressions such as 0 log2 0 and uncertainties in large scale calculations; partiality also introduces complications in logical analysis. Instead of adding conventions or splitting formulae into cases, we create a new algebra of real numbers with two symbols &#xB1;&#x221E; for signed infinite values and a symbol named &#x22A5; for the undefined. In this resulting arithmetic, entropy, cross-entropy, Kullback&#x2013;Leibler divergence, and Shannon divergence can be expressed without concerning any further conventions. The algebra may form a basis for probability theory more generally.</abstract><type>Journal Article</type><journal>Entropy</journal><volume>27</volume><journalNumber>1</journalNumber><paginationStart>31</paginationStart><paginationEnd/><publisher>MDPI AG</publisher><placeOfPublication/><isbnPrint/><isbnElectronic/><issnPrint/><issnElectronic>1099-4300</issnElectronic><keywords>Partial formulae; fracterm calculus; transreals; entropic transreals; peripheral numbers; entropy; cross-entropy</keywords><publishedDay>2</publishedDay><publishedMonth>1</publishedMonth><publishedYear>2025</publishedYear><publishedDate>2025-01-02</publishedDate><doi>10.3390/e27010031</doi><url>https://doi.org/10.3390/e27010031</url><notes/><college>COLLEGE NANME</college><department>Mathematics and Computer Science School</department><CollegeCode>COLLEGE CODE</CollegeCode><DepartmentCode>MACS</DepartmentCode><institution>Swansea University</institution><apcterm>Another institution paid the OA fee</apcterm><funders>This research received no external funding.</funders><projectreference/><lastEdited>2025-01-13T15:17:22.8124208</lastEdited><Created>2025-01-02T15:25:16.0368950</Created><path><level id="1">Faculty of Science and Engineering</level><level id="2">School of Mathematics and Computer Science - Computer Science</level></path><authors><author><firstname>Jan A.</firstname><surname>Bergstra</surname><orcid>0000-0003-2492-506x</orcid><order>1</order></author><author><firstname>John</firstname><surname>Tucker</surname><orcid>0000-0003-4689-8760</orcid><order>2</order></author></authors><documents/><OutputDurs/></rfc1807>
spelling 2025-01-13T15:17:22.8124208 v2 68639 2025-01-02 On Defining Expressions for Entropy and Cross-Entropy: The Entropic Transreals and Their Fracterm Calculus 431b3060563ed44cc68c7056ece2f85e 0000-0003-4689-8760 John Tucker John Tucker true false 2025-01-02 MACS Classic formulae for entropy and cross-entropy contain operations 0 and log2 that are not defined on all inputs. This can lead to calculations with problematic subexpressions such as 0 log2 0 and uncertainties in large scale calculations; partiality also introduces complications in logical analysis. Instead of adding conventions or splitting formulae into cases, we create a new algebra of real numbers with two symbols ±∞ for signed infinite values and a symbol named ⊥ for the undefined. In this resulting arithmetic, entropy, cross-entropy, Kullback–Leibler divergence, and Shannon divergence can be expressed without concerning any further conventions. The algebra may form a basis for probability theory more generally. Journal Article Entropy 27 1 31 MDPI AG 1099-4300 Partial formulae; fracterm calculus; transreals; entropic transreals; peripheral numbers; entropy; cross-entropy 2 1 2025 2025-01-02 10.3390/e27010031 https://doi.org/10.3390/e27010031 COLLEGE NANME Mathematics and Computer Science School COLLEGE CODE MACS Swansea University Another institution paid the OA fee This research received no external funding. 2025-01-13T15:17:22.8124208 2025-01-02T15:25:16.0368950 Faculty of Science and Engineering School of Mathematics and Computer Science - Computer Science Jan A. Bergstra 0000-0003-2492-506x 1 John Tucker 0000-0003-4689-8760 2
title On Defining Expressions for Entropy and Cross-Entropy: The Entropic Transreals and Their Fracterm Calculus
spellingShingle On Defining Expressions for Entropy and Cross-Entropy: The Entropic Transreals and Their Fracterm Calculus
John Tucker
title_short On Defining Expressions for Entropy and Cross-Entropy: The Entropic Transreals and Their Fracterm Calculus
title_full On Defining Expressions for Entropy and Cross-Entropy: The Entropic Transreals and Their Fracterm Calculus
title_fullStr On Defining Expressions for Entropy and Cross-Entropy: The Entropic Transreals and Their Fracterm Calculus
title_full_unstemmed On Defining Expressions for Entropy and Cross-Entropy: The Entropic Transreals and Their Fracterm Calculus
title_sort On Defining Expressions for Entropy and Cross-Entropy: The Entropic Transreals and Their Fracterm Calculus
author_id_str_mv 431b3060563ed44cc68c7056ece2f85e
author_id_fullname_str_mv 431b3060563ed44cc68c7056ece2f85e_***_John Tucker
author John Tucker
author2 Jan A. Bergstra
John Tucker
format Journal article
container_title Entropy
container_volume 27
container_issue 1
container_start_page 31
publishDate 2025
institution Swansea University
issn 1099-4300
doi_str_mv 10.3390/e27010031
publisher MDPI AG
college_str Faculty of Science and Engineering
hierarchytype
hierarchy_top_id facultyofscienceandengineering
hierarchy_top_title Faculty of Science and Engineering
hierarchy_parent_id facultyofscienceandengineering
hierarchy_parent_title Faculty of Science and Engineering
department_str School of Mathematics and Computer Science - Computer Science{{{_:::_}}}Faculty of Science and Engineering{{{_:::_}}}School of Mathematics and Computer Science - Computer Science
url https://doi.org/10.3390/e27010031
document_store_str 0
active_str 0
description Classic formulae for entropy and cross-entropy contain operations 0 and log2 that are not defined on all inputs. This can lead to calculations with problematic subexpressions such as 0 log2 0 and uncertainties in large scale calculations; partiality also introduces complications in logical analysis. Instead of adding conventions or splitting formulae into cases, we create a new algebra of real numbers with two symbols ±∞ for signed infinite values and a symbol named ⊥ for the undefined. In this resulting arithmetic, entropy, cross-entropy, Kullback–Leibler divergence, and Shannon divergence can be expressed without concerning any further conventions. The algebra may form a basis for probability theory more generally.
published_date 2025-01-02T05:41:53Z
_version_ 1821382922275389440
score 11.3749895

Similar Items