Cargando…

On the Depth of Decision Trees with Hypotheses

In this paper, based on the results of rough set theory, test theory, and exact learning, we investigate decision trees over infinite sets of binary attributes represented as infinite binary information systems. We define the notion of a problem over an information system and study three functions o...

Descripción completa

Detalles Bibliográficos
Autor principal: Moshkov, Mikhail
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8774416/
https://www.ncbi.nlm.nih.gov/pubmed/35052142
http://dx.doi.org/10.3390/e24010116
_version_ 1784636336850862080
author Moshkov, Mikhail
author_facet Moshkov, Mikhail
author_sort Moshkov, Mikhail
collection PubMed
description In this paper, based on the results of rough set theory, test theory, and exact learning, we investigate decision trees over infinite sets of binary attributes represented as infinite binary information systems. We define the notion of a problem over an information system and study three functions of the Shannon type, which characterize the dependence in the worst case of the minimum depth of a decision tree solving a problem on the number of attributes in the problem description. The considered three functions correspond to (i) decision trees using attributes, (ii) decision trees using hypotheses (an analog of equivalence queries from exact learning), and (iii) decision trees using both attributes and hypotheses. The first function has two possible types of behavior: logarithmic and linear (this result follows from more general results published by the author earlier). The second and the third functions have three possible types of behavior: constant, logarithmic, and linear (these results were published by the author earlier without proofs that are given in the present paper). Based on the obtained results, we divided the set of all infinite binary information systems into four complexity classes. In each class, the type of behavior for each of the considered three functions does not change.
format Online
Article
Text
id pubmed-8774416
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-87744162022-01-21 On the Depth of Decision Trees with Hypotheses Moshkov, Mikhail Entropy (Basel) Article In this paper, based on the results of rough set theory, test theory, and exact learning, we investigate decision trees over infinite sets of binary attributes represented as infinite binary information systems. We define the notion of a problem over an information system and study three functions of the Shannon type, which characterize the dependence in the worst case of the minimum depth of a decision tree solving a problem on the number of attributes in the problem description. The considered three functions correspond to (i) decision trees using attributes, (ii) decision trees using hypotheses (an analog of equivalence queries from exact learning), and (iii) decision trees using both attributes and hypotheses. The first function has two possible types of behavior: logarithmic and linear (this result follows from more general results published by the author earlier). The second and the third functions have three possible types of behavior: constant, logarithmic, and linear (these results were published by the author earlier without proofs that are given in the present paper). Based on the obtained results, we divided the set of all infinite binary information systems into four complexity classes. In each class, the type of behavior for each of the considered three functions does not change. MDPI 2022-01-12 /pmc/articles/PMC8774416/ /pubmed/35052142 http://dx.doi.org/10.3390/e24010116 Text en © 2022 by the author. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Moshkov, Mikhail
On the Depth of Decision Trees with Hypotheses
title On the Depth of Decision Trees with Hypotheses
title_full On the Depth of Decision Trees with Hypotheses
title_fullStr On the Depth of Decision Trees with Hypotheses
title_full_unstemmed On the Depth of Decision Trees with Hypotheses
title_short On the Depth of Decision Trees with Hypotheses
title_sort on the depth of decision trees with hypotheses
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8774416/
https://www.ncbi.nlm.nih.gov/pubmed/35052142
http://dx.doi.org/10.3390/e24010116
work_keys_str_mv AT moshkovmikhail onthedepthofdecisiontreeswithhypotheses