Learning Bayesian Network Parameters from a Small Data Set: A Further Constrained Qualitatively Maximum a Posteriori Method
Guo, Zhi-gao, Gao, Xiao-guang, Hao, Ren, Yang, Yu, Di, Ruo-hai and Chen, D (2017). Learning Bayesian Network Parameters from a Small Data Set: A Further Constrained Qualitatively Maximum a Posteriori Method. International Journal of Approximate Reasoning. 91 (Dec), pp. 22-35.
|Authors||Guo, Zhi-gao, Gao, Xiao-guang, Hao, Ren, Yang, Yu, Di, Ruo-hai and Chen, D|
To improve the learning accuracy of the parameters in a Bayesian network from a small data set, domain knowledge is normally incorporated into the learning process as parameter constraints. MAP-based (Maximum a Posteriori) methods that utilize both sample data and domain knowledge have been well studied in the literature. Among all the MAP-based methods, the QMAP (Qualitatively Maximum a Posteriori) method is one of the algorithms with the highest learning performance. When the data is insufficient, however, the estimation given by the QMAP often fails to satisfy all the parameter constraints, and this has made the overall QMAP estimation unreliable. To ensure that a QMAP estimation does not violate any given parameter constraints and further to improve the learning accuracy, a FC-QMAP (Further Constrained Qualitatively Maximum a Posteriori) algorithm is proposed in this paper. The algorithm regulates QMAP estimation by replacing data estimation with a further constrained estimation via convex optimization. Experiments and theoretical analysis show that the proposed algorithm outperforms most of the existing parameter learning methods including Maximum Likelihood, Constrained Maximum Likelihood, Maximum Entropy, Constrained Maximum Entropy, Maximum a Posteriori, and Qualitatively Maximum a Posteriori.
|Keywords||Bayesian network; Parameter learning; Small data set; Artificial Intelligence And Image Processing; Domain knowledge|
|Journal||International Journal of Approximate Reasoning|
|Journal citation||91 (Dec), pp. 22-35|
|Digital Object Identifier (DOI)||doi:10.1016/j.ijar.2017.08.009|
|04 Sep 2017|
|Publication process dates|
|Deposited||08 Nov 2017|
|Accepted||15 Aug 2017|
|Accepted author manuscript|
CC BY-NC-ND 4.0
4views this month
7downloads this month