ProbLog

ProbLog
Original author(s)	DTAI research lab (KU Leuven)
Initial release	November 11, 2007
Stable release	2.1
Written in	Python
Operating system	Linux, Mac OS X, Microsoft Windows
Type	Probabilistic logic
License	Apache License, Version 2.0
Website	dtai.cs.kuleuven.be/problog/

ProbLog is a probabilistic logic programming that extends Prolog with probabilities.^[1]^[2]^[3] It minimally extends Prolog by adding the notion of a probabilistic fact, which combines the idea of logic atoms and random variables. Similarly to Prolog, ProbLog can query an atom. While Prolog returns the truth value of the queried atom, ProbLog returns the probability of it being true.

Semantics

A probabilistic fact is a pair $(p,a)$ with $a$ an atom and $p\in [0,1]$ the probability of $a$ being true. A rule is defined by an atom $h$ , called the head, and a finite set of $n$ literals $\{b_{1},b_{2},...,b_{n}\}$ , called the body. ProbLog programs consist of a set of probabilistic facts ${\mathcal {F}}$ and a set of rules ${\mathcal {R}}$ . Using the distribution semantics, a probability distribution is defined over the two-valued well-founded models of the atoms in the program. The probability of a model is defined as $P(M)=\prod _{l\in M}P(l)$ where the product runs over all the literals in the model $M$ . For a query atom $q$ the distribution semantics defines a probability for the query $P(q)=\sum _{M\models q}P(M)=\sum _{M\models q}\prod _{l\in M}P(l)$ in which the sum runs over all the models where $q$ is true.

ProbLog supports multiple tasks:

Probabilistic inference: calculate $P(q)$
Most probable explanation: calculate the most probable model probability $\max _{M\models q}P(M)$
Sampling: generate samples of $q$
Learning from interpretations: learn the probabilities of ProbLog programs from data

Example

ProbLog can for example be used to calculate the probability of getting wet given the probabilities for rain and the probabilities that someone brings an umbrella as follows:

0.4 :: rain(weekday).
0.9 :: rain(weekend).
0.8 :: umbrella_if_rainy(Day).
0.2 :: umbrella_if_dry(Day).

umbrella(Day) :- rain(Day), umbrella_if_rainy(Day).
umbrella(Day) :- \+rain(Day), umbrella_if_dry(Day).
wet(Day) :- rain(Day), \+umbrella(Day).

query(\+wet(weekend)).

The last rule before the query states that someone gets wet if it rains and no umbrella was brought. When ProbLog is asked to solve the "probabilistic inference" task, the query asks for the probability to stay dry on a weekend day. When solving the "most probable explanation" task, ProbLog will return the most likely reason for staying dry, i.e. because it is not raining or because the person has an umbrella.

Implementations

The ProbLog language has been implemented as a YAP Prolog library (ProbLog 1).^[4] and as a stand-alone Python framework (ProbLog 2)^[5] The source code of ProbLog 2 is licensed under Apache License, Version 2.0 and available on GitHub.^[6]

ProbLog variants

ProbLog has been extended or used as inspiration for several different variants, including:

DeepProbLog extends ProbLog by allowing the probability to be parametrized by a neural network.^[7]
DTProblog extends ProbLog with decision theory. The utility of a strategy is defined as the expected reward for its execution in the presence of probabilistic effects.^[8]
DC-ProbLog extends ProbLog with distributional facts, meaning that instead of probabilities, a logic atom has a corresponding continuous probability distribution instead.
aProbLog extends ProbLog by allowing any semiring instead of just probabilities.^[9]
ProbFOIL: given a set of ProbLog facts as a probabilistic relational database, ProbFOIL finds a set of probabilistic rules to predict the facts of one relation based on all other relations.

Related systems

PRISM: Programming in statistical modeling^[10]
ICL: Independent Choice Logic^[11]
CP-Logic: Language of causal probabilistic events^[12]
PITA: Probabilistic Inference with Tabling and Answer subsumption^[13]
Distributional clauses: A probabilistic logic language for hybrid relational domains^[14]

References

^ De Raedt, Luc; Kimmig, Angelika; Toivonen, Hannu (November 2007). ProbLog: A Probabilistic Prolog and Its Application in Link Discovery. IJCAI. Vol. 7.
^ Fierens, D; Van den Broeck, G.; Bruynooghe, M.; De Raedt, L. (2012). Constraints for probabilistic logic programming. Proceedings of the NIPS Probabilistic Programming Workshop. pp. 1–4.
^ De Raedt, Luc; Kimmig, Angelika (2015). "Probabilistic (logic) programming concepts". Machine Learning. 100 (1): 5–47. doi:10.1007/s10994-015-5494-z. S2CID 3166992.
^ "ProbLog1". dtai.cs.kuleuven.be.
^ ^a ^b "ProbLog: Probabilistic Programming". dtai.cs.kuleuven.be.
^ ^a ^b "ProbLog GitHub repository". github.com. 12 October 2022.
^ Manhaeve, Robin; Dumancic, Sebastijan; Kimmig, Angelika; Demeester, Thomas; De Raedt, Luc (2018). DeepProbLog: Neural Probabilistic Logic Programming. NeurIPS 2018, Thirty-second Conference on Neural Information Processing Systems. pp. 3753–3760.
^ Van den Broeck, Guy; Thon, Ingo; Van Otterlo, Martijn; De Raedt, Luc (2010). "DTProbLog: A decision-theoretic probabilistic Prolog". Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 24.
^ Kimmig, A.; Van den Broeck, G.; De Raedt, L. (2011). An algebraic Prolog for reasoning about possible worlds. Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence. pp. 209–214.
^ "PITA: Probabilistic Inference with Tabling and Answer subsumption". rjida.meijo-u.ac.jp.
^ Poole, David (2008). "The independent choice logic and beyond". Probabilistic Inductive Logic Programming. Lecture Notes in Computer Science. 9: 222–243. doi:10.1007/978-3-540-78652-8_8. ISBN 978-3-540-78651-1.
^ Vennekens, Joost; Denecker, Marc; Bruynooghe, Maurice (2009). CP-logic: A language of causal probabilistic events and its relation to logic programming. Theory and practice of logic programming. Vol. 9. pp. 245–308.
^ "PITA: Probabilistic Inference with Tabling and Answer subsumption". ml.unife.it.
^ "Distributional Clauses". dtai.cs.kuleuven.be.
^ "ProbLog: ProbLog 2.1 documentation". problog.readthedocs.io.

[ProbLogLinkDiscovery-1] De Raedt, Luc; Kimmig, Angelika; Toivonen, Hannu (November 2007). ProbLog: A Probabilistic Prolog and Its Application in Link Discovery. IJCAI. Vol. 7.

[PLP-2] Fierens, D; Van den Broeck, G.; Bruynooghe, M.; De Raedt, L. (2012). Constraints for probabilistic logic programming. Proceedings of the NIPS Probabilistic Programming Workshop. pp. 1–4.

[ProbLogConcepts-3] De Raedt, Luc; Kimmig, Angelika (2015). "Probabilistic (logic) programming concepts". Machine Learning. 100 (1): 5–47. doi:10.1007/s10994-015-5494-z. S2CID 3166992.

[ProbLog1-4] "ProbLog1". dtai.cs.kuleuven.be.

[ProbLogHomepage-5] "ProbLog: Probabilistic Programming". dtai.cs.kuleuven.be.

[ProbLogRepository-6] "ProbLog GitHub repository". github.com. 12 October 2022.

[DeepProbLog-7] Manhaeve, Robin; Dumancic, Sebastijan; Kimmig, Angelika; Demeester, Thomas; De Raedt, Luc (2018). DeepProbLog: Neural Probabilistic Logic Programming. NeurIPS 2018, Thirty-second Conference on Neural Information Processing Systems. pp. 3753–3760.

[DTProbLog-8] Van den Broeck, Guy; Thon, Ingo; Van Otterlo, Martijn; De Raedt, Luc (2010). "DTProbLog: A decision-theoretic probabilistic Prolog". Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 24.

[aProbLog-9] Kimmig, A.; Van den Broeck, G.; De Raedt, L. (2011). An algebraic Prolog for reasoning about possible worlds. Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence. pp. 209–214.

[PRISM-10] "PITA: Probabilistic Inference with Tabling and Answer subsumption". rjida.meijo-u.ac.jp.

[ICL-11] Poole, David (2008). "The independent choice logic and beyond". Probabilistic Inductive Logic Programming. Lecture Notes in Computer Science. 9: 222–243. doi:10.1007/978-3-540-78652-8_8. ISBN 978-3-540-78651-1.

[CP-Logic-12] Vennekens, Joost; Denecker, Marc; Bruynooghe, Maurice (2009). CP-logic: A language of causal probabilistic events and its relation to logic programming. Theory and practice of logic programming. Vol. 9. pp. 245–308.

[PITA-13] "PITA: Probabilistic Inference with Tabling and Answer subsumption". ml.unife.it.

[DC-14] "Distributional Clauses". dtai.cs.kuleuven.be.

[ProbLogDocs-15] "ProbLog: ProbLog 2.1 documentation". problog.readthedocs.io.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

[13]

[14]

[15]