Prior Probability

In Bayesian statistical inference, a prior probability distribution, often honestly referred to as the prior, of an uncertain amount is the probability distribution that would specify one’s beliefs about this quantity before some evidence is taken under consideration.

Definition of Prior Probability

A prior probability, additionally called classical probability, is a probability that is deduced from formal reasoning. In other words, a prior probability is derived from logically analyzing an event. A priori probability does not range from individual to person (as might a subjective probability) and is a goal probability.

Prior Probability In Statistics 

• In Bayesian statistical inference, a prior probability distribution, frequently clearly known as the prior, of an uncertain amount is the probability distribution that would express one’s ideals approximately this amount earlier than a few proofs is taken under consideration. As an instance, the prior can be the probability distribution representing the relative proportions of voters who will vote for a specific politician in a future election. The unknown amount may be a parameter of the model or a latent variable rather than an observable variable.

• Bayes’ theorem calculates the renormalized pointwise product of the earlier and the probability feature, to provide the posterior opportunity distribution, that’s the conditional distribution of the uncertain quantity given the data.

• Similarly, the prior probability of a random event or an uncertain proposition is the unconditional probability that is assigned before any relevant evidence is taken under consideration.

• Priors can be created by the usage of a number of techniques.[1]: 27–41  a prior may be determined from past records, inclusive of preceding experiments. A prior can be elicited from the only subjective evaluation of an experienced professional. An uninformative prior may be created to mirror a balance amongst consequences while no information is to be had. Priors can also be chosen in line with some precept, which includes symmetry or maximizing entropy given constraints; examples are Jeffreys prior or Bernardo’s reference prior. Whilst a circle of relatives of conjugate priors exists, deciding on a prior form of that family simplifies the calculation of the posterior distribution.

• Parameters of prior distributions are a type of hyperparameter. As an example, if one uses a beta distribution to model the distribution of the parameter p of a Bernoulli distribution, then:

• P is a parameter of the underlying system (Bernoulli distribution), and Α and β are parameters of the prior distribution (beta distribution); for this reason hyperparameters.

The formula for Prior Probability -: 

 A Prior Probability = f / N

Where:

f is the number of desirable outcomes.

N is the total number of outcomes.

Prior Probability Examples -: 

Example 1: Fair Dice Roll

Six-sided fair dice are rolled. What is the a priori possibility of rolling a 2, 4, or 6, in a cube roll?

The range of desired effects is 3 (rolling a 2, 4, or 6), and there are 6 consequences in general. Then the prior probability for this example is given as follows:

A priori probability = 3 / 6 = 50%. 

Hence, a prior probability of rolling a 2, 4, or 6 is 50%.

Example 2 -: Deck of Cards

In a standard deck of cards, what’s a prior probability of drawing an ace of spades?

The quantity of desired results is 1 (an ace of spades), and there are 52 outcomes in general. The prior probability for this example is calculated as given below: 

A prior probability = 1 / 52 = 1.92%.

 Hence, a prior probability of drawing the ace of spades is 1.92%.

Example 3:  Tossing the coin

John is looking to find a prior probability of getting a head. He did a single coin toss, proven under:

Test 1

Result: Head

What is a prior probability of coming to a head?

The above is a trick example – the prior coin toss has no impact on a prior probability of coming to a head. The a priori probability of coming a head is calculated as follows:

A priori probability = 1 / 2 = 50%. Therefore, a prior probability of coming to a head is 50%.

Conclusion -: 

In this article, we have discussed the prior probability. The prior probability is defined as the Bayesian statistical inference, which is the probability of an event before new statistics are collected. This is the quality rational assessment of the chance of final results based on the modern expertise earlier than an experiment is executed. We have explained the concept of prior probability with examples for better understanding. We have even discussed the importance of prior probability in statistics. The priors can be created by multiple techniques.