Horje
Probability Density Function(PDF): Definition, Formula, Example

Probability Density Function is the function of probability defined for various distributions of variables and is the less common topic in the study of probability throughout the academic journey of students. However, this function is very useful in many areas of real life such as predicting rainfall, financial modelling such as the stock market, income disparity in social sciences, etc.

This article explores the topic of the Probability Density Function in detail including its definition, condition for existence of this function, as well as various examples.

Table of Content

What is Probability Density Function(PDF)?

Probability Density Function is used for calculating the probabilities for continuous random variables. When the cumulative distribution function (CDF) is differentiated we get the probability density function (PDF). Both functions are used to represent the probability distribution of a continuous random variable.

The probability density function is defined over a specific range. By differentiating CDF we get PDF and by integrating the probability density function we can get the cumulative density function.

Probability Density Function Definition

Probability density function is the function that represents the density of probability for a continuous random variable over the specified ranges.

Probability Density Function is abbreviated as PDF and for a continuous random variable X, Probability Density Function is denoted by f(x).

PDF of the random variable is obtained by differentiating CDF (Cumulative Distribution Function) of X. The probability density function should be a positive for all possible values of the variable. The total area between the density curve and the x-axis should be equal to 1.

Necessary Conditions for PDF

Let X be the continuous random variable with probability density function f(x). For a function to be valid probability function should satisfy below conditions.

  • f(x) ≥ 0, ∀ x ∈ R
  • f(x) should be piecewise continuous.
  • [Tex]\int\limits^{\infin}_{-\infin}f(x)dx = 1 [/Tex]

So, the PDF should be the non-negative and piecewise continuous function whose total value evaluates to 1.

Check: Normal distribution Formula

Example of a Probability Density Function

Let X be a continuous random variable and the probability density function pdf is given by f(x) = x – 1 , 0 < x ≤ 5. We have to find P (1 < x ≤ 2).

To find the probability P (1 < x ≤ 2) we integrate the pdf f(x) = x – 1 with the limits 1 and 2. This results in the probability P (1 < x ≤ 2) = 0.5

Probability Density Function Formula

Let Y be a continuous random variable and F(y) be the cumulative distribution function (CDF) of Y. Then, the probability density function (PDF) f(y) of Y is obtained by differentiating the CDF of Y.

f(y) = [Tex]\bold{\frac{d}{dy}[F(y)]} [/Tex] = F'(y)

If we want to calculate the probability for X lying between the interval a and b, then we can use the following formula:

P (a ≤ X ≤ b) = F(b) – F(a) = [Tex]\bold{\int\limits^{b}_{a}f(x)dx} [/Tex]

Key Points about PDF Formula

  • If we differentiate CDF, we get the PDF of the random variable.

f(y) = [Tex]\bold{\frac{d}{dy}[F(y)]} [/Tex]

  • If we integrate PDF, we get the CDF of the random variable.

F(y) = [Tex]\bold{\int\limits^{y}_{-\infin}f(t) dt} [/Tex]

What Does a Probability Density Function (PDF) Tell Us?

A Probability Density Function (PDF) is a function that describes the likelihood of a continuous random variable taking on a particular value. Unlike discrete random variables, where probabilities are assigned to specific outcomes, continuous random variables can take on any value within a range. Probability Density Function (PDF) tells us

  • Relative Likelihood
  • Distribution Shape
  • Expected Value and Variance, etc.

How to Find Probability from Probability Density Function

To find the probability from the probability density function we have to follow some steps.

Step 1: First check the PDF is valid or not using the necessary conditions.

Step 2: If the PDF is valid, use the formula and write the required probability and limits.

Step 3: Divide the integration according to the given PDF.

Step 4: Solve all integrations.

Step 5: The resultant value gives the required probability.

Graph for Probability Density Function

If X is continuous random variable and f(x) be the probability density function. The probability for the random variable is given by area under the pdf curve. The graph of PDF looks like bell curve, with the probability of X given by area below the curve. The following graph gives the probability for X lying between interval a and b.

Probability-Density-Function

Probability Density Function Properties

Let f(x) be the probability density function for continuous random variable x. Following are some probability density function properties:

  • Probability density function is always positive for all the values of x.

f(x) ≥ 0, ∀ x ∈ R

  • Total area under probability density curve is equal to 1.

[Tex]\bold{\int\limits^{\infin}_{-\infin}f(x)dx =1} [/Tex]

  • For continuous random variable X, while calculating the random variable probabilities end values of the interval can be ignored i.e., for X lying between interval a and b

P (a ≤ X ≤ b) = P (a ≤ X < b) = P (a < X ≤ b) = P (a < X < b)

  • Probability density function of a continuous random variable over a single value is zero.

P(X = a) = P (a ≤ X ≤ a) = [Tex]\bold{\int\limits^{a}_{a}f(x)dx} [/Tex] = 0

  • Probability density function defines itself over the domain of the variable and over the range of the continuous values of the variable.

Mean of Probability Density Function

Mean of the probability density function refers to the average value of the random variable. The mean is also called as expected value or expectation. It is denoted by μ or E[X] where, X is random variable.

Mean of the probability density function f(x) for the continuous random variable X is given by:

[Tex]\bold{E[X] = \mu = \int\limits^{\infin}_{-\infin}xf(x)dx} [/Tex]

Median of Probability Density Function

Median is the value which divides the probability density function graph into two equal halves. If x = M is the median then, area under curve from -∞ to M and area under curve from M to ∞ are equal which gives the median value = 1/2.

Median of the probability density function f(x) is given by:

[Tex]\bold{\int\limits^{M}_{-\infin}f(x)dx = \int\limits^{\infin}_{M}f(x)dx=\frac{1}{2}} [/Tex]

Variance Probability Density Function

Variance of probability density function refers to the squared deviation from the mean of a random variable. It is denoted by Var(X) where, X is random variable.

Variance of the probability density function f(x) for continuous random variable X is given by:

Var(X) = E [(X – μ)2] = [Tex]\bold{\int\limits^{\infin}_{-\infin}(x-\mu)^2f(x)dx} [/Tex]

Standard Deviation of Probability Density Function

Standard Deviation is the square root of the variance. It is denoted by σ and is given by:

σ = √Var(X)

Probability Density Function Vs Cumulative Distribution Function

The key differences between Probability Density Function (PDF) and Cumulative Distribution Function (CDF) are listed in the following table:

AspectProbability Density Function (PDF)Cumulative Distribution Function (CDF)
DefinitionThe PDF gives the probability that a random variable takes on a specific value within a certain range.The CDF gives the probability that a random variable is less than or equal to a specific value.
Range of ValuesDefined for continuous random variables.Defined for both continuous and discrete random variables.
Mathematical Expressionf(x), where f(x)≥0 and ∫−∞∞​f(x)dx=1F(x), where 0≤F(x)≤1 for all x, and F(−∞)=0 and F(∞)=1
InterpretationRepresents the likelihood of the random variable taking on a specific value.Represents the probability that the random variable is less than or equal to a specific value.
Area Under the CurveThe area under the PDF curve over a certain interval gives the probability that the random variable falls within that interval.The value of the CDF at a specific point gives the probability that the random variable is less than or equal to that point.
Relationship with CDFThe PDF can be obtained by differentiating the CDF with respect to the random variable.The CDF can be obtained by integrating the PDF with respect to the random variable.
Probability CalculationThe probability of a random variable falling within a specific interval (a,b) is given by ∫ab​f(x)dx.The probability of a random variable being less than or equal to a specific value x is given by F(x).
PropertiesThe PDF is always non-negative: f(x)≥0 for all x.
The total area under the PDF curve is equal to 1.		The CDF is a monotonically increasing function: F(x1​) ≤ F(x2​) if x1​ ≤ x2​.
0≤F(x)≤1 for all x.
ExamplesNormal Distribution PDF:

[Tex]\frac{1}{\sigma \sqrt{2\pi}}e^{-\frac{(x-\mu)^2}{2\sigma^2}} [/Tex]

Exponential distribution PDF: λe−λx		Normal Distribution CDF:

[Tex]\frac{1}{2}\left( 1+ \mathrm{erf}\left( \frac{x-\mu}{\sigma \sqrt{2}} \right) \right) [/Tex]

Exponential distribution CDF: 1−e−λx

Types of Probability Density Function

There are different types of probability density functions given below:

  • Uniform Distribution
  • Binomial Distribution
  • Normal Distribution
  • Chi-Square Distribution

Probability Density Function for Uniform Distribution

The uniform distribution is the distribution whose probability for equally likely events lies between a specified range. It is also called as rectangular distribution. The distribution is written as U(a, b) where, a is the minimum value and b is the maximum value.

Probability Density Function for Uniform Distribution Formula

If x is the variable which lies between a and b, then formula of PDF of uniform distribution is given by:

f(x) = 1/ (b – a)

Probability Density Function for Binomial Distribution

The binomial distribution is the distribution which has two parameters: n and p where, n is the total number of trials and p is the probability of success.

Probability Density Function for Binomial Distribution Formula

Let x be the variable, n is the total number of outcomes, p is the probability of success and q be the probability of failure, then probability density function for binomial distribution is given by:

P(x) = nCx px qn-x

Probability Density Function for Normal Distribution

The normal distribution is distribution that is symmetric about its mean. It is also called as Gaussian distribution. It is denoted as N ([Tex]\bar{x}[/Tex], σ2) where, [Tex]\bar{x}[/Tex]is the mean and σ2 is the variance. The graph of the normal distribution is bell like graph.

Probability density function for Normal distribution or Gaussian distribution Formula

If x be the variable, [Tex]\bar{x}[/Tex] is the mean, σ2 is the variance and σ be the standard deviation, then formula for the PDF of Gaussian or normal distribution is given by:

N ([Tex]\bar{x}[/Tex], σ2) = f(x) = [Tex]\frac{1}{\sigma\sqrt{2\pi}}e^{\frac{-1}{2}[\frac{x – \mu}{\sigma}]^2} [/Tex]

In standard normal distribution mean = 0 and standard deviation = 1. So, the formula for the probability density function of the standard normal form is given by:

f(x) = [Tex]\frac{1}{\sigma\sqrt{2\pi}}e^{\frac{-x^2}{2}} [/Tex]

Probability Density Function for Chi-Squared Distribution

Chi-Squared distribution is the distribution defined as the sum of squares of k independent standard normal form. IT is denoted as X2(k).

Probability Density Function for Chi-Squared Distribution Formula

The probability density function for Chi-squared distribution formula is given by:

f(x) = [Tex]\frac{x^{\frac{k}{2}-1}e^{\frac{-x}{2}}}{2^{\frac{k}{2}}\Gamma(\frac{k}{2})}[/Tex] , x > 0

f(x) = 0, otherwise

Joint Probability Density Function

The joint probability density function is the density function that is defined for the probability distribution for two or more random variables. It is denoted as f(x, y) = Probability [(X = x) and (Y = y)] where x and y are the possible values of random variable X and Y. We can get joint PDF by differentiating joint CDF. The joint PDF must be positive and integrate to 1 over the domain.

Difference Between PDF and Joint PDF

The PDF is the function defined for single variable whereas joint PDF is the function defined for two or more than two variables, and other key differences between these both concepts are listed in the following table:

PDF (Probability Density Function)

Joint PDF

Probability Density Function is the probability function defined for single variable.

Joint Probability Density Function is the probability function defined for more than one variable.

It is denoted as f(x).

It is denoted as f (x, y, …).

Probability Density Function is obtained by differentiating the CDF.

Joint Probability Density Function is obtained by differentiating the joint CDF

It can be calculated by single integral.

It can be calculated using multiple integrals as there are multiple variables.

Applications of Probability Density Function

Some of the applications of Probability Density function are:

  • Probability density functions are used in statistics for calculating probabilities for random variables.
  • It is used in modelling various scientific data.

Read More,

Examples on Probability Density Function

Example 1: If the probability density function is given as: [Tex]\bold{f(x)= \begin{cases} x / 2 & 0\leq x < 4\\ 0 & x\geq4 \end{cases}} [/Tex] . Find P (1 ≤ X ≤ 2).

Solution:

Apply the formula and integrate the PDF.

P (1 ≤ X ≤ 2) = [Tex]\int\limits^{2}_{1}f(x)dx [/Tex]

f(x) = x / 2 for 0 ≤ x ≤ 4

⇒ P (1 ≤ X ≤ 2) = [Tex]\int\limits^{2}_{1}(x/2)dx [/Tex]

⇒ P (1 ≤ X ≤ 2) = [Tex]\frac{1}{2}\times\big [\frac{x^2}{2} \big ]^2_1 [/Tex]

⇒ P (1 ≤ X ≤ 2) = 3 / 4

Example 2: If the probability density function is given as: [Tex]\bold{f(x)= \begin{cases} c(x – 1) & 0 < x < 5\\ 0 & x\geq5 \end{cases}} [/Tex] . Find c.

Solution:

For PDF:

[Tex]\int\limits^{\infin}_{-\infin}f(x)dx = 1\\ \Rightarrow\int\limits^{1}_{-\infin}f(x)dx\hspace{0.1cm}+\hspace{0.1cm} \int\limits^{5}_{1}f(x)dx \hspace{0.1cm}+\hspace{0.1cm} \int\limits^{\infin}_{5}f(x)dx = 1\\ \Rightarrow\int\limits^{1}_{-\infin}0dx\hspace{0.1cm}+\hspace{0.1cm} \int\limits^{5}_{1}c(x-1)dx \hspace{0.1cm}+\hspace{0.1cm} \int\limits^{\infin}_{5}0dx1\\ \Rightarrow 0 \hspace{0.1cm}+\hspace{0.1cm} c \big [\frac{x^2}{2}- x\big]^5_1 +0 =1\\ \Rightarrow c\big [\frac{x^2}{2}- x\big]^5_1\\ \Rightarrow 8c = 1\\ \Rightarrow c = \frac{1}{8} [/Tex]

Example 3: If the probability density function is given as: [Tex]\bold{f(x)= \begin{cases} \frac{5}{2}x^2 & 0\leq x < 2\\ 0 & otherwise \end{cases}} [/Tex] . Find the mean.

Solution:

Formula for mean:

μ = [Tex]\int\limits^{\infin}_{-\infin}xf(x)dx [/Tex]

⇒ μ = [Tex]\int\limits^{1}_{-\infin}x(0) dx\hspace{0.1cm}+\hspace{0.1cm} \int\limits^{2}_{1} x(\frac{5x^2}{2}) dx \hspace{0.1cm}+\hspace{0.1cm} \int\limits^{\infin}_{2}x(0) dx [/Tex]

⇒ μ = [Tex]\frac{5}{2}\big[\frac{x^4}{4}\big]^2_1 [/Tex]

⇒ μ = (5/2) × (15/4)

⇒ μ = 75/8 = 9.375

Example 4: If the probability density function is given as: [Tex]\bold{f(x)= \begin{cases} {2}{}x & 0\leq x < 1\\ 0 & otherwise \end{cases}} [/Tex] . verify if this is a valid probability density function.

To verify that f(x) is a valid PDF, it must satisfy two conditions:

f(x)≥0 for all x.

The integral of f(x) over its entire range must equal 1.

Checking f(x)≥0:

f(x)=2x is clearly non-negative for 0≤x≤10.

Integrating f(x) over its range:∫−∞∞f(x) dx=∫012x dx=[x2]01=12−02=1.[Tex]\int_{-\infty}^{\infty} f(x) \, dx = \int_{0}^{1} 2x \, dx = \left[ x^2 \right]_{0}^{1} [/Tex]

= 12 – 02 = 1.

Since both conditions are satisfied, f(x) is a valid PDF.

Example 5: Given the probability density function f(x)= [Tex]\begin{cases} 3x^2 & \text{if } 0 \leq x \leq 1 \\ 0 & \text{otherwise} \end{cases}[/Tex], find the mean (expected value) of the distribution.

The mean of a continuous random variable X with PDF f(x) is given by:

E(X)= [Tex]\int_{-\infty}^{\infty} x f(x) \, dx[/Tex].

For the given PDF:

E(X)= = [Tex]\int_{0}^{1} x \cdot 3x^2 \, dx[/Tex]

= [Tex]\int_{0}^{1} 3x^3 \, dx [/Tex]

= [Tex]3 \left[ \frac{x^4}{4} \right]_{0}^{1} [/Tex]

= [Tex]3 \cdot \frac{1}{4} [/Tex]

=[Tex] \frac{3}{4} [/Tex]

Example 6: Using the same PDF[Tex] f(x) = \begin{cases} 3x^2 & \text{if } 0 \leq x \leq 1 \\ 0 & \text{otherwise} \end{cases}[/Tex]​, find the variance of the distribution.

The variance of a continuous random variable X is given by:

[Tex]\text{Var}(X) = E(X^2) – [E(X)]^2.[/Tex]

We already have [Tex]E(X) = \frac{3}{4}[/Tex]​.

Now, we need to find E(X2):

[Tex]E(X^2) = \int_{-\infty}^{\infty} x^2 f(x) \, dx[/Tex]

[Tex] = \int_{0}^{1} x^2 \cdot 3x^2 \, dx [/Tex]

[Tex]= \int_{0}^{1} 3x^4 \, dx [/Tex]

[Tex]= 3 \left[ \frac{x^5}{5} \right]_{0}^{1}[/Tex]

[Tex]= 3 \cdot \frac{1}{5} [/Tex]

[Tex]= \frac{3}{5}.[/Tex]

Practice Questions on Probability Density Function

Q 1: Let f(x) be a probability density function given by:

  • f(x) = 2x for 0 ≤ x ≤ 2
  • f(x) = 0 otherwise

Verify that f(x) is a valid probability density function.

Q 2: Let f(x) be a probability density function given by:

  • f(x) = 1/2e-x/2 for x ≥ 0
  • f(x) = 0 for x < 0

Calculate the probability that X ≤ 1.

Q 3: Let f(x) be a probability density function given by:

  • f(x) = 2x2 for 0 ≤ x ≤ 1
  • f(x) = 0 otherwise

Find the cumulative distribution function (CDF) F(x) for x ≥ 0.

Q 4: Given the probability density function f(x) of a continuous random variable X:

  • f(x) = 3(1 – x2) for -1 ≤ x ≤ 1
  • f(x) = 0 otherwise

Find P(0 ≤ X ≤ 1/2)

Q 5: Find the cumulative distribution function (CDF) for the PDF [Tex]f(x) = \begin{cases} 2x & \text{if } 0 \leq x \leq 1 \\ 0 & \text{otherwise} \end{cases}​.[/Tex]

Q 6: Given the function [Tex]f(x) = \begin{cases} k(1-x^2) & \text{if } -1 \leq x \leq 1 \\ 0 & \text{otherwise} \end{cases}[/Tex]​, find the value of k that makes f(x) a valid PDF.

Q 7: Using the same PDF [Tex]f(x) = \begin{cases} \frac{1}{3} e^{-x/3} & \text{if } x \geq 0 \\ 0 & \text{otherwise} \end{cases}otherwise[/Tex]​, find the variance Var(X).

Q 8: Given the PDF [Tex]f(x) = \begin{cases} 3(1-x)^2 & \text{if } 0 \leq x \leq 1 \\ 0 & \text{otherwise} \end{cases}​[/Tex], find the cumulative distribution function (CDF) F(x).

Q 9: For the PDF [Tex]f(x) = \begin{cases} \frac{5}{4}(x – x^2) & \text{if } 0 \leq x \leq 1 \\ 0 & \text{otherwise} \end{cases}[/Tex], calculate the probability that X is between 0.2 and 0.8, i.e., [Tex]P(0.2 \leq X \leq 0.8)[/Tex].

Q 10: For the PDF [Tex]f(x) = \begin{cases} \frac{1}{3} e^{-x/3} & \text{if } x \geq 0 \\ 0 & \text{otherwise} \end{cases}[/Tex]​, calculate the expected value E(X).

Probability Density Function – FAQs

What is a Probability Density Function (PDF)?

The probability density function is the function that defines the density of the probabilities of a continuous random variable over given range. It is denoted by f(x) where, x is the continuous random variable.

How Does a PDF Differ from a PMF?

A PDF is used for continuous random variables, where the probability of any single, exact value is zero. A Probability Mass Function (PMF) is used for discrete random variables, where the probability of specific values can be non-zero.

Write Probability Density Function Formula for Continuous Random Variable X in interval (a, b).

The probability density function formula for the continuous random variable X in interval (a, b):

P (a ≤ X ≤ b) = [Tex]\int\limits^{b}_{a}f(x)dx [/Tex]

What are Necessary Conditions for Probability Density Function?

Necessary conditions for the probability density function are:

  • f(x) ≥ 0, ∀ x ∈ R
  • f(x) should be piecewise continuous.
  • [Tex]\int\limits^{\infin}_{-\infin}f(x)dx = 1 [/Tex]

How to Find Mean of Probability Density Function?

The mean of the probability density function can be calculated by following formula:

E[X] = μ = [Tex]\int\limits^{\infin}_{-\infin}xf(x)dx [/Tex]

Can a PDF Have Negative Values?

No, a PDF cannot have negative values. The value of a PDF for a given point in its domain represents the probability density at that point and must be non-negative.

What Does the Area Under a PDF Represent?

Area under a PDF curve within a certain interval represents the probability that the random variable falls within that interval.

How Do You Find the Mean of a Distribution Using a PDF?

Mean (or expected value) of a distribution using a PDF is found by integrating the product of the variable and its PDF over the entire range of the variable.

What is the Relationship Between PDF and CDF?

Cumulative Distribution Function (CDF) is the integral of the PDF. It represents the probability that the variable takes a value less than or equal to a certain value.

Can a PDF be Greater Than 1?

Yes, a PDF can be greater than 1 for a narrow interval because it represents probability density, not probability. The total area under the PDF curve over all possible values must equal 1.

How is a PDF Normalized?

A PDF is normalized by ensuring that the integral of the PDF over all possible values of the random variable equals 1. This normalization condition ensures that the PDF correctly represents a probability distribution.

How Do You Calculate the Variance from a PDF?

The variance of a distribution from a PDF is calculated by integrating the square of the difference between the variable and its mean, multiplied by the PDF, over the entire range of the variable.

How is the PDF related to the Cumulative Distribution Function (CDF)?

The CDF, F(x)F, is the integral of the PDF from [Tex]-\infty[/Tex] to x: [Tex]F(x) = \int_{-\infty}^{x} f(t) \, dt[/Tex]

Conversely, the PDF is the derivative of the CDF: [Tex]f(x)= \frac{d}{dx}F(x)[/Tex].

What are some applications of PDFs in real life?

PDFs are used in various fields such as:

  1. Economics: Modeling continuous random variables like income levels or stock prices.
  2. Engineering: Reliability analysis and signal processing.
  3. Medicine: Modeling the distribution of biological measurements like blood pressure or reaction times.
  4. Environmental Science: Modeling the distribution of pollutant concentrations.

    		 


    Reffered: https://www.geeksforgeeks.org

    Engineering Mathematics

    Related
    Discrete Mathematics - GATE CSE Previous Year Questions Discrete Mathematics - GATE CSE Previous Year Questions
    matrices in LaTeX matrices in LaTeX
    Euler Graph and Arbitrarily Traceable Graphs in Graph Theory Euler Graph and Arbitrarily Traceable Graphs in Graph Theory
    Galois Fields and Its Properties Galois Fields and Its Properties
    Plotting Functions in Gnuplot Plotting Functions in Gnuplot

    Type:
    		 Geek
    Category:
    		 Coding
    Sub Category:
    		 Tutorial
    Uploaded by:
    		 Admin
    Views:
    		 18



     

    Horje