Plotting Empirical Cumulative Distributions with Matplotlib

Introduction

This tutorial demonstrates how to plot the empirical cumulative distribution function (ECDF) of a sample and the theoretical CDF using Matplotlib. ECDFs are also known as "non-exceedance" curves in engineering, where the y-value for a given x-value gives the probability that an observation from the sample is below that x-value. Conversely, the empirical complementary cumulative distribution function (the ECCDF, or "exceedance" curve) shows the probability y that an observation from the sample is above a value x.

VM Tips

After the VM startup is done, click the top left corner to switch to the Notebook tab to access Jupyter Notebook for practice.

Sometimes, you may need to wait a few seconds for Jupyter Notebook to finish loading. The validation of operations cannot be automated because of limitations in Jupyter Notebook.

If you face issues during learning, feel free to ask Labby. Provide feedback after the session, and we will promptly resolve the problem for you.

Skills Graph

%%%%{init: {'theme':'neutral'}}%%%% flowchart RL python(("`Python`")) -.-> python/BasicConceptsGroup(["`Basic Concepts`"]) matplotlib(("`Matplotlib`")) -.-> matplotlib/BasicConceptsGroup(["`Basic Concepts`"]) matplotlib(("`Matplotlib`")) -.-> matplotlib/PlottingDataGroup(["`Plotting Data`"]) matplotlib(("`Matplotlib`")) -.-> matplotlib/PlotCustomizationGroup(["`Plot Customization`"]) python(("`Python`")) -.-> python/ControlFlowGroup(["`Control Flow`"]) python(("`Python`")) -.-> python/DataStructuresGroup(["`Data Structures`"]) python(("`Python`")) -.-> python/ModulesandPackagesGroup(["`Modules and Packages`"]) python(("`Python`")) -.-> python/PythonStandardLibraryGroup(["`Python Standard Library`"]) python(("`Python`")) -.-> python/DataScienceandMachineLearningGroup(["`Data Science and Machine Learning`"]) python(("`Python`")) -.-> python/FunctionsGroup(["`Functions`"]) python/BasicConceptsGroup -.-> python/comments("`Comments`") matplotlib/BasicConceptsGroup -.-> matplotlib/importing_matplotlib("`Importing Matplotlib`") matplotlib/BasicConceptsGroup -.-> matplotlib/figures_axes("`Understanding Figures and Axes`") matplotlib/PlottingDataGroup -.-> matplotlib/line_plots("`Line Plots`") matplotlib/PlottingDataGroup -.-> matplotlib/histograms("`Histograms`") matplotlib/PlotCustomizationGroup -.-> matplotlib/legend_config("`Legend Configuration`") matplotlib/PlotCustomizationGroup -.-> matplotlib/grid_config("`Grid Configuration`") python/BasicConceptsGroup -.-> python/booleans("`Booleans`") python/ControlFlowGroup -.-> python/for_loops("`For Loops`") python/DataStructuresGroup -.-> python/lists("`Lists`") python/DataStructuresGroup -.-> python/tuples("`Tuples`") python/ModulesandPackagesGroup -.-> python/importing_modules("`Importing Modules`") python/ModulesandPackagesGroup -.-> python/standard_libraries("`Common Standard Libraries`") python/PythonStandardLibraryGroup -.-> python/math_random("`Math and Random`") python/DataScienceandMachineLearningGroup -.-> python/numerical_computing("`Numerical Computing`") python/DataScienceandMachineLearningGroup -.-> python/data_visualization("`Data Visualization`") python/FunctionsGroup -.-> python/build_in_functions("`Build-in Functions`") subgraph Lab Skills python/comments -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} matplotlib/importing_matplotlib -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} matplotlib/figures_axes -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} matplotlib/line_plots -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} matplotlib/histograms -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} matplotlib/legend_config -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} matplotlib/grid_config -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} python/booleans -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} python/for_loops -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} python/lists -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} python/tuples -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} python/importing_modules -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} python/standard_libraries -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} python/math_random -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} python/numerical_computing -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} python/data_visualization -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} python/build_in_functions -.-> lab-48769{{"`Plotting Empirical Cumulative Distributions with Matplotlib`"}} end

Import the necessary libraries

In this step, we will import the necessary libraries. We will be using the NumPy and Matplotlib libraries for this tutorial.

import matplotlib.pyplot as plt
import numpy as np

Set the random seed and generate the data

In this step, we will set the random seed and generate the data. We will generate 100 data points from a normal distribution with a mean of 200 and a standard deviation of 25.

np.random.seed(19680801)
mu = 200
sigma = 25
data = np.random.normal(mu, sigma, size=100)

Create the figure and subplots

In this step, we will create a figure with two subplots for the cumulative distributions. We will also set the figure size to 9x4.

fig = plt.figure(figsize=(9, 4), layout="constrained")
axs = fig.subplots(1, 2, sharex=True, sharey=True)

Plot the cumulative distributions

In this step, we will plot the cumulative distributions. We will use the .ecdf method to plot the ECDF and the complementary ECDF. We will also plot the theoretical CDF using a normal distribution with a mean of 200 and a standard deviation of 25.

## Cumulative distributions
axs[0].ecdf(data, label="CDF")
n, bins, patches = axs[0].hist(data, 25, density=True, histtype="step",
                               cumulative=True, label="Cumulative histogram")
x = np.linspace(data.min(), data.max())
y = ((1 / (np.sqrt(2 * np.pi) * sigma)) *
     np.exp(-0.5 * (1 / sigma * (x - mu))**2))
y = y.cumsum()
y /= y[-1]
axs[0].plot(x, y, "k--", linewidth=1.5, label="Theory")

## Complementary cumulative distributions
axs[1].ecdf(data, complementary=True, label="CCDF")
axs[1].hist(data, bins=bins, density=True, histtype="step", cumulative=-1,
            label="Reversed cumulative histogram")
axs[1].plot(x, 1 - y, "k--", linewidth=1.5, label="Theory")

Label the figure

In this step, we will label the figure. We will add a title, gridlines, and labels for the x and y axes.

fig.suptitle("Cumulative Distributions")
for ax in axs:
    ax.grid(True)
    ax.legend()
    ax.set_xlabel("Annual rainfall (mm)")
    ax.set_ylabel("Probability of occurrence")
    ax.label_outer()

plt.show()

Summary

In this tutorial, we learned how to plot the empirical cumulative distribution function (ECDF) and the theoretical CDF using Matplotlib. We also learned how to plot the empirical complementary cumulative distribution function (ECCDF) and the reversed cumulative histogram. By following the steps outlined in this tutorial, you should now be able to create your own cumulative distribution plots using Matplotlib.