Graphical representation of the generative model and model summary.

Left: We illustrate here the conditional dependence of state durations, states, reward probabilities, and outcomes. Note that the choices ct are treated as observables within the generative model. Right: summary of the hidden state variables, observations, and the notation used for defining prior expectations and posterior beliefs over hidden states.