In 2009, Yu et al. proposed a multimodal probability model (MPM) for clustering. This paper makes advanced clustering constructions on the MPM. We first reconstruct most existing clustering algorithms, such as the k-means, fuzzy c-means, possibilistic c-means, mean shift, classification maximum likelihood, and latent class methods, by establishing the relationships between these clustering algorithms and the MPM. Under our clustering construction, we find that the MPM can be seen as a basic probability model for most existing clustering algorithms. We then construct new clustering frameworks based on the MPM. One of the frameworks develops neW penalized-type clustering algorithms. Another one induces entropy-type clustering algorithms, espe...