In the Standard Model, the ground state of the Higgs field is not found at zero but instead corresponds to one of the degenerate solutions minimising the Higgs potential. In turn, this spontaneous electroweak symmetry breaking provides a mechanism for the mass generation of nearly all fundamental particles. The Standard Model makes a definite prediction for the Higgs boson self-coupling and thereby the shape of the Higgs potential. Experimentally, both can be probed through the production of Higgs boson pairs (\textit{HH}), a rare process that presently receives a lot of attention at the LHC. In this article, the latest \textit{HH} searches by the ATLAS experiment are summarised, with emphasis on the results obtained with the full LHC Run 2...