Multi-head attention.

Deep foundation pit settlement prediction based on machine learning is widely used for ensuring the safety of construction, but previous studies are limited to not fully considering the spatial correlation between monitoring points. This paper proposes a transformer-based deep learning method that considers both the spatial and temporal correlations among excavation monitoring points. The proposed method creates a dataset that collects all excavation monitoring points into a vector to consider all spatial correlations among monitoring points. The deep learning method is based on the transformer, which can handle the temporal correlations and spatial correlations. To verify the model’s accuracy, it was compared with an LSTM network and an RNN-LSTM hybrid model that only considers temporal correlations without considering spatial correlations, and quantitatively compared with previous research results. Experimental results show that the proposed method can predict excavation deformations more accurately. The main conclusions are that the spatial correlation and the transformer-based method are significant factors in excavation deformation prediction, leading to more accurate prediction results.