Modeling implied volatility surface (IVS) is of paramount importance to price and hedge an option. The literature is abundant in predicting realized volatility and the VIX using time series models, but lack in predicting the whole IVS. Machine learning architectures have shown strengths in learning option pricing formulas and estimating implied volatility cross-sectionally. We attempt to bridge the gap between machine learning-based implied volatility modeling and multivariate multi-step implied volatility forecasting. We contribute to the literature by modeling the entire IVS using recurrent neural network architectures, namely Convolutional Long Short Term Memory Neural Network (ConvLSTM) to produce multivariate and multi-step forecasts o...