Magnetic properties of molecules such as magnetizabilities represent second order derivatives of the energy with respect to external perturbations. To avoid the need for analytic second derivatives and thereby permit evaluation of the performance of methods where they are not available, a new implementation of quantum chemistry calculations in finite applied magnetic fields is reported. This implementation is employed for a collection of small molecules with the aug-cc-pVTZ basis set to assess orbital optimized (OO) MP2 and a recently proposed regularized variant of OOMP2, called κ-OOMP2. κ-OOMP2 performs significantly better than conventional second order Møller-Plesset (MP2) theory, by reducing MP2's exaggeration of electron correlation e...