Context. With the advent of next generation high resolution telescopes, our understanding of how the magnetic field is organized in the internetwork (IN) photosphere is likely to advance significantly. Aims. We aim to evaluate the extent to which we can retrieve accurate information about the magnetic vector in the IN photosphere using inversion techniques. Methods. We use a snapshot produced from high resolution three-dimensional magnetohydrodynamic (MHD) simulations and employ the Stokes Inversions based on Response functions (SIR) code to produce synthetic observables in the same near infrared spectral window as observed by the GREGOR Infrared Spectrograph (GRIS), which contains the highly magnetically sensitive photospheric Fe I line pa...