Measurements of starlight polarized by aligned interstellar dust grains are used to probe the relation between the orientation of the ambient interstellar magnetic field (ISMF) and the ISMF traced by the ribbons of energetic neutral atoms discovered by the Interstellar Boundary Explorer spacecraft. We utilize polarization data, many acquired specifically for this study, to trace the configuration of the ISMF within 40 pc. A statistical analysis yields a best-fit ISMF orientation, B (magpol), aligned with Galactic coordinates l = 42 degrees, b = 49 degrees. Further analysis shows the ISMF is more orderly for "downfield" stars located over 90 degrees from B (magpol). The data subset of downfield stars yields an orientation for the nearby ISMF...