Context. Young, close stars are ideal targets for searching planets using the direct imaging technique. The determination of stellar parameters is crucial for the interpretation of imaging survey results, particularly since the luminosity of substellar objects has a strong dependence on system age. Aims. We have conducted a large program with NaCo at the VLT to search for planets and brown dwarfs in wide orbits around 86 stars. A large fraction of the targets observed with NaCo were poorly investigated in the literature. We performed a study to characterize the fundamental properties (age, distance, and mass) of the stars in our sample. To improve target age determinations, we compiled and analyzed a complete set of age diagnostics. Methods...