Speaker identification based on user context

Recognition of a person that issued a voice command is necessary for a device that implements a voice-based user interface to respond to the user command. This disclosure describes techniques that can be implemented by devices that provide a voice-based user interface, e.g., a smart home speaker, an appliance, etc. to recognize the identity of a person that issues a voice command. With user permission, user context data is obtained and used to determine the identity of the person. Such data can include, with user permission, location data, recent activity data, user interests, etc. Improvement in the identification of the person issuing a voice command enables the devices to provide an improved user experience