To process faces, the cerebral cortex of humans and other primates has evolved dedicated areas, especially in occipito-temporal areas, in which face-selective cells underlie face identification or discrimination. Some neurons responding to faces have also been described beyond this core face processing areas. In the human hippocampus, neurons responding to faces are thought to underlie identity relevant information. Less well understood face-responsive neurons are present in the orbitofrontal cortex. We focus on different aspects of face processing in the hippocampus and the orbitofrontal cortex shedding light on the role of regions beyond the core occipito-temporal regions processing faces. For example, we showed how the activity of face selective cells in the orbitofrontal cortex encode several face dimensions that provide information about social categories and emotions. We now explore how these activities are modulated during live interactions.