Agents that are able to build relationships with the people they are interacting with are envisioned to be more successful in long-term interactions. Small talk about impersonal topics has been found an adequate tool in human-agent interactions for manipulation of such relationships. We suspect that an agent and the interaction with it will be evaluated even more positively when the agent talks about personal information it remembers about its interlocutor from previous encounters. In this paper a model of person memory that provides virtual agents with information needed in social conversations is presented. An interaction study demonstrates the impact of personal information in human-agent conversations and validates the performance of our model.