Success in human-agent interaction will to a large extent depend on the ability of the system to cooperate with humans over repeated tasks. It is not yet clear how cooperation between humans and virtual agents evolves and is interlinked with the attribution of qualities like trustworthiness or competence between the cooperation partners. To explore these questions, we present a new interaction game framework that is centered around a collaborative puzzle game and goes beyond commonly adopted scenarios like the Prisoner’s dilemma. First results are presented at the conference.