Data Driven Inference in Populations of Agents