What are some open problems in agent foundations research which might be appropriate for a PhD?

We don't have an answer for this question yet. Would you like to write one?