https://github.com/miyosuda/evolution_and_ai/tree/master/multi_agent_emergence My conda env: hide-and-seek Also,It looks like a recent release of pyglet cloud break gym. I downgraded pyglet to 1.3.2 for the colabs, and it should work now.