Unity_Robot_Playgrounds

Install ML-Agents package

1. navigating to the menu Window -> Package Manager.
2. In the package manager window click on the + button on the top left of the packages list).
3. Select Add package from disk...
4. Navigate into the ./MLAgents_4.0/com.unity.ml-agents folder.
5. Select the package.json file.

• [NOTE] This step is required for each Unity Project.

---

Setup a conda environment

conda create -y -n mlagents python=3.10.12
conda activate mlagents


pip install mlagents==1.1.0
pip install ipykernel ipywidgets
pip install torchvision torchaudio

---

Test packages

Package	Version
Unity	6000.2.4.f1
ML-Agents (Unity package)	Release 23 [4.0.0]
mlagent (python package)	1.1.0

---

Playgrounds

Playground	Screenshot	Unity Project	Notebook-Python API	Notebook-ML Agents
3D Ball		3DBall	3DBall.ipynb	3DBall_ml.ipynb
GridWorld		GridWorld	GridWorld_DQN.ipynb	GridWorld_ml.ipynb
			GridWorld_A2C.ipynb
Drone		Drone	Drone_DDPG.ipynb	Drone_ml.ipynb
Kart		Kart	Kart_BC.ipynb	Kart_ml.ipynb
				Kart_BC_ml.ipynb
				Kart_BC_GAIL_ml.ipynb
Dodge		Dodge	Dodge_Random_PPO.ipynb	Dodge_ml.ipynb
			Dodge_Curriculum_PPO.ipynb
Dodge-Attention		Dodge_Attention	Dodge_Attention_PPO.ipynb	Dodge_Attention_ml.ipynb
Pong		Pong	Pong_Adversarial.ipynb	Pong_Adversarial_ml.ipynb
EscapeRoom		EscapeRoom	EscapeRoom_MAPOCA.ipynb	EscapeRoom_MAPOCA_ml.ipynb
Maze		Maze	Maze_RND_PPO.ipynb	Maze_RND_PPO_ml.ipynb
TwoMission		TwoMission	TwoMission_PPO.ipynb	TwoMission_Hyper_ml.ipynb
			TwoMission_HyperPPO.ipynb
Crawler		Crawler		Crawer_ml.ipynb
				Crawer_BC_ml.ipynb
Walker		Walker		Walker_ml.ipynb
Worm		Worm		Worm_ml.ipynb
SoccerTwos		Soccer		SoccerTwos_ml.ipynb
StrikersVsGoalie		Soccer		StrikersVsGoalie_ml.ipynb

---

Reference:

• Papers:

  • ....

• Blog:

  • https://docs.unity3d.com/Packages/com.unity.ml-agents@4.0/manual/Installation.html#advanced-local-installation-for-development
  • https://docs.unity3d.com/Packages/com.unity.ml-agents@4.0/manual/Learning-Environment-Examples.html
  • https://unity-technologies.github.io/ml-agents/Training-ML-Agents/
  • https://unity-technologies.github.io/ml-agents/Training-Configuration-File/

• Github:

  • https://github.com/Unity-Technologies/ml-agents
  • https://github.com/reinforcement-learning-kr/Unity_ML_Agents_2.0