Virtual Temperature Control in Unity Environment With Ml Agents

In this paper, an innovative approach to controlling temperature was made. Using Unity as our chosen platform, we crafted a virtual environment, that replicates the real-world temperature change dynamics. For this, a virtual environment mimics an enclosed area with a virtual heat source. Additionally, this environment’s area and air density were also taken into consideration. Then, a virtual sensor and cooler were added for detecting and adjusting the environment temperature. Finally, the ML agent package was integrated for controlling temperature with RL. This integration consisted of adding a script that inherits from the agent class and has environment, sensor, and cooler as variables. In each epi-sode, there was a time duration in which both environment's temperature change was calculated and the reward was set to be given only when the environment's temperature was at a certain range. The empirical findings show the efficiency of our approach, show-casing the system's ability to adapt and optimize temperature regulation parameters over successive iterations. By successfully integrating Unity and ML agents, our study under-scores the transformative potential of harnessing virtual environments and machine learning for advancing temperature control technologies.