[Plant Simulation Study #05] – Controlling Plant Simulation with an Xbox Controller via Socket Communication

🧪 [Plant Simulation Study #05] – Controlling Plant Simulation with an Xbox Controller via Socket Communication

🎬 Overview

In this demo, I integrated Plant Simulation with an Xbox game controller using socket communication.
The goal is not just to passively observe simulations but to interactively control simulation objects in real time using an external device.
This makes the simulation experience more dynamic and hands-on for both experimentation and demonstration purposes.

• Purpose: Test real-time control using an external device
• Tech Stack: Python + Xbox Controller + Socket Communication + Plant Simulation
• Simulation Tools Used: Method, SocketClient object in Plant Simulation

🎥 Demo Video
🔗 https://youtu.be/wE22Czmx6lM

 

---

🛠️ Simulation Architecture & Communication Flow

ComponentDescription

Input Device	Xbox controller (data received via Python script)
Middle Layer	Python socket server processes directional inputs
Simulation	Plant Simulation connects to Python server and receives movement commands
Controlled Object	MU or 3D robot joints (position and speed controlled in real time)

 

---

🔧 Key Implementation Details

1. Python Layer
   Use libraries like pygame or inputs to detect Xbox controller inputs.
   The data is sent via TCP socket as strings to the simulation.
2. Plant Simulation Side
   Use SocketClient to receive data and update the simulation dynamically.
   Here's how message parsing and joint motion control is implemented:

 

// writes the value to the global variable ’MessageReceived’
if strLen(SocketMessage) = 0
    MessageReceived := to_str(strAscii(SocketMessage)); // byte received
else
    MessageReceived := to_str(SocketMessage); // string received
end

• Motion Execution (based on socket command)
  Below is the structure for controlling 3D robot joints using the received command:

-- param attribute: string, oldValue, newValue: string
-- param attribute: string, oldValue: string
param newValue: string

switch newValue
case "UP,1"

	if 현재로봇 = void or 현재_제어축 = ""
		messagebox("로봇과 제어축을 다시 확인해주세요.")
		return
	end

	switch 현재_제어축
	case "J1"
		현재로봇.J1 := 현재로봇.J1 + 이동값
		var J1_num := 현재로봇.J1

		현재로봇._3D.getobject("J1").moveTo(J1_num)
	case "J2"
		현재로봇.J2 := 현재로봇.J2 + 이동값
		var J2_num := 현재로봇.J2
		현재로봇._3D.getobject("J1").getobject("J2").moveTo(J2_num)
	case "J3"
		현재로봇.J3 := 현재로봇.J3 + 이동값
		var J3_num := 현재로봇.J3
		현재로봇._3D.getobject("J1").getobject("J2").getobject("J3").moveTo(J3_num)
	case "J4"
		현재로봇.J4 := 현재로봇.J4 + 이동값
		var J4_num := 현재로봇.J4
		현재로봇._3D.getobject("J1").getobject("J2").getobject("J3").getobject("J4").moveTo(J4_num)
	case "J5"
		현재로봇.J5 := 현재로봇.J5 + 이동값
		var J5_num := 현재로봇.J5
		현재로봇._3D.getobject("J1").getobject("J2").getobject("J3").getobject("J4").getobject("J5").moveTo(J5_num)
	case "J6"
		현재로봇.J6 := 현재로봇.J6 + 이동값
		var J6_num := 현재로봇.J6
		현재로봇._3D.getobject("J1").getobject("J2").getobject("J3").getobject("J4").getobject("J5").getobject("J6").moveTo(J6_num)
	end
case "UP,-1"

	if 현재로봇 = void or 현재_제어축 = ""
		messagebox("로봇과 제어축을 다시 확인해주세요.")
		return
	end

	switch 현재_제어축
	case "J1"
		현재로봇.J1 := 현재로봇.J1 - 이동값
		var J1_num1 := 현재로봇.J1
		현재로봇._3D.getobject("J1").moveTo(J1_num1)
	case "J2"
		현재로봇.J2 := 현재로봇.J2 - 이동값
		var J2_num1 := 현재로봇.J2
		현재로봇._3D.getobject("J1").getobject("J2").moveTo(J2_num1)
	case "J3"
		현재로봇.J3 := 현재로봇.J3 - 이동값
		var J3_num1 := 현재로봇.J3
		현재로봇._3D.getobject("J1").getobject("J2").getobject("J3").moveTo(J3_num1)
	case "J4"
		현재로봇.J4 := 현재로봇.J4 - 이동값
		var J4_num1 := 현재로봇.J4
		현재로봇._3D.getobject("J1").getobject("J2").getobject("J3").getobject("J4").moveTo(J4_num1)
	case "J5"
		현재로봇.J5 := 현재로봇.J5 - 이동값
		var J5_num1 := 현재로봇.J5
		현재로봇._3D.getobject("J1").getobject("J2").getobject("J3").getobject("J4").getobject("J5").moveTo(J5_num1)
	case "J6"
		현재로봇.J6 := 현재로봇.J6 - 이동값
		var J6_num1 := 현재로봇.J6
		현재로봇._3D.getobject("J1").getobject("J2").getobject("J3").getobject("J4").getobject("J5").getobject("J6").moveTo(J6_num1)
	end

case "A,1"
	if 현재로봇.empty = false
	else
		pick.mu.move(현재로봇)
	end

case "B,1"
	if 현재로봇.empty = true
		else
		현재로봇.mu.move(place)
	end
case "X,1"
	switch 이동값
	case 1
		이동값 := 2
	case 2
		이동값 := 3
	case 3
		이동값 := 5
	case 5
		이동값 := 10
	case 10
		이동값 := 30
	case 30
		이동값 := 90
	case 90
		이동값 := 1
	end
case "Y,1"
	switch 현재_제어축
	case ""
		현재_제어축 := "J1"
	case "J1"
		현재_제어축 := "J2"
	case "J2"
		현재_제어축 := "J3"
	case "J3"
		현재_제어축 := "J4"
	case "J4"
		현재_제어축 := "J5"
	case "J5"
		현재_제어축 := "J6"
	case "J6"
		현재_제어축 := "J1"
	end
end

---

📈 Experiment Results & Applications

This goes far beyond a simple demo. Possible applications include:

• Real-time simulation tests integrated with external machines or logistics devices
• Virtual commissioning of robotic systems
• Creating interactive simulation models for training or demos
• Testing digital twins with physical control input

---

🧠 Final Thoughts

While the Xbox controller was used in this example, the architecture supports any external device — including sensors, mobile apps, keyboards, or industrial controllers.
This approach shows how Plant Simulation can be used not just as an analysis tool but as a real-time experimentation and feedback platform.
More integrations are coming soon — stay tuned!