Utilizing Computer Vision to Inform Real-Time Simulations and Controlling Embedded Systems Using Various Wireless Techniques

Abstract

The field of robotics is filled with many interwoven concepts, each with their own niche yet relevant function which serves a higher abstracted purpose. At the University of Kansas Robotics Organization (KURO), we offer students the freedom to explore these underlying concepts in self contained and interesting projects. As such, in this paper, we will recount the methodology and results of combining a wide array of topics together for an insightful yet novel goal of recreating a carnival game with a twist: A shooting gallery but your finger is the gun. Such topics include web socket communication, advanced hand tracking hardware, game development software, RF communication between multiple embedded systems, and real time computer vision. Along with this, but not necessarily relevant to Telemetry, we will discuss the manufacturing considerations, for optimizing speed and stability, as the entire project had a strict time constraint of 48 hours to create a working demo to be judged.