For the past 3 years I have lead development for User Experience in Humanoid Robotic Controls at The National Aeronautics and Space Administration's Johnson Space Center. This work has been extremely rewarding as I have made use of Design, Development, Leadership, and Research skills to create User Interfaces for controlling robots and working with roboticists to create custom tools and features. While I cannot show the application, I am able to share a few Design elements that have made their way into the software in a limited capacity as well as sharing my experience and how I have lead and collaborated with small teams within the Dexterous Robotics Team.
While the main use case for this application is Virtual Reality, we have created an Augmented Reality pass-through view that allows the user to see through the robots vision sensors and by using a Digital twin, align this view with what the user is seeing for immersion and depth perception. The team also made use of several commercial products and integrated into our custom system, these include the Stereolabs Zed mini stereo camera sensor, Bigscreen VR headset, Psyonic Ability Hand and more. Below is a design for the Psyonic Ability Hand controller that can be enabled from the main menu and used to swap to preset positions for specfic tasks. Also developed a Desktop Overwatch Application and a version used to control the robot on the Steam Deck as a mobile controller.
disclaimer ---- these images are not a reflection of the final product, but to get an idea of what the project is.
The Humanoid Robot Valkyrie is the main robot used with this software, so naturally I also had to learn to use and operate this 250 pound marvel. Other robots I have developed with include single arm and dual armed robots on fixed and mobile stations. shout out iMetro Lab.
This image shows an IMAX crew filming me operate before they interviewed me for the Documentary Space: The New Frontier
The use of Robots in space will be for Logistics and taking Astronauts out of harmful environments and enabling them to perform more science from a safe space. Through Direct Tele-Operation and Automated behaviours robots can assist Astronauts to do more. Not only that but terrestial applications such as bomb disposal or rigerous environmental offshore/dangerous location applications.
Ironman Helmet