Skip to main content

Robot Inspiration Series #6: Computer-Interacting Robots

This week's Robot Inspiration might sound a little advanced: make a robot that interacts with the computer. However, this can actually be quite easy, while opening up a host of new applications. As I posted about here and here, you can use RoboRealm to easily make robots interact with the computer in a variety of ways. Now RoboRealm has added more computer capability to their software.

Keyboard: Besides taking input from the keyboard, you can make a robot control the keyboard. In other words, I could have my robot write a post on this blog! In terms of taking input from the keyboard, here's a video of a "NXT Messenger" I made using RoboRealm. With the range of BT, I can type a message up here in my room, and my mom can read it in the kitchen, two floors down, on the NXT brick!

(sorry for the low quality of the NXT screen... putting the video in the blogger player made it much harder to read the text on the NXT screen)

Mouse: Now RoboRealm lets you get the coordinates of a computer mouse and even control the mouse. Here's a video of my computer mouse controlling a cursor on the NXT screen:


EDIT: You can get the two .robo (RoboRealm) files here and here (to get them you'll need to right-click->Save Target As). You can get the two NXT-G programs here and here. Just to clarify what goes on, the .robo files read inputs from the computer and send the data to the NXT brick via BT, and the NXT-G files recieve the data and control the actual behaviors of the NXT Brick.

EDIT 2: You can get the My Block for the Keyboard NXT-G program here.

Popular posts from this blog


2023 is the 25th Anniversary of the MINDSTORMS brand. For 25 years, MINDSTORMS has educated and inspired a generation of robot builders, both children and adults. Unfortunately, the LEGO Group decided to end the line on December 2022. Many ROBOTMAK3RS have been passionately involved with the development of MINDSTORMS through the MUP and MCP programs. Even with the newest Robot Inventor line, several ROBOTMAK3RS were invited to submit additional bonus models that were included in the official app. Regardless of the retirement of a major LEGO robotics product line, ROBOTMAK3RS continue to MAKE-SHARE-INSPIRE using all LEGO robotics platforms available to us. Here is the official statement from LEGO. Since its launch in September 1998, LEGO MINDSTORMS has been one of the core ‘Build & Code’ experiences in the company’s portfolio, carrying with it significant brand equity and becoming a stand-out experience for the early days of consumer robotics and leading to current Build & Code

Celebrating MINDSTORMS with a Remix Part 1

In honor of the 25th Anniversary of MINDSTORMS, we asked ROBOTMAK3RS to combine a LEGO set of their choice with a MINDSTORMS set. Here is what these five ROBOTMAK3RS came up with.  MINDSTORMS Chess Assistant by Arvind Seshan Overview: When you are new to chess, it can be a challenge to remember which pieces go where. Now, you can use machine learning and LEGO MINDSTORMS Robot Inventor to build a tool to help you learn where all the chess pieces go on the chess board. Sets used: LEGO® Iconic Chess Set (40174) and MINDSTORMS Robot Inventor (51515) Review: I really like how the chess set base can store all the pieces underneath and that the board neatly splits in half for handy storage. The chess pieces themselves are very sturdy and well built. My only criticism is the building of the box itself. It was quite difficult to see what pieces to use and since the entire box is made mostly of thin plates, it took a lot of time and patience. I would have liked the storage area to be sliding dra

Celebrating 25 Years of MINDSTORMS

In celebration of the 25th Anniversary of MINDSTORMS, we take a trip through history. Please also visit ROBOTMAK3RS Community every week as we highlight different projects all through 2023 in celebration of the anniversary. Some of the early history is based on the content shared by  Coder Shah  in our  MINDSTORMS EV3 Community Group . Some of the text and links may have been edited from his original posts for consistency and clarity.  1984 - Kjeld Kirk Kristiansen watched a TV program called "Talking Turtle," where MIT professor Seymour Papert demonstrated how children could control robot "turtles" using LOGO, a programming language he developed. 1988 - The collaboration between MIT and LEGO resulted in LEGO TC Logo in 1988, which allowed students to control LEGO models using computer commands. The video shows Papert demonstrating TC Logo. 1990 - LEGO TC Logo was hampered since the robots you built had to be tethered to a personal computer. LEGO and MIT