{"id":2874,"date":"2018-10-02T11:36:24","date_gmt":"2018-10-02T11:36:24","guid":{"rendered":"http:\/\/bestdroneforthejob.com\/?p=2874"},"modified":"2019-02-16T19:56:52","modified_gmt":"2019-02-16T19:56:52","slug":"flying-drone-using-eye-tracking-glasses","status":"publish","type":"post","link":"https:\/\/bestdroneforthejob.com\/blog\/flying-drone-using-eye-tracking-glasses\/","title":{"rendered":"Latest Drone Tech: Flying a Drone Using Eye-Tracking Glasses"},"content":{"rendered":"

One of the goals of drone companies like DJI is making drone flying as simple as possible. <\/p>\n

Using a wireless controller is still the most common method of flying a drone. But manufacturers have added all sorts of features to make drone control easier. <\/p>\n

Take DJI drones for instance. They have automatic obstacle-detection and evasion technology as well as different intelligent flight modes<\/a>. <\/p>\n

You can shoot a full video or take pictures without having to touch the joysticks. <\/p>\n

A new type of drone technology is promising to make drone control even easier and eliminate the need for intensive UAV training. <\/p>\n

Developed by experts from the University of Pennsylvania, New York University and the U.S. Army Research Laboratory, the new technology uses eye movements to guide the drone. <\/p>\n

Gaze-Controlled Drones<\/h2>\n

The idea of controlling drones using your eyes is not new<\/a>.<\/p>\n

This one stands out for its simplicity and lack of dependence on external equipment. <\/p>\n

Other gaze-controlled drones rely on external sensors to detect the position and orientation of the user as well as the drone. <\/p>\n

This one is completely self-contained.<\/p>\n

You only need a pair of Tobii Pro Glasses 2<\/a>. <\/p>\n

\"Tobii<\/p>\n

The glasses have eye-tracking cameras, a wide angle HD camera and an inertial measurement unit<\/a> (IMU) consisting of an accelerometer and gyroscope. <\/p>\n

Because the glasses don\u2019t have a lot of processing power, they are connected to a portable computational unit, the NVIDIA Jetson TX2 Module<\/a>.<\/p>\n

And that\u2019s all you need plus the drone of course. No controller required. <\/p>\n

How It Works<\/h2>\n

You start by looking directly at the drone. The glasses follow your gaze and use artificial intelligence to identify the drone. <\/p>\n

They then calculate the position of the drone and its distance from you. <\/p>\n

After that, you just need to move your eyes to a specific location and the drone will follow. <\/p>\n

The cameras in the glasses track your pupils\u2019 movements that are then translated into actual navigational instructions for the drone. <\/p>\n

All the while, the glasses keep tracking the drone\u2019s position and orientation. <\/p>\n

The system works surprisingly well as you can see in this video. <\/p>\n