Researchers develop artificial intelligence system to watch you through walls

June 14, 2018

Researchers have developed an artificial intelligence (AI) system which is able to see through walls.

The creators of the AI, a team of scientists from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), say the project, RF-Pose, could be used in the monitoring of disease and the health of the elderly.

In a paper documenting the research, MIT says the AI uses a neural networking to teach wireless devices to sense the posture and movement of people, “even from the other side of a wall.”

This kind of X-ray vision may seem far-fetched, but the team, led by Professor Dina Katabi, says that the neural network is able to analyze the radio signals which bounce off bodies in order to create a digital, dynamic figure of where the individual is—and what pose they are striking.

In order to demonstrate the AI’s capabilities, MIT programmed RF-Pose to create and control a stick figure which is able to sit, stand, and move its limbs at the same time the test subject is moving.

The majority of today’s neural networks are trained by data labeled by hand. However, radio signal-based training was more of a challenge.

In order to teach the AI how to interpret these signals, the scientists collected examples from wireless devices and camera, gathering thousands of samples based on people conducting everyday activities.

Images were extracted from the camera to show the network, alongside corresponding radio signals.

RF-Pose was then able to estimate posture and movement without the help of cameras—but being able to do so through a wall was a surprise to MIT, which did not anticipate that the system could generalize its knowledge to handle through-wall movements.

According to MIT, the invention has practical uses beyond fulfilling sci-fi dreams. For example, the AI could be used to discreetly monitor the elderly and allow them to live independently—while monitoring for falls or accidents.

However, it may also have a deeper purpose in the medical field, and RF-Pose may have worth in studying and monitoring the progression of diseases such as Parkinson’s, multiple sclerosis (MS), and muscular dystrophy.

The team is currently working on upgrading 2D figure outputs to three-dimensional representations and is also working with medical professionals to explore the technology’s applications in healthcare.

ZDNet has the full story

Sponsored Recommendations

A Cyber Shield for Healthcare: Exploring HHS's $1.3 Billion Security Initiative

Unlock the Future of Healthcare Cybersecurity with Erik Decker, Co-Chair of the HHS 405(d) workgroup! Don't miss this opportunity to gain invaluable knowledge from a seasoned ...

Enhancing Remote Radiology: How Zero Trust Access Revolutionizes Healthcare Connectivity

This content details how a cloud-enabled zero trust architecture ensures high performance, compliance, and scalability, overcoming the limitations of traditional VPN solutions...

Spotlight on Artificial Intelligence

Unlock the potential of AI in our latest series. Discover how AI is revolutionizing clinical decision support, improving workflow efficiency, and transforming medical documentation...

Beyond the VPN: Zero Trust Access for a Healthcare Hybrid Work Environment

This whitepaper explores how a cloud-enabled zero trust architecture ensures secure, least privileged access to applications, meeting regulatory requirements and enhancing user...