Help Rescuers Find Missing Persons With Drones and Computer Vision
There's a definite sense that robots are destined to become a critical part of search and rescue missions and disaster relief efforts, working alongside humans to help first responders move faster and more efficiently. And we've seen all kinds of studies that include the claim "this robot could potentially help with disaster relief," to varying degrees of plausibility.
But it takes a long time, and a lot of extra effort, for academic research to actually become anything useful-especially for first responders, where there isn't a lot of financial incentive for further development.
It turns out that if you actually ask first responders what they most need for disaster relief, they're not necessarily interested in the latest and greatest robotic platform or other futuristic technology. They're using commercial off-the-shelf drones, often consumer-grade ones, because they're simple and cheap and great at surveying large areas. The challenge is doing something useful with all of the imagery that these drones collect. Computer vision algorithms could help with that, as long as those algorithms are readily accessible and nearly effortless to use.
The IEEE Robotics and Automation Society and the Center for Robotic-Assisted Search and Rescue (CRASAR) at Texas A&M University have launched a contest to bridge this gap between the kinds of tools that roboticists and computer vision researchers might call "basic" and a system that's useful to first responders in the field. It's a simple and straightforward idea, and somewhat surprising that no one had thought of it before now. And if you can develop such a system, it's worth some cash.
CRASAR does already have a Computer Vision Emergency Response Toolkit (created right after Hurricane Harvey), which includes a few pixel filters and some edge and corner detectors. Through this contest, you can get paid your share of a $3,000 prize pool for adding some other excessively basic tools, including:
Image enhancement through histogram equalization, which can be applied to electro-optical (visible light cameras) and thermal imagery
Color segmentation for a range
Grayscale segmentation for a range in a thermal image
If it seems like this contest is really not that hard, that's because it isn't. "The first thing to understand about this contest is that strictly speaking, it's really not that hard," says Robin Murphy, director of CRASAR. "This contest isn't necessarily about coming up with algorithms that are brand new, or even state-of-the-art, but rather algorithms that are functional and reliable and implemented in a way that's immediately [usable] by inexperienced users in the field."
Murphy readily admits that some of what needs to be done is not particularly challenging at all, but that's not the point-the point is to make these functionalities accessible to folks who have better things to do than solve these problems themselves, as Murphy explains.
"A lot of my research is driven by problems that I've seen in the field that you'd think somebody would have solved, but apparently not. More than half of this is available in OpenCV, but who's going to find it, download it, learn Python, that kind of thing? We need to get these tools into an open framework. We're happy if you take libraries that already exist (just don't steal code)-not everything needs to be rewritten from scratch. Just use what's already there. Some of it may seem too simple, because it IS that simple. It already exists and you just need to move some code around."
If you want to get very slightly more complicated, there's a second category that involves a little bit of math:
Coders must provide a system that does the following for each nadir image in a set:
- Reads the geotag embedded in the .jpg
- Overlays a USNG grid for a user-specified interval (e.g., every 50, 100, or 200 meters)
- Gives the GPS coordinates of each pixel if a cursor is rolled over the image
- Given a set of images with the GPS or USNG coordinate and a bounding box, finds all images in the set that have a pixel intersecting that location
The final category awards prizes to anyone who comes up with anything else that turns out to be useful. Or, more specifically, "entrants can submit any algorithm they believe will be of value." Whether or not it's actually of value will be up to a panel of judges that includes both first responders and computer vision experts. More detailed rules can be found here, along with sample datasets that you can use for testing.
The contest deadline is 16 December, so you've got about a month to submit an entry. Winners will be announced at the beginning of January.