Wild Nature Institute, Penn State, and Microsoft Azure Work Together to Find the Giraffe in the Bushes

Giraffe are the tallest animal on earth, so naturally scientists have turned to big data solutions for giraffe conservation.  Researchers from Penn State and Wild Nature Institute are conducting one of the biggest large mammal studies ever undertaken by studying births, deaths, and movements of more than 3,000 giraffes across a 4,000 square kilometre landscape in the Tarangire Ecosystem of northern Tanzania, East Africa.

Dr. Derek E. Lee, Associate Research Professor at Penn State University’s Department of Biology and Principal Scientist of the Wild Nature Institute said, “These are big animals, and they cover big distances, so naturally we are using big data to learn where they are doing well, where they are not, and why, so we can protect and connect the areas important to giraffe conservation.”

Giraffe populations have declined precipitously across Africa due to habitat loss and illegal killing for meat. “We needed new tools to figure out how we can save giraffes, and there was a harmonic conjunction of technology that made our work possible,” said Lee.
Lee’s team uses digital photographs of each animal’s unique and unchanging spot patterns to identify them throughout their lives. However, the analysis process is very manually intensive and time-consuming. Many thousands of photos have to be processed per year, and for every photo the giraffe body in the image has to be manually cropped to provide just a giraffe torso to the pattern recognition software. To improve this process, Microsoft scientists have provided a new image processing service using machine learning technology deployed on the Microsoft Azure cloud.

Using a computer vision object detection algorithm, the Microsoft team trained a program to recognize giraffe torsos using some existing annotated giraffe photos. The program was iteratively improved using an efficient Active Learning process, where the system identified new images and showed its predicted cropping squares on these images to a human who could quickly verify or correct the results. These new images were then fed back into training algorithm to further update and improve the program.  The resulting system identifies the location of giraffe torsos in images with a very high accuracy. A description of the work was published this week in the journal Ecological Informatics.
The new system dramatically speeds up the important research being performed by the giraffe scientists. “It is wonderful how the Azure team automated this tedious aspect of our work,” said Lee. “It used to take us a week to manually process our new images after a survey, now it is done automatically in minutes!”