Foundation Offers $10m For ‘Cracking The Code’ Of Animal Language

Think you can decipher the rhythmic clicks and whistles of dolphins or the grunts and alarm calls of monkeys? A foundation is offering big prizes for progress in communicating with animals.

Looking to prompt renewed efforts at decoding animal communication, a non-profit founded by an investor and a university are offering prizes — including a hefty $10 million — to teams that can figure out what animals are “saying.”

The Coller Dolittle Challenge for Interspecies Two-Way Communication is a collaboration between the Jeremy Coller Foundation and Tel Aviv University. (Yes, it’s named after that Dr. Dolittle.)

Entrants aren’t asked to come up with a Star Trek-like “universal translator” for animals. Rather, the people behind the Coller Dolittle Challenge want to see methods that allow for two-way communication between humans and individual species.

“We are open to any organism and any modality from acoustic communication in whales to chemical communication in worms,” said Yossi Yovel, a professor at Tel Aviv University and co-chairman of the challenge.

The grand prize is a $10 million grant or $500,000 in cash, chosen by the winner, while the Foundation will offer $100,000 prizes each year for the best entries that make significant progress toward communicating with animals. The yearly prizes will be assessed “for significant contributions to decipher, interface or mimic non-human organism communication.”

While it may seem far-fetched — and there are those who believe humans will never be able to fully understand animal communication in proper context — there have been efforts to communicate with and decode the communications of bats, dolphins, whales and some primate species. Scientists have also pushed the boundaries on understanding group communication, such as the coordination involved in avian murmurations.

orangutan on tree
Orangutans have demonstrated the ability to understand abstract concepts, like using money, rudimentary sign language, and have even deceived humans. One orangutan in the 1960s repeatedly escaped his zoo enclosure by hiding a small strip of metal in his mouth and using it to pick a lock. Credit: Klub Boks/Pexels

The organizers believe artificial intelligence will be the tool that ultimately helps crack the communication barrier, but entrants aren’t required to use AI. The technology is incredibly useful for tasks involving pattern recognition and sorting large amounts of data, both of which are important in this kind of work when researchers are tasked with analyzing thousands of audio samples or hundreds of hours of footage.

Alas, we don’t think the foundation will be interested in the Buddinese language, which boasts 327 different ways of demanding food and features a timekeeping and calendar system based on meals and naps. A short trill followed by a series of staccato meows, for example, means “I expect prompt service at salmon o’clock,” while a truncated meow ending with a scoff is used to indicate displeasure when a human napping substrate tosses too much during sleep.

Still, maybe we’ll dress it up to make it look properly academic and give the challenge a try. Those prizes could buy a lot of Roombas!

The Dividing Line Between Human And Animal Has Been Blurred Again As AI Reveals Startlingly Complex Whale Language

By unlocking the mysteries of how sperm whales communicate and demonstrating their impressive cognitive abilities, researchers hope to get people invested in the fate of these endangered animals.

Sperm whales are chatty.

Their language is markedly different from the deep cetacean moans associated with other whales, taking the form of Morse code-like clicks that boom through the ocean in a decibel range almost twice that of jet engines.

And while we’ve long known animals like monkeys assign specific meaning to short vocalizations varying from alarm calls to affirmations of social rank, sperm whale conversations can endure for an hour or more, with participants exchanging complex strings of clicks that vary depending on context, environment and even which pod family is speaking.

Sperm_whale_Tim_Cole_NMFS_crop
An aerial view of a sperm whale near the ocean surface. Credit: Wikimedia Commons

While artificial intelligence has been maligned over the past few years as people grapple with its rapid progress and potential for abuse, it remains the best tool we have for teasing out patterns that our human minds can’t discern, especially from large quantities of data.

With more than 9,000 recordings of sperm whales, Project CETI — Cetacean Translation Initiative, a non-profit effort to decode and translate sperm whale communication — had precisely the kind of huge data cache that AI excels at analyzing.

By feeding the recordings into specially trained machine learning algorithms, the research team was able to identify a wealth of new language patterns. While human languages are composed of quantized morphemes — prefixes, suffixes and root words — whale communication is broken down into sequences of clicks and pauses called “codas.”

Like Morse code, codas make a distinction between short clicks and long clicks. Sperm whales also vary the tempo of the clicks, which could represent inflection, “dialects” or concepts completely alien to the human mind.

“Some of what they’re doing might be totally different from our way of communicating and we’re probably never going to be able to fully grasp those differences,” Oregon State postdoctoral marine researcher Taylor Hersh told NPR.

sperm whale fluke
A sperm whale fluke visible above the surface of the ocean. Credit: Wikimedia Commons

Researchers believe the “inter-click intervals” — akin to ghost notes in music — may be as significant as the clicks themselves. Importantly, while human ears were able to identify and catalog some of the codas, the machine learning algorithms found many that human analysis missed.

That’s not surprising considering sperm whales — the loudest animals on Earth, capable of generating sounds up to 230 dB — took a much different evolutionary course and, as ocean-dwelling creatures weighing up to 90,000 pounds (40,800 kg) likely have a radically different sensorium compared to humans.

The comparisons to music go further than ghost notes.

“This study shows that coda types are not arbitrary, but rather that they form a newly discovered combinatorial coding system in which the musical concepts of rubato and ornamentation combine with two categorical, context-independent features known as rhythm and tempo, by analogy to musical terminology,” CETI’s team wrote on May 7 while unveiling the most recent study.

Sperm_whale_distribution_(Pacific_equirectangular)
Sperm whale distribution based on human sightings. Sperm whales freely travel the oceans except in cold, ice-packed environs. Credit: Wikimedia Commons

While people have used many abilities to mark the dividing line between humans and animals over the years — including the ability to use tools, experience emotions, and demonstrate self-awareness — human capacity for authentic language with syntax and context-dependent meaning was one of the stalwarts, standing the test of time as new research toppled the other dividers by showing animals do indeed use tools, experience rich emotions and have complex inner mental lives.

With this research, scientists are assembling a “sperm whale phonetic alphabet” that will make it easier to discern and catalog whale codas.

To be clear, there’s still a lot of work ahead before scientists can prove sperm whale codas are comparable to human definitions of language, but whether they strictly meet that definition may not matter. After all, it’s clear the clicks and pauses of whale codas are imbued with meaning, even if it remains elusive to us for the moment.

Indeed, “sperm whale communication has both contextual and combinatorial structure not previously observed in whale communication,” the team wrote.

Proving sperm whale codas are tantamount to human language isn’t the goal anyway. The team has two overriding priorities — decode the meanings behind the codas, and get the wider public invested in the fate of these endangered animals by showing they’re not so different from us.

“Our results show there is much more complexity than previously believed,” MIT AI lab director Daniela Rus told NPR, “and this is challenging the current state of the art or state of beliefs about the animal world.”

Cat On The Street: What Do You Think About The Rise Of AI?

As the supreme species on this planet, cats have a lot to lose if AI seeks to supplant them as Earthly rulers.

With artificial intelligence making rapid progress over the past year, we asked cats what they think about a future where we depend on intelligent machines.

WATCH: New Buddy Wildlife Documentary Premieres On PITB!

Watch the premiere of Buddy: Perfect Predator exclusively streaming NOW on PITB!

It’s here!

The long-awaited documentary feature: “Buddy: Perfect Predator” has arrived on PITB.

Join Sir David Cattenborough and his intrepid crew of wildlife videographers as they follow the elusive Buddinese tiger through the dense undergrowth and dangerous terrain of its natural habitat in suburban New York.

Watch never-before-seen footage of the silver-furred Buddy stalking his prey, lounging, sleeping and eating, and follow a tense encounter between the Buddy and a red laser dot.

“I’m extremely proud of the work we’ve done here, and I believe our audience will be thrilled to learn more about this little-known creature, who shares so many qualities with tigers, lions, jaguars and leopards,” Cattenborough said.

“We fell in love with the silver-furred Buddy as we kept our cameras trained on him, and we think our audiences will find him just as charming as we did,” the British naturalist said. “He’s such a good boy!”

(Please ensure your sound is enabled or wear headphones to hear the narration and the atmospheric sounds.)

About this video:

This story was made possible with the use of artificial intelligence tools. To create the images of Sir David Attenborough with Buddy, we used a natural language processing AI trained to output realistic-looking images and Pixlr to refine the images in post. To create the narration, we assembled samples of Attenborough speaking and trained a vocal synthesis AI, based on brand new technology, to mimic Attenborough’s unique pronunciation, cadence and rhythm, then layered the audio with a background of various nature sounds and incidental sounds, such as a tiger roaring.

Just a year ago it would not have been possible to generate images like this or faithfully recreate Attenborough’s famous narrative style, proving AI not only allows users to achieve things that were previously impossible, but has been making major leaps forward in short periods of time.

We believe AI, when properly used, can be a great instrument in the creative toolbox.

Finally, a thank you to Buddy for being a good sport about having cameras in his face. Great job, Bud!

Cattenborough and Buddy
Sir David Cattenborough with Buddy the Cat.

Is Your Cat In Pain? The Feline Grimace Scale Can Tell You

For the first time, veterinarians and regular cat parents have a tool that can tell them if their cats are hurting.

Although there’s been lots of talk claiming cats don’t have facial expressions humans can parse — or even the muscles to noticeably change expressions — that’s not actually true.

It’s more accurate to say feline facial expressions are far more subtle than their human or even canine equivalents, and it takes an expert — a veterinarian or behaviorist with specialized training — to accurately read them.

This is a brand new frontier for veterinary science, and it’s all thanks to the feline grimace scale, a system developed by researchers at the University of Montreal in 2019. Using video clips of cats in various moods and stages of pain or pain-free expression, the researchers built a system that could reliably determine how a cat is feeling. (You can read more about how they did that here.)

“I call it the Rosetta Stone for interpreting how a cat is feeling,” veterinarian Liz Bales says in a new video at dvm360. “It turns out that very subtle changes in cat’s facial expressions can tell us whether or not they’re in pain. It includes the position of the ears, the opening of the eyes, the expression on the mouth, how the cat is holding its whiskers, and how they’re holding their head.”

Each of the five elements of feline facial expression are scored on a three-point scale, then added up. The result provides an accurate assessment of how a cat feels.

“It’s amazing, and it allows us to interpret feline pain in a way we never could before,” Bales says. “The hard part is, it can be a little bit tricky to learn. It is learnable, but I specialize in this and I’m still struggling to get it right every single time.”

Despite the challenge, she says, it’s well worth learning.

“The applications of this are so far and wide, and I think as the technology grows and it becomes easier and easier to use the grimace scale, the more exciting it’s going to be.”

Thanks to an app named Tably, cat servants don’t have to know how to read the most subtle feline facial expressions anymore. By running a photo of your cat through the app’s algorithm, Tably can read your cat’s expression for you.

Tably Bud
Tably gauges cats’ moods in addition to their pain levels. We used the web app to evaluate Buddy last year. Thankfully he was happy!

Bales says she envisions a near future in which pet parents monitor their cats’ health and mood daily, and the scale becomes the standard for end-of-life care. With a “validated, consistent way to measure pain, we can look into more pain drugs for cats, what’s working, what isn’t.”

“A cat in pain looks like a resting cat to most people, but now we have this tool,” Bales says. “And I think as the tool evolves and we give cats a way to really speak for themselves through this Rosetta Stone of the grimace scale, then the more we understand that we can do for them, the more we’re going to do for them.”

We wrote about the feline grimace scale and Tably last year, and noted it had a lot of promise for veterinarians and us cat servants. At the time Tably was in beta and had a web app that allowed anyone to use the technology.

Unfortunately the web app seems to have disappeared, and the app is now available only to iOS users. Since we switched from an iPhone to Android, we can’t access Tably for the time being. (Let’s hope an Android version is forthcoming.) But if you have an Apple device, the app is definitely worth checking out.

Bud and Becky
“You go, girlfriend!”