Another Tech Company Wants To Translate Meows And Barks Using AI: Can It Work?

Cats and dogs communicate primarily by scent, touch and body language, but human efforts to understand them have focused exclusively on meows and barks. If we want to truly understand our non-human friends, we need to take an approach that considers the other ways animals “talk” to each other.

A few years ago when MeowTalk made a minor splash in the startup world, I was pretty bullish on its potential to help us understand our cats better.

Sure, the app had an unhelpful habit of attributing improbably loving declarations to Buddy, but I thought it would follow the trajectory of other machine learning models and drastically improve as it accumulated more data.

More users meant the app would record and analyze more meows, chirps and trills, meaning it was just a matter of time before the AI would be able to distinguish between an “I want attention!” meow and a “My bowl is dangerously close to empty!” meow.

Obviously that didn’t happen, and what I personally didn’t take into account back then — and should have, given how obvious it is in retrospect — is that cats don’t just communicate via vocalizations.

In fact, cats don’t normally incorporate vocalizations into communication at all. Pet kitties do it entirely for our benefit because they know we’re generally awful at interpreting body language and we are completely useless when it comes to olfactory information.

It’s actually amazing when you really think about how much of the heavy lifting cats do in our efforts to communicate with each other. They recognize we can’t communicate the way they do naturally, so they try to relate to us on our terms. In return, we meet them less than halfway.

No wonder Buddy sometimes looks frustrated as he meows at me, as if I’m the biggest moron in the world for not understanding the very obvious thing he’s trying to tell me.

“Human, how can you not understand the simple feeling of innerer schweinehund I’m trying to convey here? The cringe is killing me!”

Now the Chinese tech giant Baidu is throwing its hat into the ring after filing a patent in China for an AI system that uses machine learning to decode animal communication and “translate” it to human language.

Machines are designed to process things from a human viewpoint according to human logic, so if Baidu wants to succeed where MeowTalk has not, its engineers will need to take a thoughtful approach with the help of animal behavior experts.

This is a hard problem that encompasses animal cognition, neuroscience, linguistics, biology, biochemistry and even philosophy. If they approach this strictly as a tech challenge, they’ll set themselves up for failure.

Without the information and context clues provided by tails, whiskers, facial expressions, posture, eye dilation, heart rate, pheromones and even fur, an AI system is only getting a fraction of the information cats are trying to convey.

Trying to glean meaning from that is like trying to read a book in which only every fourth or fifth letter is legible. There’s just too much missing information.

Even if we can train machines to analyze sound visual, tactile and olfactory information, it may not be possible to truly translate what our cats are saying to us. We may have to settle for approximations. We’ve only begun to guess at how the world is interpreted differently among human beings thanks to things like qualia and neurodivergence, and the way cats and dogs see the world is undoubtedly more strange to us than the way a neurodivergent person might make sense of reality.

“He grimaced. He had drawn a greedy old character, a tough old male whose mind was full of slobbering thoughts of food, veritable oceans full of half-spoiled fish. Father Moontree had once said that he burped cod liver oil for weeks after drawing that particular glutton, so strongly had the telepathic image of fish impressed itself upon his mind. Yet the glutton was a glutton for danger as well as for fish. He had killed sixty-three Dragons, more than any other Partner in the service, and was quite literally worth his weight in gold.” – Cordwainer Smith, The Game of Rat and Dragon

An animal’s interpretation of reality may be so psychologically alien that most of its communication may be apples to oranges at best. Which is why I always loved Cordwainer Smith’s description of the feline mind as experienced via a technology that allows humans with special talents to share thoughts with cats in his classic short story, The Game of Rat and Dragon.

In the story, humans are a starfaring civilization and encounter a threat in the void between stars that people don’t have the reaction speed to deal with. Cats, however, are fast and swift enough, and with a neural bridge device, teams of humans paired with cats are able to keep passengers safe on interstellar journeys.

The narrator, who is one of the few people with an affinity for teaming up with felines, hopes he’ll be paired with one of his two favorite cats for his latest mission, but instead he’s assigned to partner with an old glutton of a tomcat whose mind was dominated by “slobbering thoughts of food, veritable oceans of half-spoiled fish.”

The narrator wryly notes that the last time one of his colleagues was paired with that particular cat, his burps tasted of fish for weeks afterward. But the cat in question, despite being obsessed with fish, is a badass at killing “dragons,” the human nickname for the bizarre entities that attack human ships in space. (The software that allows felines and humans to link thoughts also portrays the “dragons” as rodents in the minds of the cats, stimulating their ancient predatory drive so they’ll attack instantly when they see the enemy.)

We can’t know for sure if Smith’s interpretation of the feline mind is accurate, but another part rang true when he wrote that cat thoughts were all about the moment, filled with sentiments of warmth and affection, while they rapidly lost interest in thoughts about human concerns, dismissing them “as so much rubbish.”

If the mind of a cat is that relatable, we’ll be incredibly lucky. But in reality we’re dealing with animals who evolved in drastically different ecological niches, with different priorities, motivations, and ways of looking at the world — literally and figuratively.

That doesn’t mean we shouldn’t try to understand our furry friends. Research has yielded interesting information about the way animals like whales and elephants communicate, and AI is at its best when it augments human creativity and curiosity instead of trying to replace it.

Even if we don’t end up with a way to glean 1:1 translations, the prospect of improving our understanding of animal minds is tantalizing enough. We just need to make sure we’re listening to everything they’re saying, not just the meows.

Cat On The Street: What Do You Think About Humans Translating Your Meows?

We asked cats what they think about MeowTalk, an app designed to translate their meows to human language.

MeowTalk, an iOS/Android app that aims to translate your meows using a machine learning algorithm, is getting a new publicity push after a recent update. The app has proven particularly popular in Japan, a nation of cat lovers.

 

What do you think about MeowTalk?

“You’re telling me there’s a good chance my human understood me calling her a dim-witted biped who’s stingy with snacks?” – Midnight, 7, office supervisor

“Finally, a device that can translate all my loving utterances at 5 a.m. when my bowl’s empty!” – Cleo, 5, cushion tester

“If an app is translating our meows, then why do our humans still stink at giving us massages?” – Andre, 2, faucet operator

“You know what this means, don’t you? If my humans overheard me discussing plans for the feline takeover of Earth, I’m going to have to smother them in their sleep.” – Dragorth the Destroyer, 4, generalissimo

“Sometimes I like to meow in gibberish just to mess with the humans. LOL! Wait, how can this app translate Japanese meows AND American meows?” – Zelda, 3, princess

“CHECK IT OUT, THERE’S A KITTEN WHO LOOKS JUST LIKE ME BEHIND THE GLASS! HEY, STOP IMITATING ME! STOP THAT! IT’S REALLY ANNOYING! HEY!” – Christian, 3 months, archaeologist kitten

Every Attempt To Translate Meows Has Failed. Why?

A New York Times science writer tries MeowTalk, the app that says it can tell you what your cat is saying.

New York Times science writer Emily Anthes details her experience with MeowTalk in a new story, and has more or less come to the same conclusions I did when I wrote about the app last year — it recognizes the obvious, like purring, but adds to confusion over other vocalizations.

Back in January of 2021, in MeowTalk Says Buddy Is A Very Loving Cat, I wrote about using MeowTalk to analyze the vocalizations Bud makes when he wants a door opened. After all, that should be a pretty basic task for an app that exists to translate meows: Cats ask for things, or demand them, some would say.

But instead of “Open the door!”, “I want to be near you!”, “Human, I need something!” or even “Obey me, human!”, it told me Bud was serenading me as he pawed and tapped his claws on the door: “I’m looking for love!”, “My love, come find me!”, “I love you!”, “Love me!”, “I’m in love!”

According to MeowTalk, my cat was apparently the author of that scene in Say Anything when John Cusack held up a boombox outside of Ione Skye’s bedroom window.

John Cusack and Buddy the Cat
Buddy the Director.

Anthes had a similar experience:

“At times, I found MeowTalk’s grab bag of conversational translations disturbing. At one point, Momo sounded like a college acquaintance responding to a text: ‘Just chillin’!’ In another, he became a Victorian heroine: ‘My love, I’m here!’ (This encouraged my fiancé to start addressing the cat as ‘my love,’ which was also unsettling.) One afternoon, I picked Momo up off the ground, and when she meowed, I looked at my phone, ‘Hey honey, let’s go somewhere private.’ !”

On the opposite side of the emotional spectrum, MeowTalk took Buddy’s conversation with me about a climbing spot for an argument that nearly came to blows.

“Something made me upset!” Buddy was saying, per MeowTalk. “I’m angry! Give me time to calm down! I am very upset! I am going to fight! It’s on now! Bring it!”

In reality the little dude wanted to jump on the TV stand. Because he’s a serial swiper who loves his gravity experiments, the TV stand is one of like three places he knows he shouldn’t go, which is exactly why he wants to go there. He’s got free rein literally everywhere else.

If MeowTalk had translated “But I really want to!” or something more vague, like “Come on!” or “Please?”, that would be a good indication it’s working as intended. The app should be able to distinguish between pleading, or even arguing, and the kind of freaked-out, hair-on-edge, arched-back kind of vocalizations a cat makes when it’s ready to throw down.

buddytranslations
Accurate translations of Buddy’s meows.

Still, I was optimistic. Here’s what I wrote about MeowTalk last January:

“In some respects it reminds me of Waze, the irreplaceable map and real-time route app famous for saving time and eliminating frustration. I was one of the first to download the app when it launched and found it useless, but when I tried it again a few months later, it steered me past traffic jams and got me to my destination with no fuss.

What was the difference? Few people were using it in those first few days, but as the user base expanded, so did its usefulness.

Like Waze, MeowTalk’s value is in its users, and the data it collects from us. The more cats it hears, the better it’ll become at translating them. If enough of us give it an honest shot, it just may turn out to be the feline equivalent of a universal translator.”

There are also indications we may be looking at things — or hearing them — the “wrong” way. Anthes spoke to Susanne Schötz, a phonetician at Lund University in Sweden, who pointed out the inflection of a feline vocalization carries nuances. In other words, it’s not just the particular sound a cat makes, it’s the way that sound varies tonally.

“They tend to use different kinds of melodies in their meows when they’re trying to point to different things,” said Schötz, who is co-author of an upcoming study on cat vocalizations.

After a few months in which I forgot about MeowTalk, I was dismayed to open the app to find ads wedged between translation attempts, and prompts that asked me to buy the full version to enable MeowTalk to translate certain things.

The developers need to generate revenue, so I don’t begrudge them that. But I think it’s counterproductive to put features behind paywalls when an application like this depends so heavily on people using it and feeding it data.

To use the Waze analogy again, would the app have become popular if it remained the way it was in those first few days after it launched? At the time, I was lucky to see indications that more than a handful of people were using it, even in the New York City area. The app told me nothing useful about real-time traffic conditions.

These days it’s astounding how much real-time traffic information the app receives and processes, routing drivers handily around traffic jams, construction sites and other conditions that might add minutes or even hours to some trips. You can be sure that when you hear a chime and Waze wants to redirect you, other Waze users are transmitting data about a crash or other traffic impediment in your path.

Bud
“I’m thinking deep thoughts about turkey.”

MeowTalk needs more data to be successful, especially since — unlike Waze — it depends on data-hungry machine learning algorithms to parse the sounds it records. Like people, machine learning algorithms have to “practice” to get better, and for a machine, “practice” means hearing hundreds of thousands or millions of meows, chirps, trills, yowls, hisses and purrs from as many cats as possible.

That’s why I’m still optimistic. Machine learning has produced algorithms that can identify human faces and even invent them. It’s produced software that can write prose, navigate roads, translate the text of dead languages and even rule out theories about enduring mysteries like the Voynich Manuscript.

In each of those cases there were innovators, but raw data was at the heart of what they accomplished. If MeowTalk or another company can find a way to feed its algorithms enough data, we may yet figure our furry little friends out — or at least know what they want for dinner.

How Much Can AI Teach You About Your Cat?

A new AI algorithm promises to help you gauge your cat’s mood — and determine if she’s in pain — by analyzing facial expressions.

In the photograph, Buddy is sitting on the coffee table in the classic feline upright pose, tail resting to one side with a looping tip, looking directly at me.

The corners of his mouth curve up in what looks like a smile, his eyes are wide and attentive, and his whiskers are relaxed.

He looks to me like a happy cat.

Tably agrees: “Current mood of your cat: Happy. We’re 96% sure.”

Screenshot_20210730-092555

Tably is a new app, currently in beta. Like MeowTalk, Tably uses machine learning and an algorithmic AI to determine a cat’s mood.

Unlike MeowTalk, which deals exclusively with feline vocalizations, Tably relies on technology similar to facial recognition software to map your cat’s face. It doesn’t try to reinvent the wheel when it comes to interpreting what facial expressions mean — it compares the cats it analyzes to the Feline Grimace Scale, a veterinary tool developed following years of research and first published as part of a peer-reviewed paper in 2019.

The Feline Grimace Scale analyzes a cat’s eyes, ears, whiskers, muzzle and overall facial expression to determine if the cat is happy, neutral, bothered by something minor, or in genuine pain.

It’s designed as an objective tool to evaluate cats, who are notoriously adept at hiding pain for evolutionary reasons. (A sick or injured cat is a much easier target for predators.)

But the Feline Grimace Scale is for veterinarians, not caretakers. It’s difficult to make any sense of it without training and experience.

That’s where Tably comes in: It makes the Feline Grimace Scale accessible to caretakers, giving us another tool to gauge our cats’ happiness and physical condition. With Tably we don’t have to go through years of veterinary training to glean information from our cats’ expressions, because the software is doing it for us.

Meanwhile, I used MeowTalk early in the morning a few days ago when Buddy kept meowing insistently at me. When Bud wants something he tends to sound whiny, almost unhappy. Most of the time I can tell what he wants, but sometimes he seems frustrated that his slow human isn’t understanding him.

I had put down a fresh bowl of wet food and fresh water minutes earlier. His litter box was clean. He had time to relax on the balcony the previous night in addition to play time with his laser toy.

So what did Buddy want? Just some attention and affection, apparently:

Screenshot_20210801-181618

I’m still not sure why Buddy apparently speaks in dialogue lifted from a cheesy romance novel, but I suppose the important thing is getting an accurate sense of his mood. 🙂

So with these tools now at our disposal, how much can artificial intelligence really tell us about our cats?

As always, there should be a disclaimer here: AI is a misnomer when it comes to machine learning algorithms, which are not actually intelligent.

It’s more accurate to think of these tools as software that learns to analyze a very specific kind of data and output it in a way that’s useful and makes sense to the end users. (In this case the end users are us cat servants.)

Like all machine learning algorithms, they must be “trained.” If you want your algorithm to read feline faces, you’ve got to feed it images of cats by the tens of thousands, hundreds of thousands or even by the millions. The more cat faces the software sees, the better it gets at recognizing when something looks off.

At this point, it’s difficult to say how much insight these tools provide. Personally I feel they’ve helped me understand my cat better, but I also realize it’s early days and this kind of software improves when more people use it, providing data and feedback. (Think of it like Waze, which works well because 140 million drivers have it enabled when they’re behind the wheel and feeding real-time data to the server.)

I was surprised when, in response to my earlier posts about MeowTalk and similar efforts, most of PITB’s readers didn’t seem to share the same enthusiasm.

And that, I think, is the key here: Managing expectations. When I downloaded Waze for the first time it had just launched and was pretty much useless. Months later, with a healthy user base, it became the best thing to happen to vehicle navigation since the first GPS units replaced those bulky maps we all relied on. Waze doesn’t just give you information — it analyzes real-time traffic data and finds alternate routes, taking you around construction zones, car accident scenes, clogged highways and congested shopping districts. Waze will even route you around unplowed or poorly plowed streets in a snowstorm.

If Tably and MeowTalk seem underwhelming to you, give them time. If enough of us embrace the technology, it will mature and we’ll have powerful new tools that not only help us find problems before they become serious, but also help us better understand our feline overlords — and strengthen the bonds we share with them.

Buddy is bored
Buddy’s bored of all this AI talk and wants a snack.

MeowTalk: Little Buddy’s Rage!

More fun with MeowTalk!

The MeowTalk experiment continues!

Here’s a log of translations from last night:

Buddy's Rage
“It’s on now! Bring it!”

“I’m angry! … It’s on now, bring it! … I am going to fight!”

Thankfully I believe my readers know me well enough at this point to be certain of the truth, which is that I dote on my cat, give him loads of attention when he wants it, leave him alone when he doesn’t, and generally do my best to consider his feelings.

Out of context, though, that screen looks like we were brawling. MeowTalk deserves credit: The app knew Bud was upset. But our “argument” was one we’ve been having nightly the last week or two: An ongoing disagreement over Buddy climbing up to the one of the few places he’s not allowed, for fear of toppling over a 55″ flatscreen.

He’s a swiper (as in one of those cats who swipes everything off of flat surfaces) and he has a long and demonstrable history of destroying items large and small by swiping, knocking or pulling them onto the floor. In fact, you can often tell where he’s been just by looking at all the stuff he’s knocked over.

“Bud, you were on the table again, weren’t you?”

“Nope. I swear!”

“So how did a salt shaker, yesterday’s mail and a pair of keys end up on the floor.”

“Uh, poltergeists?”

catswiper

Maybe I should call him Newton after his obsession with gravity experiments:

“Professor Budsaac Newton here.

Gravity experiment #4,256: In my 4,255 previous experiments, an item swiped from this table fell immediately to the floor.

Conclusion: More data needed.
Test objects: An iPhone SE and a Google Pixel 4a.
Method: Standard swiping motion.

And we’re going to begin in 3…2…

** Sound of two smartphones smacking the hardwood floor. **

As expected, both devices immediately fell to the floor. We’re going to take a break now until a human places them back on the table. I’d like to repeat my experiment and see the gravitational forces in action from a different angle.”

Otherwise he can go where he wants, lounge where he wants, play wand games with me, watch Outside TV from his perch, play with his toys, nudge me for a snack, smack some bottle caps around. He’s got options.

But since he can’t claim the spot right next to the new 55″ TV, now he has to have it.

catswiper2