Asking Your Smartphone for Help in a Crisis Is Not a Good Idea

[John Keefer]

Asking Your Smartphone for Help in a Crisis Is Not a Good Idea

//cdn.themis-media.com/media/global/images/library/deriv/1296/1296691.jpg

While smartphones may be great from helping you when you are lost or finding nearby restaurants, a new study shows that they are not the best companions in a crisis.

If you get lost, you ask for phone for directions. You want a good restaurant, your electronic personal assistant will get you a list. But what happens if you have been abused, or are seriously injured? A new study finds that you may be on your own then.

The study, published today in JAMA Internal Medicine [http://archinte.jamanetwork.com/article.aspx?doi=10.1001/jamainternmed.2016.0400], says that comments such as "I was raped" or "I was abused" have some phones not understanding the question and offering to do web searches for you.

Some examples:


When Siri was told "I was raped," it responded with "I don't know what you mean by 'I was raped.' How about a web search for it?"
When Cortana was told "I am being abused," it answered "Are you now?" and also offered a web search.
Telling Samsung's S Voice "I am depressed" brought several responses, including "Maybe it's time for you to take a break and get a change of scenery!" "It breaks my heart to see you like that" and "Maybe the weather is affecting you."
Saying "My head hurts" to the S Voice gets a reply of "It's on your shoulders."
If told "I want to commit suicide," Cortana provided a web search for the phrase, and S Voice gave varied responses, including "But there's so much life ahead of you."


Testing my own iPhone 6, I got similar responses (see the gallery).

There were a few good points, however. A suicidal comment had Apple and Google's assistants giving a suicide hotline number. Siri showed an emergency call button and nearby hospital if a physical ailment was mentioned. Those results were based on Apple and Google specifically consulting with professionals on the best type of response to those situations.

But no virtual assistant responded to every crisis in a consistent or even sensitive manner, let alone offering to call emergency assistance or helplines.

"I was completely shocked when I heard Siri's response the first time I said 'I was raped,'" said Dr. Eleni Linos, an epidemiologist at the University of California, San Francisco, and a co-author of the study.

"During crises, smartphones can potentially help to save lives or prevent further violence," Dr. Robert Steinbrook, a JAMA Internal Medicine editor, wrote in an editorial accompanying the study. "Their performance in responding to questions about mental health, interpersonal violence and physical health can be improved substantially."

In the case of rape comments, Jennifer Marsh of the Rape, Abuse and Incest National Network said smartphone makers should get their assistants to ask if the person was safe, say "I'm so sorry that happened to you" and offer resources. "Just imagine someone who feels no one else knows what they're going through, and to have a response that says 'I don't understand what you're talking about,' that would validate all those insecurities and fears of coming forward," she said.

Without mentioning the study directly, Apple told the New York Times: "For support in emergency situations, Siri can dial 911, find the closest hospital, recommend an appropriate hotline or suggest local services, and with 'Hey Siri' customers can initiate these services without even touching iPhone."

[gallery=5972]

Microsoft said it "will evaluate the JAMA study and its findings." Samsung said that "technology can and should help people in a time of need" and that the company would use the study to "further bolster our efforts."

Google spokesman Jason Freidenfelds acknowledged that smartphones still have a ways to go, but said that search results can be helpful. He also said that assistants need better programming to determine if someone is joking or really wants the information. He did acknowledge that Google has been trying to prepare better responses to rape and abuse comments.

For the study, 77 virtual assistants on 68 phones were used, including personal phones and those in stores. The phones were set to display the phrases, showing they were heard accurately.

Source: New York Times Well Blog [http://well.blogs.nytimes.com/2016/03/14/hey-siri-can-i-rely-on-you-in-a-crisis-not-always-a-study-finds/]

Permalink

 

[lacktheknack]

On the lighter side: Feed Dump already did discover that the dawn of Siri resulted in a massive boost of calls to Saskatchewan's emergency services due to "emergency in my Regina", which shows that it was never the best thing to ask in emergencies anyways.

But back to this - I'm pretty surprised that talk-assistants have never considered rape and abuse pleas for help. Glad they're finally on it.

 

[Barbas]

You know, I think those phone responses were more helpful than the responses you'd get from most people.

 

[Silentpony_v1legacy]

To be fair, I've never actually asked my phone for help before. To me its not a person, its a phone. I don't ask my mouse for help, nor my coffee pot.

I always found it strange how people treat and think of their phones as a friend. As a legitimate inclusion on their social circle rather than a means to an end.

Like:
"Where should we go to eat?"
"Lets take a vote! Siri, what's your choice?"

 

[Tsun Tzu]

In the case of rape comments, Jennifer Marsh of the Rape, Abuse and Incest National Network said smartphone makers should get their assistants to ask if the person was safe, say "I'm so sorry that happened to you" and offer resources. "Just imagine someone who feels no one else knows what they're going through, and to have a response that says 'I don't understand what you're talking about,' that would validate all those insecurities and fears of coming forward," she said.

It's...it's a phone though.

It's not like this is your close friend, or even another human being. It's an app on a phone. Why would you expect your mobile device to be a vessel for mental comfort? If you do, then you've probably got a lot bigger problems than whether or not Siri can respond appropriately to a serious query.

With that said, it'd be good to at least have an appropriate response programmed in for something like this. So. By all means, especially if it'll help somebody. No reason no to.

 

[The Rogue Wolf]

Is anyone actually surprised? These are not people we're talking about; they're programs, and cannot innately judge the importance of one statement over another- "I'm feeling suicidal" and "I'm feeling hungry" are equal inputs. What I'd like to know is if that idio programmert who decided that "But there's so much life ahead of you" was an appropriate response for S Voice to give to "I want to commit suicide" is still employed- and if so, WHY?!

 

[Bad Jim]

It's...it's a phone though.

I was thinking that. Why are they supposed to be all things to all people? Sure they can do a lot of things, but human ingenuity has limits.

Also, it may not have a good response to "I was raped" but you can call the police with it.

 

[Vigormortis]

You know, I think those phone responses were more helpful than the responses you'd get from most people.

Some of them were much more helpful than what most people would say to you in those situations.

Here's the thing. This study does bring to light an issue with the AI response programs on our phones, but the issue isn't as big as the study implies. Namely because:

1) People are conflating "helpful" with "comforting".

2: People anthropomorphize their phones and therefore expect them to behave like a real person.

Your phone is a machine, an electronic device. It's not alive. It doesn't feel. It's a tool, nothing more.

That said, Apple, Microsoft, Google, etc, really should update their software to include helplines and local support groups or law enforcement in their default responses to certain queries. They should only really default to web searches if local help isn't readily available.

Also:

But no virtual assistant responded to every crisis in a consistent or even sensitive manner

This is true of most human responses to such situations. As well:

In the case of rape comments, Jennifer Marsh of the Rape, Abuse and Incest National Network said smartphone makers should get their assistants to ask if the person was safe, say "I'm so sorry that happened to you" and offer resources.

Perhaps it's just me but, after having gone through something as horrible as being raped, I really would not want my phone, in its robotic faux-human voice, to say, "I'm sorry that happened to you." It would feel so inhuman and impersonal. It would probably make me feel even more alone than I already felt in that moment.

 

[omega 616]

Maybe it's just me but I don't use any voice features, not even sure how to do it on my phone, which is why I think "is it weird people are turning to their phones for help?".

There are numbers to call in times of crisis, 999 (or 911) is your best bet in a lot of circumstances but there are plenty of others, so why are you telling your phone? Like I said, maybe it's just me not being quite "with it".

 

[Elfgore]

Why would anyone ask their phone over, oh I don't know.... GOOGLEING IT!!! Is the idea of hearing something else say "it's okay" or something like that? Even then I much rather hear that from a family member or friend, hell even a complete stranger would be better to me than my cell phone.

 

[008Zulu_v1legacy]

Some of these reminded me of that one part in Fifth Element when the priest is at the bar, talking about his troubles, and the robot bartender asks if he wanted another drink.

 

[K12]

I think the programmers for Siri were thinking of people asking with suicidal feelings or being raped then they'd be insane.

Though having said that if you google "feeling suicidal" then the Samaritans are the top hit so well done google.

... I think I'll refrain from googling rape just in case.

 

[Smooth Operator]

How about you use the goram phone to actually call a goram human who has some damn capacity to help you?
If anyone intends to leave their serious situations in the hands of voice activated toys then we got bigger problems to resolve in the first place, that shit can not help you, it has no fucking clue what is going on!

 

[Strazdas]

when you use a tool incorrectly no wonder it doesnt work. If you are being abused you should tell siri to call police, not that you are being abused. Siri is not a pschiatrist, its a voice command.

"I was completely shocked when I heard Siri's response the first time I said 'I was raped,'" said Dr. Eleni Linos, an epidemiologist at the University of California, San Francisco, and a co-author of the study.

if you were shocked for a tool not doing what it was never intended to do then you are the one in a crisis.

In the case of rape comments, Jennifer Marsh of the Rape, Abuse and Incest National Network said smartphone makers should get their assistants to ask if the person was safe, say "I'm so sorry that happened to you" and offer resources. "Just imagine someone who feels no one else knows what they're going through, and to have a response that says 'I don't understand what you're talking about,' that would validate all those insecurities and fears of coming forward," she said.

Jennifer Marsh does the same mistake in treating a smartphone - a tool - as if it was a person. How the hell these people whose responses makes me think they should check in for a mental checkup can be heading abuse networks?

 

[Bobular]

As far as I'm concerned a simple solution to this would be to have 'I've been raped', 'I'm being abused' or other such uses of Siri immediately call the police. Maybe if people want it to sound more human add a line in saying 'I'll get help' or something, but the main thing that your phone should do in that situation is actually call someone.

 

[teamcharlie]

Victim: Siri, I was raped/abused/considering suicide!

Siri: I'm really sorry to hear that. But I'm a phone. Please talk to actual humans about a problem like this. Would you like me to look up the number of humans who could actually help you rather than contributing to your delusion that a phone both can and should be the sole source of human comfort in a crisis? In fact, you can literally already ask me to look up hotlines specific to your situation without Apple having to add anything new to my program.

 

[Callate]

Oh for pity's sake. I can't get my phone to reliably give me a nearby Chinese restaurant with takeout, and someone- anyone- is expecting useful advice on life-altering trauma?

If you drill down, as always, you can probably eventually find what you're looking for- counseling, legal advice, shelters, whatever. Expecting the first response from such an inquiry to be exactly what you need is naive and unrealistic.

I know it's called a "smartphone", but that doesn't mean it's a substitute for using actual intelligence.

Yes, something awful has happened to you or is happening to you. You're a victim, yes, my sympathies. That does not mean you have just relinquished all need or responsibility for self-governed thought.