If you're one of the many therapists I'm seeing who was approached by an AI company offering six figures for "de-identified" notes, reports, etc, and you've abandoned your ethics enough to consider the offer, make sure when you negotiate your compensation that you factor in legal fees and the cost of losing your license.
I hate it here.
Jonathan Lamothe likes this.
reshared this
Dr. Amy, Psy.D. 🎃
in reply to Dr. Amy, Psy.D. 🎃 • • •NadiaPurge
in reply to Dr. Amy, Psy.D. 🎃 • • •"ethical" doing a lot of heavy lifting here.
If my encounters contribute to statistics, we're in trouble.
Dr. Amy, Psy.D. 🎃
in reply to NadiaPurge • • •derptron
in reply to NadiaPurge • • •@NadiaPurge "Ethical" just means you follow a set of ethics. You can change the set of ethics. You can follow ethics that only a monster would follow and you're still "ethical". See every CEO on the fucking planet.
They've sufficiently altered the ethics of the situation that I doubt very much they'll be held to account for anything. "De-identified" info is used and shared quite regularly in medical research. Generally with permission but some fighting that as "too costly".
Dr. Amy, Psy.D. 🎃
in reply to derptron • • •DB Schwein
in reply to derptron • • •@crazyeddie @NadiaPurge
The main issue I find with "de-identified" info is that it's not.
No name. Ok, but we know where you live because we know what therapist you see. You mention a spouse, or kids, or work, or eating habits, or entertainment, or shopping habits. Every one of those things works together to identify you.
Not-Bob, who is stressed because his kid's school requires new uniforms every year.
Not-Mary, who is stressed because her company just got bought.
Not-Stefan, who is stressed because there was a shooting at their favourite movie theatre.
"De-identifying" in this day and age is a myth.
Dr. Amy, Psy.D. 🎃
Unknown parent • • •Ty
Unknown parent • • •Steven Brudenell
in reply to Dr. Amy, Psy.D. 🎃 • • •Dr. Amy, Psy.D. 🎃
in reply to Steven Brudenell • • •Dr. Amy, Psy.D. 🎃
in reply to Dr. Amy, Psy.D. 🎃 • • •Dr. Amy, Psy.D. 🎃
in reply to Dr. Amy, Psy.D. 🎃 • • •Dr. Amy, Psy.D. 🎃
in reply to Dr. Amy, Psy.D. 🎃 • • •Steven Brudenell
in reply to Dr. Amy, Psy.D. 🎃 • • •I'm in software. I share those feelings. based on my experience, you can count on large organizations to say "we're taking a cautious approach to AI (so go ahead and use this AI product! the company told us it's fine)"
I've had luck convincing non technical people of technical truths by appealing to their personal values. what do you value about being a therapist, that's put at risk by AI ingesting notes?
Irenes (many)
in reply to Dr. Amy, Psy.D. 🎃 • • •one deep truth we have learned is that ethics is a process. it is not a fixed set of rules. the rules are just the peace treaty that marks where the last round of fighting left off.
alas, yes, not everyone sees it that way ><
refraction 折射
in reply to Dr. Amy, Psy.D. 🎃 • • •Dr. Amy, Psy.D. 🎃
in reply to refraction 折射 • • •⁂ L. Rhodes
in reply to Steven Brudenell • • •@sbrudenell One direct way to go about it may be to point out that AI companies have been relatively successful at de-anonymizing data, so just stripping away personally identifying information may not be sufficient to protect the confidentiality of patients.
Here's a reference, if you need one: doi.org/10.48550/arXiv.2602.16…
Large-scale online deanonymization with LLMs
arXiv.orgDr. Amy, Psy.D. 🎃
in reply to ⁂ L. Rhodes • • •⁂ L. Rhodes
in reply to Dr. Amy, Psy.D. 🎃 • • •mathew
in reply to ⁂ L. Rhodes • • •@lrhodes @sbrudenell Out of curiosity, I went to see if I could find out who BetterHelp were getting their session transcripts processed by, and learned that they were prosecuted for handing customer health questionnaire responses to Facebook.
reframepractice.com/answers/be…
Anyway, their privacy policy doesn't say, but BetterHelp is owned by Teladoc, and Teladoc use Nuance Dragon for their transcripts, feeding into OpenAI via Microsoft.
teladochealth.com/newsroom/pre…
(I don't use BetterHelp, but their ads are everywhere so I figured it might be important who they hand data to. My therapist doesn't use any kind of AI and is horrified that others do.) #BetterHelp
Teladoc Health Expands Collaboration in AI with Microsoft to Address Healthcare Workforce Crisis
Teladoc HealthDr. Amy, Psy.D. 🎃
in reply to mathew • • •Jonathan
in reply to Dr. Amy, Psy.D. 🎃 • • •Holy. Smokes. That's horrible.
Edit: as in, we live in a currently horrible world and my horrible meter sensitivity has been adjusted accordingly, and I'm still horrified by this.
Joltrast
in reply to Dr. Amy, Psy.D. 🎃 • • •Renke Meuwese
in reply to Joltrast • • •Al Dimond
in reply to Dr. Amy, Psy.D. 🎃 • • •i guess the implication is that they're training a therapist-bot... even if this was ethically OK to do, what would it allow them to do? if they just see notes without observing what led to them they can't even *infer* the logic behind the notes. they can only learn to imitate the language and style.
what could possibly be the point of that? a machine that produces plausible-sounding notes and reports that aren't grounded in experience or judgment?
Al Dimond
in reply to Al Dimond • • •Mike Whitney
in reply to Al Dimond • • •Yeah, but creating the appointment notes is enough evidence to bill the insurer. Which is the only functional aspect of therapy the bot creators probably care about.
Martin Taibr
in reply to Al Dimond • • •@aldimond
Oh my sweet summer child.
The implication is there's a huge gaping hole in their training set regarding people's deepest and most private thoughts and they want their interpolating autocompleters to be able to plagiarize those too.
That and gaining more personal info through deanonymization.
Dr. Amy, Psy.D. 🎃
Unknown parent • • •2qx 🔻
in reply to Dr. Amy, Psy.D. 🎃 • • •When they came for the coders, I did not speak out, because I was not a coder.
When they came for the maths, I did not speak out, because I was not a mathematician.
When they came for the doctors...
GP-u-Moto
in reply to Dr. Amy, Psy.D. 🎃 • • •The more help these companies get the worse it is for the rest of us.
Dr. Amy, Psy.D. 🎃
Unknown parent • • •Jolly Hot Dog Water
in reply to Dr. Amy, Psy.D. 🎃 • • •This just shook me.
This is bad.
This is big.
Is there something beyond 'predatory' for the scope of this sort of violent invasion? The effects this will have on people and the machines designed to kill us, I can't even figure yet.
Wow.
I'm crouched and ready for most of this, but hadn't considered this. And its potential is terrifying.
I hate Nazis.
RiaResists❌ 👑
in reply to Jolly Hot Dog Water • • •You can ask your treatment providers if they use AI.
I’ve been introduced to it and won’t use it. Neither will at least one other counselor Inwork with. The boss is unethical, so she’ll probably push it.
I’m looking for other work.
RiaResists❌ 👑
in reply to Dr. Amy, Psy.D. 🎃 • • •cheesemergency
in reply to Dr. Amy, Psy.D. 🎃 • • •argv[-1]
in reply to cheesemergency • • •Even if they're not using AI, they're almost certainly using some commercial chart software or another, whose vendor has access to the charts and can presumably sell them.
Dr. Amy, Psy.D. 🎃
in reply to argv[-1] • • •argv[-1]
in reply to Dr. Amy, Psy.D. 🎃 • • •Can you be my therapist?? 🤩
@makeitmythic
Iris Young (he/they/she) (PhD)
in reply to Dr. Amy, Psy.D. 🎃 • • •Ethan Walker
in reply to Dr. Amy, Psy.D. 🎃 • • •Dr. Amy, Psy.D. 🎃
in reply to Ethan Walker • • •tuban_muzuru
in reply to Dr. Amy, Psy.D. 🎃 • • •Renke Meuwese
in reply to Dr. Amy, Psy.D. 🎃 • • •Jay
in reply to Dr. Amy, Psy.D. 🎃 • • •kelleynnn
in reply to Dr. Amy, Psy.D. 🎃 • • •Dr. Amy, Psy.D. 🎃
Unknown parent • • •Kirils Solovjovs
in reply to Dr. Amy, Psy.D. 🎃 • • •cute punk girlthing
in reply to Dr. Amy, Psy.D. 🎃 • • •David Chisnall (*Now with 50% more sarcasm!*)
in reply to Dr. Amy, Psy.D. 🎃 • • •Cat 🐈⬛🛰️
in reply to Dr. Amy, Psy.D. 🎃 • • •One of the bugbears I have at work is effective de-identification/anonymization of information for a small internal testing database. (We'd generate but ran into issues with THAT because older systems. Long story, much swearing, migraines and ulcers.)
Given how incredibly fucking hard it can be to anonymize basic records in many cases with no reports etc in them, I would suspect that it's near-impossible to do it with full reports.
To make matters worse, the therapists who even think about it are likely to be the ones out there who will happily write misleading/completely false reports for strong enough "considerations", or even just because they're confronted with someone who is outside their worldview. (I've run into at least three and two of them I wasn't even the client.)
It's already hard enough to get people to seek basic therapy. This? Oh hell no. I'm in favor of "everyone should get therapy" and shit like this makes me stop saying that, because I'm not going to advocate for anyone putting their mental or potentially physical health and safety at risk. Safe therapists are going to turn into a word-of-mouth-only thing at this rate.
Chris Wellens
in reply to Dr. Amy, Psy.D. 🎃 • • •doctorlaura
Unknown parent • • •Jonathan Lamothe
in reply to Dr. Amy, Psy.D. 🎃 • •@Dr. Amy, Psy.D. 🎃 Even if you were able to magically put the ethical nightmare aside...
You are literally helping them to put you out of a job.
Dr. Amy, Psy.D. 🎃 likes this.
Spencer Dub
in reply to Dr. Amy, Psy.D. 🎃 • • •Rythur
in reply to Dr. Amy, Psy.D. 🎃 • • •What a mess of ethics and everything else.
I could use simple models to determine who is who from the data,
Especially considering the existence of data brokers these days.
End of times grifts abound.
Privacy, what privacy???
Soon, we lose the pants.
Shannon Prickett reshared this.
Jack Sparrow
in reply to Dr. Amy, Psy.D. 🎃 • • •Oenanthe conioides ⁂
in reply to Dr. Amy, Psy.D. 🎃 • • •Sensitive content
Tak!
in reply to Dr. Amy, Psy.D. 🎃 • • •BenServiss
in reply to Dr. Amy, Psy.D. 🎃 • • •Dr. Amy, Psy.D. 🎃
in reply to BenServiss • • •Charles
in reply to Dr. Amy, Psy.D. 🎃 • • •