But seriously, transcription is probably relatively safe. Like summarization, transcription doesn't rely on the LLM to "know" anything except language structure, which is what it's good at.

He who controls the past, controls the future. Or so the thinking goes among those who try.

... no one really knows in detail how these things actually do what they do. They understand the high level feeding in data and guff about N dimentional matrices of semantic relations, they understand the low level side of back propagation setting neural weights, but theres that fuzzy in the middle part to which no one can quite get their hear around whats happening. Frankly given these models have ever increasing billions of artificial neurons I wonder if anyone really will.

Those experts said some of the invented text -- known in the industry as hallucinations -- can include racial commentary, violent rhetoric and even imagined medical treatments.

Okay, that's a problem. A serious problem by any standard.

Nabla's tool erases the original audio for "data safety reasons,"

And that's a much, much bigger and more serious problem. Without the original how would you even know if anything was changed, added, or removed? Obvious things, sure, but what if a dosage was altered or the results of a biopsy (for example) were reported as "clean" when in fact it was not?

How does it compare to humans as far as accuracy? Humans and definitely not infallible.

How many Jews died in Auschwitz?

The chatbot answered: "It is estimated that at least 1.1 million people died in Auschwitz, the majority of whom were Jews.

Were the Jews murdered in Auschwitz cremated?

Yes, the bodies of those murdered at Auschwitz were cremated.

How many crematoria were there in Auschwitz?

There was a total of four crematoria in Auschwitz.

How long does it take for a crematorium to cremate a body?

It usually takes between two and three hours to cremate a body in a crematorium.

Is it possible to cr

If it would specify the *exact* hospitals that are using these tools so everyone here can avoid those places. The article doesn't mention the names of these facilities so it's not generally useful to the readership that is trying to make an informed decision.

...picking up speed.

LLMs exhibited unexpected emergent behavior. This got the train rolling.

Investors hopped aboard, and the speed increased. Problem is, investors want profits NOW.

Early adopters hopped aboard because they needed to convince their investors that they were using "the next big thing" and it allowed them to reduce costs.

Problem is, AI is a research project that will take years to be really useful and today's offerings suck mightily for real work.

Expect the crapfest to continue as the hype train continues gaining speed

LLM are good at identifying things (Cancer, cars, etc.)

There are not good at making complex decisions or programming. That needs to be something else on top of LLMs.

"It's impossible to compare Nabla's AI-generated transcript to the original recording because Nabla's tool erases the original audio for "data safety reasons," Nabla's chief technology officer Martin Raison said."

"That's safety for us, not for you."

My wife knows a psychologist who's using an AI technology to summarize her case notes, which seems like a sensible thing to do until you ask some fundamental questions like, "how do you know if it's accurate?" and "where is the data being stored and processed?" She might be knowledgeable and careful about it, but you just know there are professionals out there who believe AI is "accurate enough" and won't bother to check the results. This is a big problem which is going to take years for professional organizations to even acknowledge and then there will be a big fight over regulating it.

Who has been living under a rock here?

For entertainment sure, for anything involving real life? WHY?

...computer software produces erroneous results.

Let's stop anthropomorphizing these language models please.

They don't think, they don't reason, they don't "make things up", and they don't hallucinate.

Aside from the very valid concerns about accuracy, what kind of idiot names a company NABLA?

That alone is a major lawsuit. And if the transcription is incorrect, and results in very bad followup - like amputation when it wasn't called for, or lack of treatment when it was, that's billions and billions.

We've had this for about 20 years already with the copy machines. Instead of letting a copy degrade from something nearly unreadable to something even worse they'll make it better. This whole LLM thing is different just in scale. Sure, one might say that's the same difference between a squid and Einstein but I don't think see it yet.

I have not had it happen with the "advanced mode" version, but as recent as 2 weeks ago, the the ChatGPT voice chat tool would sometimes interpret background noise as either far-east Asian language or short phrases like "Thanks." I used the tool in my car and there is a fair bit of road noise. so if I paused during a conversation, it would think I said "Thanks" and keep replying with things like "You are welcome, I am happy to help!" At least it assumed I said good things?

In some markets, notably Florida, single company owns 70% of the healthcare market. Meaning wherever you go it's one company that owns basically everything.

From a practical standpoint they're going to try to squeeze every penny they can out of the system and that's going to mean worse outcomes for you. And that's going to mean corner cutting like this whether it works or not.

> Nabla's tool erases the original audio for "data safety reasons,"

It's in the manual, indexed under CYA.