Skip to main content
Sandy Wright

Sandy Wright

Head of Devices at Scarlet, medical device regulatory and quality affairs expert specializing in AI/LLM certification and CE marking.

Aug 31, 2026

10:04
So in your experience, what are the common areas where software medical device companies tend to get their non-conformities or areas where maybe they need to go back and revisit? What have you seen?
10:14
How long have you got? Yeah, I think...
10:18
It probably remiss of me maybe not to start with.
10:19
I think clinical evaluation is a common area where we're raising findings.
10:23
And I think it kind of makes sense because I think generating high quality clinical data and forming a robust clinical evidence base for a device is definitely, I think, one of the more challenging aspects of bringing a device to market.
10:36
So I think...
10:38
Areas where we may commonly raise findings might be around the methodology of the activities that have been used to generate clinical data.

8 MINS LATER

18:55
What makes the difference between a good PCCP rather than one that's just been made for the sake of it?
17:36
So mainly... we suppose like for example i work with some companies that are doing those devices like we have a camera that is making some pictures capturing some pictures and then identifying there is a cancer like for example when you do endoscopy or when you do whatever so this this kind of thing so which are more image related or other that are more signal related you you cough and then you identify what kind of cough is it or a stethoscope that measures the sound and then you are identifying if this is there is a disease etc What makes LLM different from those devices mainly? Is it the same or you are really having a different view when you receive a client and say, oh, I have a medical device with an LLM inside?
18:19
Yeah, I guess maybe what's interesting about those examples you provided is that the intended purpose, the scope of the intended purpose is quite specific.
18:33
It's analyzing a waveform from a stethoscope.
18:38
analyzing an image for like specific kind of like, uh, pathology.
18:43
And so I think one area where potentially like LLM based medical devices kind of deviate somewhat from, it kind of feels weird to say like traditional, um, but you know, like traditional kind of AI medical devices, I think is in this sort of like generative output.
18:58
So, um, The device isn't selecting from a fixed set of answers, right? It's constructing a response, potentially.
19:08
And so that output can be super broad and is generally fairly unbounded.
21:38
Is hallucination something that you are also talking about when we have this discussion with customers?

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.