Chapter 26: Quality Assurance and Quality Control

Welcome to Last Minute Lecture.

This free chapter overview is designed to help students review and understand key concepts.

These summaries supplement not replaced the original textbook and may not be redistributed or resold.

For complete coverage, always consult the official text.

Whenever you hear about forensic DNA evidence in the news, there's this immediate, almost inherent weight of certainty placed upon it.

It feels, well, infallible.

It does.

But for that science to truly hold up in a courtroom, we have to tackle a fundamental question.

How do we actually know?

How can the legal system and the public be sure that the DNA profile presented is reliably and validly produced?

That really is the core of it.

The science behind DNA is incredibly powerful, no doubt.

But it absolutely relies on standardized procedures and, let's face it, human beings running those tests.

Okay.

So our mission today is a deep dive into those mandatory meticulous systems designed to ensure integrity.

We're talking quality assurance and quality control, specifically using the standards developed for forensic biology labs.

All right.

Let's unpack this then.

Foundational concepts first.

We hear QA and QC all the time, quality assurance, quality control, sometimes used interchangeably.

But our source material draws a really crucial distinction.

And it's a key distinction for understanding the whole regulatory structure.

So quality assurance, or QA, that refers to the entire system.

That'd be a picture.

Exactly.

The overarching processes, the structure needed to guarantee the lab meets established requirements.

Think documentation, ensuring continuing education, proper training, setting up internal audits.

It's the framework, the philosophy, the rulebook, if you will.

Okay.

So if QA is the philosophy, the rulebook, then quality control, QC, sounds more like the daily practice.

Precisely.

QC covers the operational procedures.

It's the hands -on, day -to -day actions needed to meet those quality standards set by QA.

Well, like what specifically?

Think of QC as making sure the essential tools are working perfectly before you even start a test.

So rigorously testing chemical reagents, making sure instruments are maintained correctly, keeping calibration records updated.

QA sets the standard.

QC proves it's being followed hour by hour, day by day.

Got it.

And these standards didn't just appear out of nowhere, right?

They developed because DNA technology, while powerful, was initially pretty controversial back in the 80s.

That's right.

They evolved directly in response.

Let's look at the history of how the U .S.

tackled this regulatory challenge.

Okay.

So when DNA profiling first entered the criminal justice system in the 1980s, the methods were brand new.

They really needed serious scrutiny to be accepted legally.

And that oversight came from?

The National Research Council, the NRC, part of the National Academy of Sciences.

They stepped in.

And their first report, NRC in 1992, it covered basically everything, technical stuff, interpretation, ethics.

It did.

But the response was, well, mixed.

It actually sparked criticism from both the forensic science community and the legal community.

Why the pushback?

Well, it highlighted areas where maybe things weren't quite nailed down yet, especially around standardization and population genetics interpretation.

That hesitation, that criticism led directly to the formation of a second committee.

Which gave us the NRC type the second report in 1996, formed specifically to, quote, update and clarify discussion of the principles of population genetics and statistics.

What's fascinating here, though, is the shift this report represents.

It essentially declared that, quote, the reliability and validity of properly collected and analyzed DNA data should not be in doubt.

That sounds pretty definitive.

It was a very bold assertion, both politically and legally.

You could argue they didn't eliminate the doubt.

They just declared it shouldn't exist for properly handled evidence.

What was the impact of that?

Oh, it was enormous.

NRC sent us basically shifted the entire legal debate.

It allowed courts to stop wasting time questioning the fundamental science of DNA, which was accepted as valid.

And instead, it forced challenges to focus squarely on the application of the methods.

Was it done correctly in this specific lab for this specific case?

It really paved the way for DNA to become the powerful, reliable evidence we generally see it as today.

So as the science solidified, formal oversight became necessary, even mandatory.

The 1994 DNA Identification Act led to the DNA Advisory Board, the DAB, being formed in 1995.

Yes.

The DAB was really the foundational body in the U .S.

for this.

It operated until the year 2000.

Its main job.

Setting the first major quality assurance standards, not just for forensic DNA testing labs in 98, but also, importantly, for the convicted offender DNA Databasing Labs in 99.

Two separate but related sets of standards.

Okay.

And when the DAB's term ended in 2000?

The torch was passed to SWG DAM, the scientific working group on DNA analysis methods.

SWG DAM.

Heard of them.

Right.

They essentially became the engine room for DNA guidelines in the U .S.

They published comprehensive standards on QA programs, validation procedures,

complex interpretation protocols for different marker types like autosomal STRs, YSTRs, mitochondrial DNA.

So it shows this really rapid evolution driven by necessity, moving from a concept under pretty heavy fire to a highly regulated standardized field within, what, about a decade?

Exactly.

All focused on ensuring consistency across different labs and jurisdictions within the U .S.

Now, was this just a U .S.

thing or was the global community facing similar challenges with standardization?

Did they adopt the U .S.

standards or go their own way?

They absolutely faced the same challenges and created their own collaborative bodies.

You had groups like the International Society for Forensic Genetics, ISFG, which was very early in recognizing the potential.

And they spun off other groups.

Yes, like the European DNA Profiling Group, ED and EPPE.

They worked alongside other European groups like ENFSI and IEW PDP.

The common goal was consistency, compatibility.

And did this collaboration lead to tangible success, like a major standardization win?

Absolutely.

Their combined work led directly to establishing the European standard set, the ESS, for core autosomal SDR loci.

Why is that so critical, having a standard set like the ESS?

Well, think about it.

Without these joint efforts, sharing data across borders, say, matching a crime scene profile from France to an offender database in Germany, it would be incredibly difficult, maybe impossible, if they were using incompatible methods or looking at different genetic markers.

Standardization makes that feasible.

OK, this brings us neatly to the ultimate stamp of quality for a lab, accreditation.

What does that process actually involve?

Sounds intense.

It is intense.

Accreditation is the formal process used to assess a laboratory's overall qualification to meet all those established QAQC standards we've been talking about.

So it's like a top to bottom review.

Exactly.

A deep audit of the entire operation.

Management structure, personnel qualifications, are the procedures written down and followed, equipment maintenance logs, security protocols, everything.

How does a lab get accredited?

It requires a really exhaustive internal self -evaluation first, then preparing massive amounts of documentation.

And finally, a significant on -site inspection by an external independent body.

And in the US, those bodies are like ACLD lab for casework labs.

Correct.

ACLD lab is a major one for forensic casework.

And you also have bodies like AABB, often involved in DNA parentage testing accreditation.

So accreditation is typically granted for, say, five years.

But you mentioned earlier QA is ongoing.

Does that five -year certificate mean the lab can just relax?

Absolutely not.

That five -year window doesn't mean five years of rest.

Think of the accreditation body as the initial gatekeeper.

But the continuous audit cycle is the real enforcer.

Audits.

How often?

To maintain compliance, labs have to undergo audits constantly.

Typically, annual internal audits run by the lab itself, and then external audits conducted by the accrediting body, usually every other year.

And if they find problems during an audit?

Any problems found could be a procedural slip -up, a gap in documentation,

anything that must be meticulously documented.

And crucially, corrective actions have to be planned, initiated, signed off on, and verified.

This continuous monitoring loop is quality assurance in action.

Okay, so that brings us to the operational heart of QC, validation, and proficiency testing.

We've checked the big system, the rulebook, the audits.

Now we need to check the methods themselves, Exactly.

That's laboratory validation.

It's the process of confirming that a specific procedure used in the lab is sufficiently robust, reliable, and reproducible.

Can you break those down?

Robust, reliable, reproducible?

Sure.

Robust basically means the method performs successfully even if there are minor, unavoidable variations or errors in execution.

It can cope.

Reliable means it consistently produces accurate results.

And reproducible means you get the same or very similar result each time you run the test, ideally regardless of who runs it or minor variations in conditions.

And our source mentions two main kinds of validation, depending on the situation.

That's right.

So if your lab is adopting an established procedure that's already widely accepted, maybe you adopt in the latest commercial STR typing kit, you perform internal validation.

What does that involve?

It essentially demonstrates the method performs as expected in your specific laboratory, using your specific equipment, your reagents, your staff.

You're confirming it works correctly in your hands.

Okay.

Makes sense.

What's the other type?

That's developmental validation.

This is required when you are characterizing a new or novel methodology, perhaps developing a test for a brand new genetic marker or a significantly modified technique.

So that's much more involved.

Oh, yeah.

Developmental validation requires acquiring extensive test data to really determine the full conditions, the limitations, the sensitivity,

the potential error rates.

Basically defining the capabilities and boundaries of that novel methodology before it can even be considered for casework.

And all validation, whether internal or developmental, it's measured by precision and accuracy.

Correct.

Precision looks at the degree of agreement among your multiple measurements.

How close are your repeated attempts to each other?

It reflects random error.

Accuracy, on the other hand, looks at how close your measurements are to the actual known true value.

You check accuracy using things like performance check samples with known results.

Okay.

This next part seems really compelling.

Proficiency testing or PT.

This seems to shift the focus from the method itself to the person using the method.

How do they test for that human element, that potential for error, and how often?

Right.

PT evaluates both the lab's overall performance and the quality of performance by the individual analysts.

And the DAB standards mandate this testing every six months.

It's frequent.

How does it work?

Analysts are given mock forensic case samples.

These usually include question stains, like you'd find at a crime scene, and known reference samples, perhaps from a mock suspect or victim.

They process these samples just as if they were real evidence.

Like a normal case.

Exactly.

They run the analyses, interpret the results, and submit a full report for evaluation, just like any other piece of casework.

Now, the source makes a big deal about the difference between open and blind proficiency testing.

Why is that distinction so important?

It's absolutely vital for gauging true, everyday competence.

Open testing means the analyst knows they're being tested.

They know this sample is a PT sample.

So they might be extra careful, perform better than usual.

Potentially, yes.

There might be a subtle performance boost just due to that awareness.

Now,

blind testing, that's different.

In blind testing, the analyst is entirely unaware that the sample is a test case.

How do they manage that?

It's integrated seamlessly into the normal casework flow.

It looks and feels like any other piece of evidence coming into the lab.

Our sources really emphasize that blind testing, often provided by external bodies like CTS Forensics in the US or GDNAP in Europe, is considered the more effective means of evaluating consistent real -world performance.

It tests how they perform under normal conditions without the spotlight effect.

Okay, so layering over all this operational detail, the validation, the PT is the human element itself, the qualifications needed to even be an analyst, and the ethical code they must follow.

Let's look at the basic requirements set by DEV and SWGDAM first.

Yeah, these requirements are mandatory and quite specific.

An analyst needs, at minimum, a BA or BS degree in a biology, chemistry, or a forensic science related area.

But not just any science degree, right?

There's specific coursework needed.

Absolutely critical.

They must have successfully completed coursework at least nine semester hours total, or equivalent covering three core areas.

Okay, what are those core areas?

First, biochemistry.

Things like understanding DNA replication, Protein synthesis, cellular metabolism.

Second, genetics.

Concepts like heredity, genotype -phenotype, how cells divide like mitosis and meiosis.

And a third.

Molecular biology.

This is absolutely crucial.

It covers the techniques that underpin everything like PCR,

polymerase chain reaction, cloning, the central dogma of molecular biology.

Why is that molecular biology course specifically mandatory?

Because PCR, the polymerase chain reaction, is the engine of modern DNA profiling.

If you don't fundamentally grasp the molecular technology being used and how PCR works,

it's limitations you simply cannot competently perform or interpret the analysis.

You also need coursework in statistics and population genetics for the interpretation side.

And even with all that specialized education, that's still not enough to just start working cases independently.

Definitely not.

They need supervised experience first.

At least six months of hands -on forensic DNA laboratory experience, successfully analyzing a range of different sample types under supervision.

And they have to pass a specific qualifying test before they're allowed to initiate independent casework.

It's a rigorous path.

Beyond the mandatory requirements, there's also certification.

Is that required?

Certification, for example, through the American Board of Criminalistics, ABC,

is typically a voluntary process.

It recognizes professional qualifications beyond the minimum requirements.

Although it was worth noting, the big 2009 National Academy of Sciences report on forensic science did recommend making certification mandatory for forensic science professionals.

So,

voluntary but strongly encouraged.

Yes, very much so.

The ABC offers different levels, like diplomat, fellow, technical specialist, all requiring degrees, significant experience, and passing specialized exams and ongoing proficiency tests.

It's another layer of demonstrating competence.

Okay, this brings us to the ethical code.

This seems like the final, crucial guardrail.

Distinguishing correctness from incorrectness with serious consequences like expulsion for violations.

It really is.

This section defines the analyst's ultimate loyalty.

And that loyalty must be to the scientific method and to transparency.

Meaning?

Meaning, the methods used can never be secret or proprietary, hidden from scrutiny.

They have to be completely visible, documented, and verifiable by others.

You must use true scientific methods, employ appropriate experimental controls, and verify results if necessary.

No cutting corners.

The part about opinions in court testimony sounds like maybe the most difficult tightrope to walk.

It's arguably the bedrock of ensuring unbiased justice from the science side.

The forensic scientist's opinion must be objective.

It should not be influenced by matters unrelated to the specific evidence itself.

And the most critical line seems to be?

That the scientist must never choose an interpretation that favors the side of their employer.

It doesn't matter if they work for the prosecution or the defense,

their interpretation must be based solely on the scientific data.

So they have to present everything.

Even results that don't help their side.

Absolutely.

When testifying, they have an ethical obligation to present all relevant evidence and findings.

Not just cherry pick the details that support their employer's case.

They are loyal to the truth revealed by the data.

Full stop.

So if we pull all these threads together, connect it back to the bigger picture, what you see is that the entire structure of forensic biology is built on these layered quality checks.

And they seem specifically designed to withstand the pressures inherent in an adversarial legal system.

Precisely.

You've got the institutional standards like DABI and SWG DAM setting the baseline.

You have external accreditation from bodies like ACLD Lab proving overall lab competency.

You have validation confirming the specific methods work reliably.

And then proficiency testing, ensuring the individual analyst performs correctly, test after test, six months after six months.

This multi -level defense system is fundamentally why we can speak about the certainty, the reliability of DNA evidence today.

So what does all this mean for you, the listener, when you hear about DNA evidence?

Well, the integrity of the judicial system, at least where DNA is involved, relies entirely on the detailed, meticulous, sometimes yes, even dry adherence to these quality standards documents.

The journey from a science that was highly contested back in the early 90s to a globally standardized, heavily regulated field today is really quite remarkable when you think about it.

It really is.

And it views us with maybe this final provocative thought to consider.

The ethical code, as we discussed, mandates that a forensic scientist must be entirely unbiased.

They should never choose an interpretation just because it favors their employer.

Now, if that commitment to integrity is purely internal, purely based on individual ethics, well, that commitment can sometimes be fragile under pressure.

It raises an important question, doesn't it?

Considering those heavy pressures that are just inherent in any adversarial legal system,

is the external blind proficiency test, where the analyst is completely unaware they're being evaluated,

is that possibly the only truly reliable mechanism we have to ensure that unbiased scientific rigor remains the daily practice in the lab, rather than just an admirable aspiration written down in the code of ethics?

Something to think about?