I have yet to walk into a manufacturing company that does not have a supplier scorecard. Most of them are impressive-looking documents — colour-coded, weighted, automated, fed directly from the ERP. And most of them are worse than useless. They are actively misleading.
The problem is not the scorecard itself. The problem is what we choose to measure, how we aggregate it, and what behaviour it drives on the supplier side. After twenty years of managing supplier quality across automotive and aerospace, I can tell you that the scorecard most companies use today was designed by procurement, not by quality. And it shows.
On-time delivery is not a quality metric
Every scorecard I see leads with on-time delivery. It is usually weighted at 40 percent or more. Here is the problem: a supplier can deliver 100 percent on-time by shipping early, shipping partial quantities, or shipping parts that pass incoming inspection but fail downstream. I have seen suppliers who gamed the delivery metric so aggressively that their components had a 30 percent field failure rate. Their scorecard said they were green. Their parts were in customer returns.
On-time delivery tells you about logistics. It tells you nothing about whether the parts are good.
The PPM trap
PPM — parts per million defective — is the second sacred cow of supplier scorecards. It sounds scientific. It sounds precise. But PPM is only as honest as your detection system. If your incoming inspection samples five pieces out of a lot of ten thousand, your PPM is a statistical guess, not a measurement. I have seen suppliers with "zero PPM" for years because nobody was inspecting the critical characteristics.
The real question is not what your detection system caught. The real question is what your customer found that your detection system missed.
A scorecard that measures detected defects is a scorecard of your inspection system, not of supplier quality.
What your scorecard is actually doing to your suppliers
Suppliers are not stupid. They read your scorecard and they optimise for it. If you weight delivery at 40 percent, they will ship early. If you weight PPM, they will negotiate looser acceptance criteria. If you weight cost reduction, they will cut corners on process control. The scorecard does not measure supplier performance — it shapes it. And most scorecards shape it in the wrong direction.
I sat in a supplier review meeting where a top-rated supplier was being praised for their scorecard performance. Green across the board. Two weeks later, we discovered they had been quietly deviating from the agreed material specification for eighteen months. Their scorecard was perfect because the scorecard measured compliance, not conformance to intent. The supplier had optimised for the metric, not for the product.
The scorecard I actually use
Over the years, I have stripped supplier scorecards down to four metrics that actually predict supplier performance:
1. Escape rate to customer. Not incoming PPM. Not internal reject rate. How many of this supplier's parts made it all the way through your process and were found defective by your customer? This is the only defect metric that matters, because it measures the true cost of the supplier's quality.
2. Responsiveness to nonconformances. When you raise an 8D, how long does it take the supplier to submit a credible root cause analysis? Not the initial response — the credible one. I measure the gap between "8D opened" and "containment verified." Suppliers who respond in 48 hours are partners. Suppliers who respond in two weeks are vendors.
3. Proactive communication. Does the supplier tell you about problems before you find them? This is binary and powerful. A supplier who calls to say "we had a process upset on line three, we are holding the shipment" is worth ten who wait for you to discover it at incoming inspection.
4. Cost of poor quality passed through. Not price variance. Not cost reduction. The actual cost of dealing with this supplier's failures — sorting, rework, line downtime, expedited freight, customer credits. This number is uncomfortable to calculate, which is exactly why most companies do not calculate it. But it is the truest measure of what the supplier costs you.
The conversation the scorecard should start
A scorecard is not a verdict. It is the opening of a conversation. The problem with most scorecards is that they are used as weapons in negotiation rather than as diagnostic tools for improvement. Procurement uses them to beat down prices. Suppliers respond by hiding problems. The scorecard becomes part of the dysfunction.
I use scorecards to ask one question: where does this supplier need help? Not where are they failing — where do they need investment, development, support? The suppliers who improve are the ones who get developed, not the ones who get threatened. And the scorecard, done right, tells you exactly where to focus that development.
Your supplier scorecard is lying to you. Not because the numbers are wrong, but because the numbers are measuring the wrong things. Stop measuring compliance. Start measuring behaviour. Stop rewarding suppliers who game the system. Start developing suppliers who communicate honestly. The scorecard that drives improvement looks nothing like the scorecard that drives compliance. Choose which one you want to live with.
