A mechanical engineering company in Baden-Württemberg - 800 employees, two plants, IATF certification - spent two years searching for the right quality management software. The result: three failed implementation projects, a frustrated quality team and an Excel spreadsheet that still serves as the linchpin of the inspection data. Not because the providers delivered poor software. But because the selection criteria were set incorrectly.
The market for quality management software is confusing. Providers promise IATF conformity, AI-supported error analysis, seamless ERP integration and intuitive usability - often simultaneously, but rarely with substantial proof. Anyone who takes the promise as the basis for their decision is buying a license, not a solution.
The reality in manufacturing companies is different: QMS software not only has to meet standards, it has to be integrated into an ongoing production environment - with existing machines, existing MES and ERP systems, plant management processes and archiving obligations that extend up to 25 years into the future. What works in the demo must work on the store floor.
I have been supporting manufacturing companies for years with the introduction of quality data systems - from the initial workshop to productive operation in line production. What has become clear during this time is that the crucial questions when evaluating suppliers are not the ones that appear in RFP templates. This article provides the evaluation framework that quality managers and production managers actually need - with concrete criteria, tables and a step-by-step plan for system selection.
THE MOST IMPORTANT POINTS IN BRIEF
|
IN A NUTSHELL
|
Most lists of requirements for QMS software are created at the quality manager's desk. The problem is that what looks like a complete picture at the desk is often only half the reality in day-to-day production. The other half takes place on the production line - and this is where it is decided whether the software keeps its promise.
Quality management in production is not a documentary process. It is a real-time process. A test result that is not in the system three minutes after production is worthless for ongoing production control. A torque protocol that has to be transferred manually is not proof - it is a document with a risk of error.
The core: quality management software for production must record quality data where it is generated - at the machine, at the test station, at the worker - link it to the exact component and keep it permanently available for auditing, traceability and archiving. Everything else is downstream administration.
Real-time process data acquisition: Machine data, tightening curves and measured values are recorded automatically and accurately for each component - without manual input by the worker.
Component-accurate traceability: Each part has a data key (serial or batch number) that accompanies it through all systems and process steps.
Cross-system integration: QMS, MES and ERP speak the same language - without media disruptions, without Excel exports as an interim solution.
Audit-proof long-term archiving: Quality data can be retrieved in a tamper-proof manner for up to 25 years - even after system changes.
An automotive supplier with IATF certification typically requires proof of torques, use of test equipment, worker IDs and approval decisions per component - not per shift or per day. Systems that only document on a shift or batch basis fail to meet this requirement. In practice, this means: component key as a mandatory field in every data point, seamless audit trail across all system levels.
At first glance, the market for QMS software seems clear. Many providers promise digital quality processes, traceability and compliance. In practice, however, the systems differ significantly in terms of whether they come from ERP, document management, MES or directly from production.
| Provider | Focus | Strengths | Typical target group |
|---|---|---|---|
| SAP QM | ERP-integrated quality management | Deep ERP integration, master data, compliance | SAP-oriented companies and groups |
| Siemens Opcenter Quality | Production-related quality management | MES integration, traceability, store floor processes | Complex production environments |
| MasterControl | Compliance and document management | Audit and document processes | Pharmaceuticals, life sciences, regulated industries |
| ETQ Reliance | Enterprise QMS | Broad range of functions, workflows, compliance | Medium-sized companies and corporations |
| Intelex | Cloud QMS | Quality, environmental and safety management | Compliance-oriented companies |
| Q-DAS | SPC and quality data analysis | Statistical process control | Manufacturing companies with a focus on metrology |
| CSP Manufacturing OS | Quality management and process data in manufacturing | Quality inspection, process data acquisition, worker guidance, AI-supported anomaly detection and long-term archiving on one platform | All manufacturing industries |
For manufacturing companies, it is not only crucial whether a QMS solution supports documentation and audits. Equally important is how well it interacts with machines, systems, inspection processes and production data.
These are particularly relevant:
The right QMS software is therefore not automatically the most comprehensive solution. The decisive factor is whether it fits the production reality of the company.
Manufacturing companies evaluating quality management software too often ask about functions and too little about architecture. The following seven criteria are the ones that make the difference between success and failure in practice:
Interface architecture: which protocols are natively supported? OPC-UA, REST-API, MQTT? Proprietary interfaces are a long-term risk - they tie you to the provider and cause follow-up costs with every system change.
Component key consistency: Can the system use a serial number or batch number as a mandatory field across all data points? If this common key is missing, component-specific traceability is not technically possible.
Real-time capability: Is process data recorded in real time and made available for production control - or is it processed in batches? Real-time is mandatory for screwdriving curve monitoring or SPC during production.
Long-term archiving concept: How is data archived after 5, 10, 25 years? In open formats (PDF/A, XML, CSV) or proprietary? Is there a CHRONOS-like concept for inactive data without database dependency?
Scalability: How does the system perform with 50 million data points per month? Does the provider have references from comparable production volumes?
Implementation effort: How long does a typical implementation take? What internal resources are tied up? Is there a step-by-step introduction (module by module)?
Provider stability and support: How long has the provider been on the market? Is there German support? How are software updates handled when standards change?
PRACTICAL TIP
Manufacturing OS consists of five specialized modules that can be introduced individually or operated as an end-to-end platform. Each module solves a specific pain point - together they form the digital twin of your quality-relevant processes.
IPM (Integrated Process Data Management): Real-time recording of screwing, pressing, riveting, gluing and other joining processes - with automatic component file and OPC UA machine connection, regardless of manufacturer. Used by BMW, Mercedes-Benz, Knorr-Bremse and others.
→ Request a demo and discuss modular entry for your plant
Integration is the word that comes up in every QMS presentation - and is most often used misleadingly. "We integrate with SAP" can mean: A daily CSV export. Or: Bidirectional real-time interface with validated data transformation. The difference in practice is enormous.
Three integration levels are decisive for the QMS selection in production: the machine level (store floor), the MES level (production control) and the ERP level (order planning and controlling). Systems that only integrate at one of these levels create media discontinuities at the transitions - and media discontinuities are the most common cause of delayed reactions to quality deviations in quality assurance.
|
Integration level |
Typical data flows |
Critical protocol |
Risk in the absence of integration |
|
Machine level (OT) |
Process parameters, torques, curve progressions, sensor events |
OPC-UA, MQTT |
Manual logging, gaps in component file, no real-time alarm |
|
MES level |
Production order status, reject messages, setup data, SPC raw data |
OPC UA, REST API, DB integration |
Inspection results without production context, no component-specific linking |
|
ERP level |
Quality specifications, inspection plans, block bookings, complaint management |
REST API, SOAP |
Inspection specifications not up to date, quality status not in ERP, manual postings |
|
QMS internal |
Deviation reports, CAPA measures, audit records, calibration protocols |
Internal / database integration |
Information silos, CAPA without link to production data |
A typical production plant in the automotive supply industry has 15-40 different types of machines and systems from different manufacturers in use. QMS software that only natively connects the machinery of one manufacturer does not solve the problem - it shifts it. The requirement is therefore: manufacturer-independent machine connection via open standards, not via proprietary drivers.
The most common cause of failed QMS integrations is not the interface - it's the master data. These 10 questions must be answered before the first integration step:
Is there a unique serial number or batch number logic that is identical in all systems (ERP, MES, QMS)?
Is material master data in the ERP complete and up-to-date - in particular inspection characteristics and tolerances?
Are all machines and test equipment stored in the system with unique IDs?
Are calibration intervals and status digitally recorded for all test equipment?
Are work plan versions in the MES synchronized with the inspection plans in the QMS?
Are there defined limit values for each inspection characteristic that can be read out automatically?
Are worker IDs and shift assignments consistent across systems?
Is supplier master data with qualification status stored in the system?
Is there a defined process for master data changes (change management)?
Is the responsibility for data maintenance clearly defined for each data category?
Practical reference: At Knorr-Bremse, the introduction of the CSP software was accompanied by a three-month master data clean-up before the first interface was activated. IPM was introduced for process data acquisition and QST for screwdriving technology inspections. The result: complete data quality from the first day of production - instead of the typical 6-12 month start-up phase with corrections.
The conformity of QMS software to standards is a necessary condition, not a sufficient one. Every provider claims to be IATF-compliant. The question is not whether the software has a checkbox for IATF 16949 - but whether it fulfills the specific data model requirements that an IATF auditor actually makes during a component file inspection.
|
Standard / Section |
Requirement |
What the QMS must do |
Frequent gap in practice |
|
IATF 16949 - 8.5.2.1 |
Traceability at serial number level for safety-relevant parts |
Automatic linking of each data point with serial number as a mandatory field |
Traceability only on a batch basis, not at individual part level |
|
IATF 16949 - 7.5 |
Control of documented information - all quality-relevant records |
Versioning, release workflow, change history with operator ID and time stamp |
No audit trail for data changes, no versioning of inspection plans |
|
IATF 16949 - 8.6.2 |
Release of products and services according to inspection plan |
Documented release decision with operator ID, time stamp and test result |
Release as checkmark without documented decision context |
|
ISO 9001:2015 - 6.1 |
Risk-based thinking - identifying and addressing quality risks |
CAPA link with production data, root cause documentation |
CAPA without link to specific production parameters |
|
ISO 9001:2015 - 9.1 |
Monitoring, measurement, analysis, evaluation - data-supported decisions |
Real-time KPIs from production data, not just aggregated monthly reports |
Quality KPIs from manually compiled reports |
|
EU product liability 2024/2853 |
Manufacturer must be able to provide proof of exoneration for individual part level |
Component-specific process data can be retrieved as legal evidence |
Shift logs instead of component-specific evidence |
What an IATF auditor actually tests: The so-called component file sample. The auditor selects any part from the current or past production period and requests it within minutes: Material certificate of the raw material, all process parameters at the time of production, test results with test equipment ID, release decision with operator ID and the proof of delivery. Systems that require an IT specialist for this do not pass this test.
"After introducing IPM and QST, we have not only dramatically accelerated our audit preparation - for the first time we have the feeling of being truly traceable. Before, we had the data. Now we have the connections."
- Michael Wagner - Mercedes-Benz Group AG
Long-term archiving is regularly treated as a subordinate issue when selecting a QMS - a mistake that pays off years later. A manufacturing company that introduces QMS software today will still have to retrieve this data in 15 or 25 years' time. The EU Product Liability Directive 2024 has tightened the requirements even further: a liability period of up to 25 years after placing on the market applies to damage with a latent effect.
The problem: production databases are growing. In a medium-sized automotive production facility with 500 screwdriving points per day and component-specific curve recording, 50-100 GB of raw data is created each year. After five years the database is inert, after ten years it is a maintenance problem, after fifteen years it is a cost problem - if there is no archiving strategy.
|
Data category |
Max. Retention period |
Legal basis |
Archive format |
|
Test results, quality certificates |
25 years |
EU Product Liability Directive 2024/2853/EU |
PDF/A, XML with XSD, CSV with schema |
|
Batch data, traceability |
25 years |
EU Product Liability Directive 2024 |
Structured, component-specific retrievable |
|
Production parameters (safety-relevant) |
25 years |
IATF 16949 - 8.5.2.1 + EU-PH |
Open formats, no proprietary DB format |
|
Calibration protocols, test equipment data |
15 years |
IATF 16949 - 7.1.5 |
Structured, with validity period |
|
Tax-relevant records |
10 years |
GoBD / § 147 AO |
Automatically analyzable, unalterable |
|
Personal user logs |
Deletion after end of purpose |
DSGVO Art. 17 |
Verifiable deletion with log |
CSP has developed CHRONOS for this problem - an archiving system that identifies inactive production data, converts it into open, long-term secure formats and stores it on separate storage without burdening the production database. The economic effect is considerable: in a documented use case, a manufacturing company was faced with the choice between 1.2 million euros per year for a classic database expansion and approx. 20,000 euros for CHRONOS archiving. The productive database became 80% smaller and query performance improved measurably.
A QMS introduction is not an IT project. It is an organizational project with an IT component. The most common cause of delayed or failed implementations is not the technology - it is the lack of close cooperation between quality management, production and IT right from the start.
Step 1 - As-is analysis and scope definition (4-6 weeks): Which processes should be covered? Which systems are in place? Which standard requirements apply? The inventory clarifies which system type actually fits - and avoids the purchase of an enterprise QMS for a store floor use case. Result: documented requirements profile, prioritized use cases, IT landscape sketch.
Step 2 - Master data audit (4-8 weeks, parallel to step 1): Without clean master data, any integration will fail. Serial number logic, inspection characteristics, machine master data, test equipment master - everything that is transferred to the new system must first be checked for completeness and consistency. This step is most often underestimated.
Step 3 - Vendor shortlist and structured evaluation (4-6 weeks): Shortlist a maximum of three providers. Evaluation according to the criteria matrix from section 7 of this article. Demo appointments with own test data set (not with the provider's demo data). Reference visits to comparable manufacturing companies - not just reading reference lists.
Step 4 - Pilot (6-12 weeks): One production line, one manufacturing area. The pilot provides real data: Implementation effort, data point volume, integration issues, user acceptance. Important: Parallel operation with the old system remains active until the new flow has been validated.
Step 5 - Rollout (after pilot, 3-6 months per plant): Gradual expansion to other lines and plants. Change management, worker training and process adjustments run in parallel. Critical: Data quality control continues to be intensified in the first six months.
The following matrix is not an academic construct. It is the result of dozens of provider evaluations in the DACH manufacturing industry - reduced to the criteria that actually determine suitability for everyday manufacturing. Each criterion can be rated 0-3: 0 = not fulfilled, 1 = partially fulfilled, 2 = fulfilled, 3 = exceeded.
|
Evaluation criterion |
Weighting |
Test question in the demo appointment |
|
Machine connection (OPC-UA native) |
High |
Show live how a data point flows from machine X into the system - without manual export. |
|
Component key consistency |
High |
How is the serial number enforced as a mandatory field in every single data point? |
|
MES/ERP integration (depth) |
High |
Which data flows are bidirectional, which are unidirectional? Show the ERP feedback live. |
|
Real-time alarm when limits are exceeded |
Medium |
How long between event and alarm in the system? Who is notified and how? |
|
Long-term archiving (open formats) |
High |
How will data be retrievable in 15 years without an active database? Show the archive format. |
|
Audit trail (immutability) |
High |
Can an administrator change measured values retrospectively? What happens if he tries? |
|
User interface Shop floor suitability |
Medium |
How many clicks does a worker need for the most frequent action? Demo without user preparation. |
|
IATF component file test |
High |
Find any part from the demo data set and show the complete part file in 2 minutes. |
|
Implementation effort (reference) |
Medium |
Name three reference customers with a comparable system landscape and let us call them. |
|
Provider stability and DACH support |
Medium |
How long have you been in the market? How many employees in DACH? What is the support procedure for critical production disruptions? |
This matrix can be used directly as a basis for the supplier RFP. Experience shows that 60-70% of providers are already eliminated during the machine connection and component file test - not because they have no software, but because their software was developed for administrative processes, not for store floor real-time requirements.
QMS software is the generic term for software that digitizes quality management processes. In the manufacturing industry, this specifically refers to systems that cover inspection processes, production data acquisition, traceability and conformity to standards (IATF 16949, ISO 9001). General quality management software - from the service sector, for example - often focuses on document management and audit planning, without the machine connection and component-specific data allocation that are crucial for production. Manufacturing QMS must function at store floor level.
Automotive suppliers need QMS software that covers IATF 16949 sections 8.5.2.1 (component-specific traceability) and 7.5 (control of documented information with audit trail). The ability to trace serial numbers at individual part level - not just on a batch basis - is crucial. The CSP software covers these requirements with several modules: IPM records process data directly from the machine with component accuracy, QST documents inspection processes in an audit-proof manner, PG ensures correct execution at the worker's workstation and CHRONOS archives all data in open formats for the required 15-25 years. Important: Before selecting a system, check the OEM-specific requirements (BMW, Mercedes-Benz, Volkswagen) - these may go beyond the IATF minimum requirements.
Realistically 6-18 months for a full implementation in a medium-sized manufacturing company (200-2,000 employees, 1-3 plants). Pilot operation on one line is typically possible after 3-4 months. The CSP Quality Suite allows a modular introduction: if you start with IPM for process data acquisition, you can later add QST, PG and CHRONOS step by step - without replacing the basic system. The most frequent delays do not occur in the software, but in the master data cleansing and change management phase.
The cost range is considerable and depends on the system type, license model and scope of integration. As a rough guide: Specialized manufacturing QMS solutions typically range between 30,000 and 200,000 euros initial investment (software, integration, training), plus annual license and maintenance costs of 15-25% of the initial investment. The CSP Quality Suite is modular: It is possible to start with one module, with expansion taking place gradually. Enterprise QMS solutions (ERP-related) are often more expensive to implement because the customizing effort for store floor requirements is considerable. The ROI for well-planned projects is typically 2-4 years.
Not necessarily - but for manufacturing companies with safety-relevant components and IATF requirements, MES integration is the decisive factor for auditable evidence. Without MES integration, the production context is missing from the inspection results: The QMS knows the inspection result, but not the process parameters under which the part was manufactured. IPM and QST from the CSP Quality Suite are designed for precisely this transition - they record process data directly at the machine and automatically link it to the quality certificate without the need for a separate MES as an intermediary.
The EU Product Liability Directive 2024/2853/EU extends the definition of manufacturer to include AI-supported decisions and extends the liability periods for latent damage to up to 25 years. For QMS software, this means that production data must be retrievable as legal evidence for 25 years after being placed on the market - component-specific, tamper-proof and in open formats. CHRONOS from the CSP Quality Suite has been developed precisely for this application: Data is archived independently of the database manufacturer and can still be retrieved without special software even after a system change in 15 years.
No - and this is not a limitation of the technology, but a regulatory requirement. Under ISO 9001, IATF 16949 and the EU AI Act (for high-risk AI systems in safety-critical industries), the final approval decision must be made by a qualified human decision-maker. AI can provide decision support - Curve Anomaly AI from the CSP Quality Suite, for example, recognizes anomalies in screw curves and marks conspicuous connections for human review. The responsibility always lies with the quality manager or production manager.
An MES (Manufacturing Execution System) controls and documents the ongoing production process in real time: machine occupancy, feedback, process parameters. A QMS focuses on quality assurance: inspection processes, conformity to standards, deviation management, CAPA, audit documentation. In practice, the systems overlap considerably. Manufacturing OS from CSP combines process data acquisition (IPM) with quality testing (QST), worker guidance (PG), AI anomaly detection (Curve Anomaly AI) and long-term archiving (CHRONOS) - as a modular platform that integrates into existing MES and ERP landscapes without replacing them.