FAQ Tag: change control

  • How do I handle KPIs for events that span multiple shifts?

    Use a single authoritative event record, not separate shift-specific copies of the same event.

    For KPIs, the usual approach is to timestamp the event start and end, preserve the full event lineage, and then allocate the impact across shifts using a defined rule. Which rule is right depends on the KPI, the process, and the level of traceability your systems can actually support.

    In practice, this connects to operational visibility when teams need to turn the answer into repeatable execution habits.

    What usually works

    • Keep one event ID for the full event. Do not split the source record just because the clock crossed a shift boundary. Splitting creates reconciliation problems, duplicate counts, and disputes during review.

    • Allocate performance impact separately from event identity. The event stays whole, but downtime, delay minutes, scrap exposure, labor impact, or lost output can be apportioned by shift.

    • Document one allocation rule per KPI family. For example, downtime may be allocated by minute overlap, while accountability may be assigned to the shift that owned recovery actions or the work center at the time of occurrence.

    Common allocation methods

    • Time-overlap allocation: Assign impact to each shift based on actual minutes within that shift. This is usually the most defensible method for downtime, NPT, and utilization metrics.

    • Point-in-time attribution: Assign the entire event to the shift where it started, ended, or was first detected. This is simpler, but it can distort shift comparisons and encourage gaming.

    • Responsibility-based attribution: Assign the event to the team, area, or shift responsible for cause, response, or clearance. This can be useful for continuous improvement review, but it should not replace time-based operational reporting unless that choice is explicit.

    • Hybrid model: Use one rule for operational KPIs and another for management accountability. This is often necessary in real plants, but only if the definitions are controlled and consistently applied.

    Important tradeoffs

    No allocation method is neutral.

    • Time-based allocation improves fairness for production reporting, but it may hide where the problem originated.

    • Start-shift attribution is easy to calculate, but it can unfairly penalize one shift for a problem that persisted for many hours.

    • Responsibility-based attribution supports improvement actions, but it depends on disciplined cause coding and reliable handoff records.

    • Hybrid reporting can be practical, but it increases governance burden and confusion if labels are vague.

    If leadership wants one number for every purpose, that is usually where reporting quality breaks down.

    What to standardize

    At minimum, define and control the following:

    • Event start, end, pause, and resume rules

    • Whether the KPI is measuring occurrence, duration, impact, or accountability

    • How shift calendars, breaks, overtime, and holiday schedules are handled

    • How overlapping events are treated

    • How planned versus unplanned conditions are classified

    • Who can edit event timestamps or reason codes, and under what change control

    • How late data corrections are versioned and auditable

    Without that governance, cross-shift KPIs become argument generators rather than management tools.

    Brownfield system reality

    In mixed MES, ERP, historian, SCADA, CMMS, and spreadsheet environments, multi-shift KPI handling often fails because each system defines time, status, and ownership differently. Shift boundaries may live in one system, event logs in another, and final management reports in a third.

    In that situation, do not assume a dashboard can fix the issue by itself. You usually need:

    • a canonical event model or at least a controlled mapping between systems

    • master data alignment for assets, work centers, and calendars

    • clear precedence rules when timestamps disagree

    • traceable correction workflows for late or revised records

    Full replacement is often unnecessary and often unrealistic in regulated, long-lifecycle operations. Replacing MES or surrounding systems just to clean up shift-spanning KPIs can trigger validation work, interface requalification, downtime risk, and evidence continuity problems. In most plants, a governed coexistence model is more practical than rip-and-replace.

    Practical recommendation

    For most operations, use this pattern:

    1. Create one event record with immutable start and end timestamps.

    2. Allocate duration-based KPIs by actual overlap with each shift.

    3. Track root-cause and corrective-action accountability separately from shift duration.

    4. Version any post-close edits and retain the original record for auditability.

    5. Publish the rule set so supervisors, quality, engineering, and finance are using the same logic.

    That approach is usually the best balance of fairness, traceability, and analytical usefulness. But it only works if event capture is timely, shift calendars are reliable, and integration logic is controlled.

  • How long does it realistically take to implement a manufacturing KPI framework?

    In most plants, a manufacturing KPI framework takes 3 to 12 months to become operational, trusted, and used in routine management. A limited pilot can often be launched in 6 to 12 weeks, but that is not the same as having a durable framework that supports decisions across shifts, lines, sites, and functions.

    The main constraint is usually not dashboard development. It is agreeing on metric definitions, proving data quality, mapping data across existing systems, and putting governance around changes so the numbers remain traceable over time.

    In practice, this connects to implementation and adoption playbooks when teams need to turn the answer into repeatable execution habits.

    What the timeline usually looks like

    • 6 to 12 weeks: initial assessment, KPI selection, definition workshops, source-system review, and a basic pilot for a narrow scope.
    • 2 to 4 months: first production use for one area or value stream, assuming the required ERP, MES, historian, quality, and manual data sources are accessible and reasonably clean.
    • 4 to 9 months: KPI framework becomes repeatable, with agreed definitions, owner assignments, review cadence, and exception handling.
    • 9 to 18 months: broader rollout across multiple plants, programs, or product families, especially where data models, local practices, and legacy systems differ.

    Those ranges vary materially by process maturity, integration quality, master data consistency, and how much of the current reporting process depends on spreadsheets or manual interpretation.

    What makes it slow

    In regulated and brownfield environments, the time is usually consumed by coexistence work:

    • ERP, MES, PLM, QMS, historian, and maintenance systems use different identifiers and timestamps.
    • Operators and supervisors may record similar events differently by shift or department.
    • Legacy equipment may not expose reliable machine-state data.
    • Existing reports often use unofficial logic that no one documented formally.
    • Any KPI tied to product disposition, quality status, or release decisions may require tighter validation and change control.

    This is why full replacement is often the wrong assumption. Replacing core systems just to get cleaner KPIs usually fails in long lifecycle, regulated operations because the qualification burden, downtime risk, integration complexity, and traceability impact are too high. In practice, most plants build the KPI framework around coexistence with current systems and improve data quality incrementally.

    What determines the timeline most

    • Scope: one line is faster than enterprise standardization.
    • Definition discipline: if teams do not agree on what counts as downtime, rework, schedule attainment, or first-pass yield, implementation will stall.
    • Data readiness: missing timestamps, inconsistent part or work-order keys, and weak genealogy slow everything down.
    • Integration method: direct point-to-point extracts may be quick initially but create maintenance debt later.
    • Governance: without formal ownership and change control, KPI disputes continue after go-live.
    • Validation needs: if metrics feed regulated reporting, batch review, deviation analysis, or quality escalation, more verification is needed.

    What is realistic to expect

    A realistic goal is not to have every KPI perfect at once. It is to establish a small set of trusted metrics, define calculation logic clearly, document source systems, identify known limitations, and create a controlled process for changes.

    If you want a framework that leaders actually rely on, expect at least:

    • a documented KPI dictionary,
    • source-to-metric mapping,
    • data quality checks,
    • named metric owners,
    • review cadence and escalation rules,
    • and a managed process for revising definitions.

    Without those controls, implementation can appear fast but usually turns into recurring argument about whose number is correct.

    Bottom line

    Realistically, plan for 3 to 12 months for a credible manufacturing KPI framework, with 6 to 12 weeks for a narrow pilot and 9 months or more for cross-site standardization. If your environment is heavily manual, highly customized, or fragmented across legacy systems, it can take longer.

  • Can an aerospace supplier use its own FAIR template instead of the AS9102 forms?

    Yes, but only if the customer and your documented quality system allow it.

    AS9102 generally permits equivalent forms, not just the published standard form layout. The important point is not whether the document looks identical to Forms 1, 2, and 3. The important point is whether your format captures all required AS9102 content completely, accurately, and with clear traceability to the design data, part configuration, characteristics, results, and accountability records.

    In practice, this connects to digital AS9102 FAI when teams need to turn the answer into repeatable execution habits.

    In practice, that means a supplier can use its own FAIR template only when all of the following are true:

    • The customer contract, purchase order, quality clauses, and flowed-down requirements do not explicitly require the AS9102 forms or a specific portal format.
    • Your internal procedure defines the alternate format and when it is allowed.
    • The template contains all required AS9102 information with no omissions.
    • The mapping from your template to AS9102 requirements is clear enough for review, audit, and handoff.
    • The people preparing and approving FAIRs are trained on the alternate format.

    If any customer requirement says to use the AS9102 forms, Net-Inspect, or another mandated submission format, then the answer is no for that job. A supplier cannot unilaterally substitute its own template just because it believes the content is equivalent.

    What usually causes problems

    Most failures are not about the template branding. They are about missing fields, weak traceability, or inconsistent interpretation. Common failure modes include:

    • Characteristic accountability that does not clearly tie back to the drawing, model, or ballooned requirement set.
    • Incomplete material, special process, or functional test references.
    • Missing linkage between part number, revision, FAI scope, and lower-level detail parts.
    • Poor control of form revisions across sites or programs.
    • Custom spreadsheet logic that changes without review, validation, or version control.
    • ERP, MES, PLM, QMS, or inspection system integrations that populate fields inconsistently.

    Those issues matter more in regulated, long-lifecycle environments because evidence has to remain understandable and defensible long after the original team has changed.

    Brownfield reality

    Many aerospace suppliers use a hybrid approach. They keep customer-facing AS9102 output in the required format while generating portions of the FAIR record from existing MES, ERP, PLM, CMM, or QMS systems. That is often more realistic than replacing everything with a single new FAI platform.

    Full replacement strategies often fail when plants have legacy inspection workflows, validated quality processes, customer portal dependencies, and long equipment lifecycles. The qualification burden, change control overhead, downtime risk, and integration complexity are usually higher than expected. For that reason, many organizations standardize the data mapping and evidence trail first, then decide whether the front-end template itself needs to change.

    Practical test

    If you are considering a custom FAIR template, ask these questions:

    • Does any customer or prime require the standard AS9102 forms or a named submission system?
    • Can you demonstrate one-to-one coverage of AS9102-required content?
    • Is the template revision-controlled and governed through change control?
    • Can reviewers quickly find drawing accountability, objective evidence, and approval history?
    • Will the record still be understandable if reviewed months or years later by a customer, auditor, or a different internal team?

    If the answer to any of those questions is no, using your own template is high risk even if it seems operationally convenient.

    So the short answer is: yes, an aerospace supplier can sometimes use its own FAIR template instead of the AS9102 forms, but only where equivalent content is preserved and customer requirements do not mandate the standard forms or a specific system.

  • How do formula changes affect historical KPI traceability?

    They can affect it significantly.

    If a KPI formula changes and your system does not retain the prior formula version, effective date, source mappings, and calculation logic used at the time, then historical KPI traceability is weakened or lost. You may still have old numbers, but you may no longer be able to show exactly how they were produced.

    In practice, this connects to data integrity, version control and audit when teams need to turn the answer into repeatable execution habits.

    In a well-controlled setup, historical KPI traceability is maintained by versioning the KPI definition and preserving the calculation context for each reported result. That usually includes the formula version, unit and normalization rules, source systems, filters, aggregation logic, exception handling, and the approval or change record tied to the change.

    What should happen when a formula changes

    • Past results should remain linked to the formula version in effect when they were calculated.

    • The new formula should have a clear effective date or effective event.

    • Reports should make clear whether values are shown as originally calculated or retrospectively recalculated.

    • Any recalculation should be controlled, documented, and justified, not done silently.

    Without those controls, a trend line can become misleading. A performance shift may reflect a metric definition change rather than an operational change.

    Freeze versus recalculate

    There is no single correct approach for every plant or KPI.

    • Freeze historical results: Better for auditability and period-correct reporting. The tradeoff is weaker comparability across time if the definition changed materially.

    • Recalculate history using the new formula: Better for like-for-like analytics. The tradeoff is that originally reported values no longer match prior management reports, investigations, or quality records unless both versions are retained.

    • Keep both: Often the safest approach in regulated environments. One version supports historical evidence, and another supports normalized trend analysis. The cost is added governance, storage, reporting complexity, and user training.

    What matters in brownfield environments

    In mixed MES, ERP, historian, QMS, and BI stacks, formula traceability depends less on the dashboard than on upstream data lineage and change control. If one layer changes mappings, timestamps, units of measure, work center hierarchies, or exclusion rules, KPI history may shift even if the displayed formula text looks unchanged.

    This is a common failure mode in brownfield environments: the KPI appears stable, but source semantics changed across systems or interfaces. For example, a downtime KPI may move because event classification changed in MES, or a yield KPI may move because rework transactions began posting differently from ERP or QMS.

    That is why full replacement is often not the practical answer. In regulated, long-lifecycle operations, replacing all contributing systems to standardize KPI logic can fail due to qualification burden, validation cost, downtime risk, and integration complexity. In most cases, the workable approach is controlled coexistence: version the KPI definition, document source dependencies, and maintain traceable mappings across existing systems.

    Minimum controls needed

    • Version-controlled KPI definitions

    • Effective dates and change history

    • Traceable source-to-metric mappings

    • Documented business rules and exclusions

    • Approval workflow and change control records

    • Clear labeling of recalculated versus original values

    • Retention of prior outputs used in operational or quality decisions

    So the short answer is yes: formula changes can affect historical KPI traceability, and sometimes invalidate comparisons, unless your architecture and governance preserve formula versioning, lineage, and calculation context explicitly.

  • How can I align supplier KPIs without forcing them to change ERP or MES systems?

    Yes. In most regulated, brownfield supply chains, that is the practical approach.

    You usually align supplier KPIs by standardizing the measurement model, not by forcing a common ERP or MES. That means agreeing on KPI definitions, event timestamps, units of measure, inclusion and exclusion rules, reporting cadence, and the minimum evidence required to support each number. Each supplier can then map data from its current systems, spreadsheets, portals, or manual processes into that common model.

    In practice, this connects to data mapping and system interoperability when teams need to turn the answer into repeatable execution habits.

    Trying to force system replacement across suppliers is often unrealistic. It creates qualification and validation burden, raises downtime and change-control risk, and pushes integration complexity onto organizations with very different process maturity levels. In long-lifecycle, regulated environments, those programs often stall or fail before the KPI problem is actually solved.

    What usually works

    • Define a small KPI set first. Start with a limited set such as on-time delivery, lead time adherence, quality acceptance rate, responsiveness to corrective actions, and documentation completeness. If you start with too many metrics, governance breaks before adoption stabilizes.
    • Publish canonical definitions. For each KPI, document the formula, business rules, source events, time zone handling, late change handling, and which transactions count. Many supplier scorecard disputes come from different definitions, not poor performance.
    • Specify evidence requirements. If a supplier reports a KPI, define what evidence must back it up, such as ASN events, receiving records, inspection results, shipment confirmations, NCR references, or approved exceptions. This matters more than the dashboard itself.
    • Allow multiple submission paths. Mature suppliers may send system-to-system feeds. Others may use CSV templates, portal forms, EDI messages, or API integrations. Forcing one method usually excludes part of the supplier base.
    • Map local data to a common data model. Align supplier-specific fields and status codes to a shared structure. This is where most of the work is. The KPI only becomes comparable if order states, revisions, ship dates, receipt dates, and quality dispositions are interpreted consistently.
    • Track definition changes under change control. If KPI logic changes, version it. Otherwise historical comparisons become misleading and supplier trust drops quickly.

    What to standardize

    If you want KPI alignment across mixed supplier systems, standardize these items first:

    • KPI name and business intent
    • Formula and rounding rules
    • Numerator and denominator logic
    • Date and time anchors
    • Revision and change-order treatment
    • Unit of measure normalization
    • Exception handling
    • Required source records and retention expectations
    • Submission frequency and cut-off timing
    • Dispute and correction workflow

    Without that level of precision, two suppliers can both report 98 percent on-time delivery while measuring different realities.

    Limits and tradeoffs

    This approach does not eliminate variation. It makes variation manageable.

    • Data quality remains a constraint. If supplier master data, item revisions, receipt events, or quality dispositions are inconsistent, your aligned KPI will still be unreliable.
    • Manual suppliers need accommodations. Some lower-volume or specialized suppliers may not have system events at the granularity you want. You may need staged maturity targets rather than immediate full automation.
    • Comparability has a cost. The more precisely you define metrics, the more onboarding, mapping, and governance effort you create.
    • Near-real-time visibility is not always realistic. Some suppliers can provide daily or event-driven updates. Others will only support weekly or periodic reporting without significant integration work.
    • One score can hide operational differences. Aggregated KPIs are useful for management, but they can mask part-family complexity, outside processing constraints, or document-related delays.

    So the answer is yes, but only if you accept that KPI alignment is partly a data governance program, not just a reporting project.

    Recommended operating model

    A practical model in mixed environments is:

    1. Define the supplier scorecard and KPI glossary.
    2. Establish a canonical data model for the required events and attributes.
    3. Segment suppliers by digital maturity and criticality.
    4. Offer multiple data exchange options based on that segmentation.
    5. Validate mappings with sample transactions before going live.
    6. Run a dispute process for early scorecard periods.
    7. Version KPI logic and retain traceability for restatements.

    This is generally lower risk than demanding ERP or MES replacement, especially where suppliers operate qualified processes, legacy interfaces, or long-depreciated equipment that cannot be changed easily.

    When you may need more than KPI alignment

    If your real problem is not just reporting inconsistency but poor execution visibility, missed outside processing milestones, or weak traceability, a scorecard alone will not fix it. In those cases, you may need supplier collaboration workflows, milestone capture, exception management, and tighter PO to work-order linkage. Even then, coexistence with existing ERP and MES is usually the safer path than rip-and-replace.

  • How should suppliers document the rationale for not performing an FAI after a change?

    Suppliers should document it as a controlled, traceable decision record, not as an informal note. If a change occurs and the supplier determines that a full or partial FAI is not required, the file should clearly show what changed, how the FAI impact was evaluated, what objective evidence supports the conclusion, and who approved the decision under the supplier’s quality system and any applicable customer requirements.

    In practice, the rationale should usually include:

    In practice, this connects to digital AS9102 FAI when teams need to turn the answer into repeatable execution habits.

    • identification of the part number, revision, job, lot, or affected configuration

    • a clear description of the change, including date, source, and whether it was design, process, tooling, software, inspection method, material, source, sequence, or documentation related

    • an assessment of whether the change affects form, fit, function, performance, manufacturability, inspection results, or characteristic accountability

    • the specific reason the supplier concluded that a new or partial FAI was not triggered

    • objective evidence supporting that conclusion, such as unchanged drawings, unchanged characteristics, validated equivalent tooling, unchanged manufacturing route, capability data, prior FAI records, engineering disposition, or customer direction if applicable

    • cross references to the governing procedure, change record, risk review, and approval record

    • approval by authorized functions such as quality and engineering, based on the supplier’s documented process

    The documentation should be specific. Statements like “no impact to quality” or “minor change only” are usually too weak on their own. An auditor, customer, or internal reviewer should be able to understand the logic without relying on tribal knowledge.

    What good documentation looks like

    A practical record usually answers five questions:

    1. What changed?

    2. What FAI trigger criteria were reviewed?

    3. Why did the change not affect accountable characteristics or the validated production method in a way that requires FAI activity?

    4. What evidence supports that conclusion?

    5. Who reviewed and approved the decision, and under what procedure or change control workflow?

    If the answer depends on customer interpretation, supplier flowdown, delegated authority, or contract language, that dependency should be stated explicitly. In some programs, a supplier may still need customer concurrence even when the supplier believes no FAI is required.

    Common evidence sources

    • engineering change review showing no effect on product characteristics

    • process change assessment showing no effect on qualified or validated output

    • tooling replacement documented as like for like, with verification results

    • inspection method changes shown to be equivalent and controlled

    • material or source changes evaluated through approved change control

    • prior FAI package and subsequent production evidence showing continuity

    • customer communication or requirement matrix, if that is part of the decision basis

    That said, evidence quality matters. A weak assessment wrapped in a well formatted form is still a weak assessment.

    What to avoid

    • informal email only, with no controlled record

    • generic justifications copied across parts or programs

    • no linkage to change control or revision history

    • no identification of affected characteristics, tools, or process steps

    • assuming ERP, MES, PLM, or QMS records are automatically sufficient without a clear decision narrative

    In brownfield environments, the supporting evidence is often split across systems and spreadsheets. That is common, but it creates review risk. If the rationale depends on data from PLM, ERP, MES, QMS, metrology software, or supplier portals, the supplier should link those records explicitly and ensure revision alignment. Otherwise, it becomes difficult to prove that the decision was based on the correct configuration and current process state.

    Suppliers also should not assume that system replacement is the answer. In regulated aerospace and other long lifecycle environments, replacing core quality or execution systems to fix documentation gaps often fails because of validation burden, downtime risk, integration complexity, and the need to preserve traceability across legacy records. A more realistic approach is usually to strengthen the decision workflow, evidence links, and approval controls across existing systems.

    So the short answer is: document the no-FAI decision as a formal, evidence-based change control record with clear reasoning, traceable references, and authorized approval. If the rationale cannot be explained and defended from the record itself, it is probably not documented well enough.