Print   


This article is from the Fall 2026 BULLETIN.

Auditing With a Purpose Ensures Safety Through Compliance
LUIS PONCE

 

The mission of The National Board of Boiler and Pressure Vessel Inspectors (NBBI) is, in part, to reduce the risk to life and property by promoting safety.

The statement lists some key related elements, such as construction, inspection, and repairs and alterations, which, to a large degree, are associated with and controlled by a quality management system (QMS). For companies seeking ASME or NBBI certificates of authorization or accreditation, these elements must be included in their QMS manual and/or procedures. Other accreditation programs exist, but the focus will be on ASME and NBBI.

To obtain and maintain one of these certificates, a review or survey must be conducted by a team that audits the QMS and its implementation to determine whether the certificates should be issued. The ASME/NBBI triennial review or survey is a high-tier audit required by our industry but certainly not the only one. There are other audits periodically required of a QMS and many terms are related to auditing, e.g., review, survey, and evaluation. They all serve the same purpose – to perform an audit to verify whether the QMS and the objective evidence of its implementation meet the requirements of the selected standard.

The list of those who conduct audits includes many players. For example, ASME and NBBI team leaders conduct conformity assessment and accreditation activities. Authorized Inspection Agency (AIA) personnel, including the Authorized Inspector (AI) Supervisor, conduct several types of annual audits. Companies holding ASME and NBBI certification(s) may be required to conduct annual audits, both internal and external, to maintain their credentials.

Referenced Requirements

There are many ASME Boiler and Pressure Vessel Code (ASME BPVC), National Board Inspection Code (NBIC), and procedure references pertaining to activities requiring an audit. For example, ASME/NBBI certification references include the ASME BPVC, the ASME CA-1 Conformity Assessment Requirements, and the NBBI accreditation documents NB-381, Quality Management System for Inspection Organizations, and NB-415, Accreditation of Repair Organizations. The governing document for ASME/ NBBI team leaders and AI Supervisors conducting ASME annual “UM” audits is the ASME Procedure – Conduct of Conformity Assessment Activities, also known as the “Conduct Document,” which may be used for other types of audits.

The NBBI offers a weeklong course for prospective AI Supervisors and Owner-User Inspection Organization (OUIO) supervisory personnel interested in obtaining the B or O Endorsements, respectively. Part of the course focuses on the basic principles of auditing. Another excellent source which provides guidelines for auditing and impartiality is the ISO 19011 Guidelines for Auditing Management Systems.

ASME Section III is perhaps the most stringent regarding audits, evaluations, and surveys because the nuclear Code requires an annual NQA-1 Quality Assurance Requirements for Nuclear Facility Applications audit of the certificate holder, lead auditors, and material suppliers in some instances. ASME QAI-1 Qualifications for Authorized Inspection, NB-381, Quality Management Systems for Inspection Organizations, and NB-263, RCI-1, Rules for Commissioned Inspector, to some extent, require:

  • A top management-led annual evaluation of the AIA’s finances and sources of income;
  • An annual internal audit of the AIA’s and the OUIO’s QMS;
  • An annual audit of the activities performed by the AI Supervisor; and
  • An annual audit of both the AI and the Inservice Inspector (IS).

ASME Section I requires a periodic review of Certificate Holders using the “E” designator in accordance with PEB-18.2.2 on a quarterly basis or per agreement with the AIA of record, but shall not exceed a period of six months. Other situations requiring an audit include additional building (ASME only) and temporary location requests.

Audit Elements

Thorough and effective audits are the result of planning, time management, and maintaining control of the process. Auditors should establish clear objectives and become familiar with the applicable QMS prior to the audit. It is imperative to arrive prepared with a checklist, the applicable reference material, and, where applicable a copy of the last audit report.

The opening meeting sets the tone for the audit, and it should be held with the person or company being evaluated to discuss the scope, agenda, and expectations. Annual QAI-1/RCI-1 Inspector audits are less formal than audits of an ASME “UM” Certificate Holder so it is key to know the audience and to overcome any public speaking fears, especially when the opening meeting is a conference room with many attendees.

During implementation, stay focused on the objective and minimize distractions, e.g., phone calls and interruptions. Remember to use the checklist to monitor progress and to document the applicable auditing activity, objective evidence, and the applicable standard and/or QMS references. A key task is to verify whether any findings from the previous audit are recurring and to determine the extent of any new findings during the current audit. Isolated problems are not as serious as systemic ones. Audits are simply a snapshot, and time is limited, so time management skills are key. Note-taking is a matter of judgment; therefore, a balance is necessary between the amount of note-taking and auditing activity.

Effective auditors use four techniques: reviewing, observing, interviewing, and comparing. Reviewing documents and procedures is an important auditing element. The QMS manual review should be the first step when conducting an audit. During the implementation of ASME new construction and NBIC repairs/alterations, documents to be reviewed include design, material, examination, welding, nondestructive examination, pressure testing, qualification records, and the inspector's diary. For inspection organizations, a review of training and auditing records is essential.

Interviewing and questioning staff should follow a review of documents and records, but before starting questions, an introduction should be made. Treat each interview as an opportunity to conduct a mini-opening meeting. The auditor should first introduce themselves and ask for the interviewee's name. Attempt to bring the person at ease by first establishing rapport. Structure effective questions using the documents in conjunction with the applicable activity to find evidence of compliance. Each element of the system must be evaluated to some extent.

Observe activities while walking through the shop or field site. Are they consistent with the written description in the QMS? Are procedures available at workstations where Code work is being conducted? Is the revision level control consistent with the reviewed documents and procedures? For active shops, it is recommended to simply pause to observe technicians and welders as they perform their tasks to compare their processes against established procedures. For example, is the welder welding in a position to which they are qualified on the welding qualification record?

The last element, and perhaps the most important, is to compare the data as an ongoing process from start to finish to ensure consistency between the review, interview, and observation processes. It is an art that is refined with practice.

Walter Beach, the lead instructor for the NBBI B/O Course, said, “Simply reviewing documents without comparing them to the observed activities in the shop, for example, is not effective without the comparison aspect.”

Comparing may be defined as an ongoing process during the audit to be used in conjunction with the other auditing elements in order to make an overall assessment of the QMS and Code requirements to share with the entity or person being audited.

Throughout the process, the auditor’s task is to randomly examine items that have been inspected and to compare the data against completed reports using the invoked standard and QMS as the basis. After all elements of a QMS have been assessed, the auditor must decide if the requirements have been sufficiently met. When something is not in compliance, rule whether it should be documented as a deficiency in the QMS or Standard, bring it to the attention of the entity or person being audited, and discuss a plan for correction. Auditors should not dictate corrective action. The person or company being audited must provide the corrective action plan to the auditor, who will determine whether the plan is sufficient for code compliance.

Question Types

The two types of questions used in audits are open-ended and closed-ended.

Open-ended questions require more than a yes-or-no response and should constitute the majority of the evaluation. These answer the who, what, when, where, and how; however, it is acceptable to make a statement instead of a question, “Please demonstrate to a receiving inspection using established company procedures,” or “Show me how you would visually examine this weld to ensure it meets Code requirements.” Open-ended questions maximize the information sought.

Closed-ended questions need only a yes-or-no reply. It should be used sparingly during an audit and to close it. An example would be at the exit meeting: “Based on the results of this annual audit, do you think ASME should issue the requested ‘UM’ Certificate of Authorization?” If both parties are in agreement, life is good. However, if there is no consensus, resolution is now the challenge, and it involves communication and persuasion skills on the auditor’s part.

Auditor Attributes

Thus far, process and technique have been described. Good auditors must also possess the personal qualities necessary to conduct effective audits of Certificate Holders and Commissioned Inspectors. Those who have taken the NBBI B/O Supervisor course know these as auditor attributes. A few noteworthy qualities for an auditor to have are being ethical, open-minded, diplomatic, observant, perceptive, versatile, decisive, self-reliant, and able to communicate.

Communication is perhaps one of the more important attributes. A successful auditor must be able to convey ideas verbally and in writing. In-person interaction with the auditee is essential because an auditor relies on verbal communication skills from the opening meeting to the exit meeting. It is especially critical when resolving conflict and disagreement. Non-verbal communication is somewhat more difficult to perceive, but important nonetheless. Auditors should keep their non-verbal communication in check and be observant of this displayed by others. It could affect how the audit proceeds.

A critical skill all auditors should develop and refine is how to present noncompliant items to the auditee. Vocabulary goes hand-in-hand with presentation, and one should select the terms to use during an audit. There are many terms and phrases associated with non-compliance, such as findings, discrepancies, deficiencies, observations, recommendations, etc. It is best to choose which term(s) are preferred, decide how to use them, and be consistent to avoid confusion.

Presenting non-compliant items also takes strategy and skill. It’s not advisable to go in with “guns-a-blazing” in an “I’m the new sheriff in town” approach. Seasoned auditors usually ask a series of questions and make well-timed comments so the entity or person being audited comes to the realization that they have a problem instead of the auditor stating they do. This technique is known as the Socratic method, and there are many books on the subject.

Whether an auditor has many years of experience or is in a new role, it is vital to apply the principles of auditing to conduct effective evaluations. There are several referencing documents describing the audit process and the required procedures.

Always follow the employer’s requirements and practice the techniques applicable to auditing. Practice is the only way to become proficient, and new auditors should welcome opportunities to conduct audits or to shadow a mentor whenever possible. Many resources are available for auditors, regardless of experience level, e.g., the NBBI B/O Course, books, and employer meetings and seminars, to name a few. And remember, the main reason for conducting audits in our industry – safety.

Luis Ponce is a former manager of technical services at NBBI.