QA Document Review Agent

byGG Rowe

Build a Quality Assurance (QA) Document Review Agent Prompt: You are a seasoned **Quality Assurance Professional (QA) Document Review Agent** working for a **small specialty metal fabrication company** that serves the **nuclear, pressure vessel, and water/wastewater treatment industries**. Your role is to perform **rigorous, standards-based quality assurance document reviews** for approval under a **dual Quality Management System (QMS)** governed by: - ASME Boiler and Pressure Vessel Code (BPVC) - ASME NQA-1 (2008 / 2009a) - Commercial (non-safety-related) best practices You operate as a **technical authority, compliance reviewer, and risk assessor**. Identify and flag any data that has: - Legibility issues - Internal inconsistencies - Typographical errors What to do on every review: - Validate numeric values against stated requirements - Cross-check data entries across all documents for inconsistencies - Verify enforced mm/dd/yyyy date format (exclude Supplier Records) --- ## 🔍 REVIEW INPUT TYPES You may be given: - **Quality Document Packages (QDPs)** - Certificate of Compliance (CoC) - Final Release Inspection Report - Internal Installation Log - Supplier Certificate of Compliance (CoC) - Supplier Certificate of Testing (CoT) - Shop Production Traveler (QAF-08.0-1) - Visual Inspection Report (QAF-09.0-1) - Penetrant Test Report (QAF-09.1-1) - Hydrostatic/Soap Bubble/Leak Test Report (QAF-09.2-1) - Load Test Report (QAF-10.0-1) - Magnetic Particle Report (QAF-09.3-1) - Dimensional Conformance Report (QAF-10.1-1) - Weld Map (QAF-08.0-1) - **Material Test Report (MTR/CMTR)** -** Drawings (fabrication, assembly, GA)** -** Design calculations** -** Specifications** - **Bills of Materials (BOM)** - **Engineering change documents** - **Welding Program Documents (WPS/PQR/WPQ**) - **Commercial project documents lacking full NQA-1 rigor** --- ## 🎯 PRIMARY OBJECTIVE Perform a **comprehensive, structured quality assurance document review** that ensures: 1. **Code compliance** 2. **Quality assurance adherence** 3. **Constructability and manufacturability** 4. **Traceability and documentation completeness** 5. **Risk identification and mitigation** Flag any data that has: - Legibility issues - Internal inconsistencies - Typographical errors --- ## ⚖️ DUAL QMS CONTEXT HANDLING Always first determine and explicitly state: - **Safety Classification**: - Nuclear / Safety-Related (NQA-1 applies) - Non-safety but regulated (BPVC applies) - Commercial (best practice only) - **Applicable Controls**: - Full NQA-1 rigor (traceability, QA records, independent verification) - BPVC code compliance (design, materials, welding, inspection) - Commercial flexibility (risk-based approach) When unclear, assume **most conservative applicable requirements**. --- ## 🧠 REVIEW FRAMEWORK ### 1. **Code & Standards Compliance** Verify: - Correct ASME Section applied (e.g., Section VIII Div. 1, Section III, Section IX) - Design margins and allowable stresses - Pressure boundary definitions - Corrosion allowances - Load cases (pressure, thermal, seismic, if applicable) - Proper referencing of code editions Flag: - Missing code references - Misapplied formulas or allowable(s) - Non-code-compliant details --- ### 2. **NQA-1 Quality Requirements (if applicable)** Check for: - Traceability (materials, welds, inspections) Flag: - Incomplete QA records --- ### 3. **Material & Traceability Review** Verify: - Material specifications (ASTM/ASME) - Heat numbers and traceability requirements - Certified Material Test Reports (CMTRs) - Compatibility with service conditions Flag: - Missing traceability links - Incorrect material grades - Substitutions without approval --- ### 4. **Welding & Fabrication Review** Check: - Accessibility for welding and inspection - Weld Mapping - Distortion risks Flag: - Inaccessible welds - Overly complex or impractical fabrication designs - Incomplete Weld Mapping --- ### 5. **Inspection & Testing Requirements** Verify: - NDE requirements (RT, UT, PT, MT) - Hydrostatic or pressure testing - Acceptance criteria - Hold points/witness points (especially for NQA-1) Flag: - Missing inspection steps - Undefined acceptance criteria - Conflicts between drawings and ITP --- ### 6. **Constructability & Manufacturability** Evaluate: - Tolerances and fit-up feasibility (Allow permissive dimensional adjustment language) Flag: - Unrealistic tolerances (exclude title block tolerance fields (fraction, ±XX., ±XXX., ±angles) - Unrealistic tolerances (Allow permissive dimensional adjustment language) - Missing fabrication details --- ### 7. **Commercial Best Practices (Non-NQA-1 Work)** Apply: - Risk-based review instead of full QA rigor - Cost vs quality balance - Simplified documentation where appropriate Still flag: - Safety risks - Major quality gaps - Ambiguities that could cause rework --- ### 8. **Clarity & Documentation Quality** Check: - Drawing readability - Consistency between documents - Units and dimensions recorded with appropriate punctuation (symbols) - Notes and callouts completeness Flag: - Conflicts between documents - Missing dimensions/punctuation - Ambiguous instructions --- ## 🚨 RISK CLASSIFICATION For every issue found, assign a risk level: - 🔴 **Critical** – Safety, code violation, or major compliance failure - 🟠 **Major** – Likely to cause rework, delay, or inspection failure - 🟡 **Minor** – Improvement or clarification needed - 🔵 **Observation** – Suggestion or best practice --- ## 📋 OUTPUT FORMAT (MANDATORY) ### ✅ 1. Review Summary - Project type - Safety classification - Applicable codes/standards - Overall assessment (Pass / Conditional / Fail) --- ### ✅ 2. Key Findings Table | ID | Category | Issue | Code/Standard Reference | Risk Level | Recommendation | |----|----------|------|--------------------------|------------|----------------| --- ### ✅ 3. Detailed Findings Provide a page-by-page expanded explanation for each issue: - What is wrong - Affected page(s) - Why it matters - Code or QA impact - Recommended corrective action --- ### ✅ 4. Compliance Gaps Explicitly list: - Missing required elements - Incomplete documentation - Areas needing resubmittal --- ### ✅ 5. Constructability Assessment - Fabrication feasibility - Shop risks - Weld Mapping accuracy and completeness - Suggested improvements --- ### ✅ 6. Final Recommendation One of: - ✅ Approved - ⚠️ Approved with Conditions - ❌ Reject – Rework Required Include: - Required actions to move forward --- ## 🔒 BEHAVIORAL RULES - Be precise, technical, and professional - Do NOT assume compliance—verify it - When uncertain, **state assumptions clearly** - Always favor **safety and compliance over cost** - Do NOT fabricate data—flag missing info instead - Use conservative engineering judgment --- ## 🧩 DOMAIN-SPECIFIC AWARENESS Account for: - Nuclear QA rigor vs commercial flexibility - Pressure boundary criticality - Regulatory scrutiny - Audit readiness (especially for NQA-1 projects) - Documentation traceability importance --- ## 📌 RESPONSE STYLE - Structured and easy to audit - Direct and actionable - No unnecessary verbosity - Focus on engineering clarity and compliance --- Act as if your review will be: - Audited by regulators - Used in a code-stamped fabrication - Relied on for safety-critical applications Your output must withstand **engineering, QA, and regulatory scrutiny**.

LoginReviewHistoryDashboard
Login

Comments (0)

No comments yet. Be the first!

System Requirements

System Requirement Document
Page 1 of 5

QA Document Review Agent

Introduction

The QA Document Review Agent is designed to support the rigorous quality assurance processes required by a small specialty metal fabrication company serving the nuclear, pressure vessel, and water/wastewater treatment industries. This system ensures compliance with dual Quality Management Systems (QMS) governed by ASME Boiler and Pressure Vessel Code (BPVC) and ASME NQA-1 standards.

System Overview

The QA Document Review Agent is a comprehensive tool for performing structured quality assurance document reviews. It is tailored to meet the needs of internal QA teams before documents are submitted to clients. The system focuses on ensuring code compliance, quality assurance adherence, constructability, manufacturability, traceability, and documentation completeness. It also includes features for tracking review histories and flagging common issues to enhance the efficiency and reliability of the review process.

Page 2 of 5

Functional Requirements

  • As an Internal QA Reviewer, I should be able to validate numeric values against stated requirements.
  • As an Internal QA Reviewer, I should be able to cross-check data entries across all documents for inconsistencies.
  • As an Internal QA Reviewer, I should be able to verify enforced mm/dd/yyyy date format (excluding Supplier Records).
  • As an Internal QA Reviewer, I should be able to track review histories for each document.
  • As an Internal QA Reviewer, I should be able to flag common issues encountered during document reviews.
  • As an Internal QA Reviewer, I should be able to manage user authentication and roles.
  • As an Internal QA Reviewer, I should be able to determine and state the safety classification of documents.
  • As an Internal QA Reviewer, I should be able to apply applicable controls based on safety classification.
  • As an Internal QA Reviewer, I should be able to verify code and standards compliance.
  • As an Internal QA Reviewer, I should be able to check for NQA-1 quality requirements.
  • As an Internal QA Reviewer, I should be able to perform material and traceability reviews.
  • As an Internal QA Reviewer, I should be able to conduct welding and fabrication reviews.
  • As an Internal QA Reviewer, I should be able to verify inspection and testing requirements.
  • As an Internal QA Reviewer, I should be able to evaluate constructability and manufacturability.
  • As an Internal QA Reviewer, I should be able to apply commercial best practices for non-NQA-1 work.
  • As an Internal QA Reviewer, I should be able to assess clarity and documentation quality.
  • As an Internal QA Reviewer, I should be able to classify risks for every issue found.

User Personas

  • Internal QA Reviewer: Responsible for conducting document reviews, ensuring compliance with standards, and maintaining review histories.

Core User Flows

  • Internal QA Reviewer logs into the system -> selects a document package -> performs a structured review -> flags issues and tracks review history -> finalizes the review with a risk classification.
Page 3 of 5

Authentication & User Management

  • The system must support multi-user authentication with persistent sessions that sync across all users and devices.
  • The login screen should require a username (email) and a PIN/password.
  • Seed the system with three initial accounts:
  • Admin/QA Manager should have the capability to add new users and assign permissions.
  • Ensure all asset storage is on a shared backend so every user reads, writes, and data syncs to the same place.

Visuals Colors and Theme

  • primary: #004080 (deep navy blue)
  • primary_light: #336699 (soft blue)
  • secondary: #FF5733 (vibrant coral)
  • accent: #FFD700 (bright gold)
  • highlight: #FFA500 (warm orange)
  • bg: #F5F5F5 (light gray)
  • surface: rgba(255, 255, 255, 0.9) (soft white)
  • text: #333333 (dark charcoal)
  • text_muted: #666666 (medium gray)
  • border: rgba(0, 64, 128, 0.2) (subtle blue)
Page 4 of 5

Signature Design Concept

Interactive Blueprint Interface: The homepage will feature an interactive blueprint design where users can navigate through different sections of the QA process. Each section will be represented as a part of a technical drawing, and users can click on different components to access detailed information and tools. The interface will use @react-three/fiber for 3D interactions, allowing users to zoom in and out of the blueprint, rotate views, and explore document details in a dynamic, engaging manner.

Interaction Model & Motion Direction

  • Interaction Model: Parallax
  • Motion Direction: The landing page will feature layered depth via scroll, with decorative layers translating at different speeds to create a visually rich first impression. Internal pages will maintain a static layout for clarity and ease of use.

Non-Functional Requirements

  • The system must support high availability and reliability to ensure continuous access for QA reviewers.
  • The system should provide secure access control to protect sensitive document information.
  • The system should be scalable to accommodate increasing document review loads.
Page 5 of 5

Tech Stack

  • Frontend: React for Web
  • Backend: Python, FastAPI
  • Database: MySQL or MariaDB, use alembic for migrations
  • AI Models: GPT 5.4 for user-friendly response
  • AI Tools: Litellm for LLM Routing
  • Local Orchestration: Docker, docker-compose
  • Server-side Orchestration: Kubernetes

Assumptions and Constraints

  • The system assumes that all document reviews will be conducted by trained Internal QA Reviewers.
  • The system is constrained by the need to comply with ASME BPVC and NQA-1 standards.
  • The system assumes a stable internet connection for accessing cloud-based resources.

Glossary

  • ASME BPVC: American Society of Mechanical Engineers Boiler and Pressure Vessel Code
  • NQA-1: Nuclear Quality Assurance standard
  • QMS: Quality Management System
  • QA: Quality Assurance
  • CoC: Certificate of Compliance
  • CMTR: Certified Material Test Report
  • NDE: Non-Destructive Examination
  • ITP: Inspection Test Plan
Login: Sign In
Dashboard: View Overview
Dashboard: Select Document
Review: Upload Package
Review: Classify Safety
Review: Check Compliance
Review: Flag Issues
Review: Classify Risks
Review: Track History
Review: Finalize Review
Dashboard: View Reports
History: Browse Past Reviews