ArXiv Research: Automatic Weld Seam Segmentation Using RGB and Polarimetric Imaging with CNN and Transformer Architectur
Summary:This research evaluates the feasibility of automatic weld seam segmentation using RGB and polarimetric imaging, comparing the performance of CNN and Transformer architectures under controlled and uncontrolled conditions. The study finds that CNN models achieve high accuracy in controlled settings but suffer significant drops in performance under uncontrolled conditions. In contrast, polarimetric imaging with geometric augmentation achieves high accuracy in uncontrolled settings without requiring
Background and Motivation
Visual inspection of welded assemblies remains one of the least automated stages in many industrial production processes, heavily relying on human operators' experience and thus subject to significant variability. This study aims to evaluate the feasibility of automatic weld seam segmentation using RGB and polarimetric imaging and compare the performance of CNN and Transformer architectures under different conditions.
Methodology and Experiments
- Data Acquisition and Processing: The study uses RGB images captured under controlled laboratory conditions and real, uncontrolled conditions for comparison. Polarimetric imaging is introduced, and geometric augmentation methods are applied to process the image data.
- Model Architectures: CNN and Transformer architectures are employed for weld seam segmentation. CNN models include common architectures like ResNet and EfficientNet, while Transformer models utilize advanced architectures such as RF-DETR.
- Evaluation Metrics: The mean mask mAP50 is used as the primary evaluation metric, and multiple random seeds are used for training to separate genuine model effects from random noise.
Key Findings
- Performance Differences in RGB Imaging: In controlled conditions, CNN models achieve a mAP50 of up to 0.87, but this drops to 0.22-0.48 under uncontrolled conditions, highlighting the significant impact of the acquisition setup on system performance.
- Advantages of Polarimetric Imaging: Polarimetric imaging with geometric augmentation achieves a mAP50 of up to 0.93 in uncontrolled conditions, comparable to the best controlled-RGB results but without requiring complex calibration control.
- Architectural Robustness: Under test-time viewpoint shifts, Transformer models, particularly RF-DETR, retain high accuracy while all CNN models collapse, demonstrating superior robustness to viewpoint changes.
Industry Impact and Recommendations
- Industrial Application Potential: The combination of polarimetric imaging and Transformer architectures offers a more reliable solution for industrial quality control, especially in complex and dynamic inspection environments.
- Model Selection Recommendations: For fixed viewpoint conditions, CNN models are sufficient, while Transformer models are more suitable for scenarios with frequent viewpoint changes.
- Future Research Directions: Further exploration of the combination of polarimetric imaging and Transformer architectures is recommended, along with optimizing model generalization across different industrial scenarios.
— END —Source: ArXiv cs.AI (2026-08-26)
Tags: #Industrial Inspection #RGB Imaging #Polarimetric Imaging #CNN #Transformer
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments