Automatic ultrasonic scanning inspection systems are becoming more and more popular. There is a growing dependence on these systems, the data (both ultrasonic signals and probe location) and the automatic or manual evaluation of the data. Stationary and mobile test systems are discussed, as used for pre-service testing (testing during manufacture) and in-service testing (testing after manufacture, including regular safety assurance testing).The information in this Technical Report covers all tests and testing on all component parts or complete manufactured systems for either correctness of geometry, material properties (quality or defects) and fabrication methodology (e.g. welds).This Technical Report can be used for training purposes.This Technical Report is aimed at suppliers and users of automatic scanning systems. The scope of this Technical Report is to permit the user, along with a customer specification or test description and any national or international standards or regulations to specify:-ultrasonic probes, probe systems and mechanical controlling sensors;-manipulation systems including controls;-ultrasound electronic sub-systems;-data storage and display systems;-evaluation and assessment methods or techniqueswith regard to their performance and suitability for purpose. This Technical Report also defines a means of verifying the performance of any specified system.This includes:-tests during the manufacturing process on parts and completed items (stationary testing systems) and also-tests with mobile systems.