Foreword
Introduction
1 Scope
2 Conformance
3 Normative references
4 Terms and definitions
5 Abbreviated terms
6 Goals
  6.1 Coverage
  6.2 Target application
      6.2.1 Biometric application
      6.2.2 Interoperable application
  6.3 Purpose
      6.3.1 Interoperability testing
      6.3.2 Sufficiency testing
7 Metrics
  7.1 General
  7.2 Figures of merit
      7.2.1 Recognition performance figure of merit
      7.2.2 Measuring component failure
  7.3 Interoperability matrices
      7.3.1 General
      7.3.2 Interoperability with sBDB generators
      7.3.3 Interoperability with sBDB generators
      7.3.4 Fixed operating point interoperability
      7.3.5 Reporting failure of sBDB generators
  7.4 Proprietary performance
8 Conducting a test
  8.1 Structure of test
  8.2 Sample data
      8.2.1 Acquisition
      8.2.2 Representative data
      8.2.3 Collection of ancillary data
      8.2.4 Corpus size
      8.2.5 Removal of subject-specific metadata
      8.2.6 Removal of unrepresentative metadata
      8.2.7 Origin of samples
      8.2.8 Untainted samples
      8.2.9 Sequestered data
  8.3 Conformance testing
      8.3.1 Conformance
      8.3.2 Executing conformance tests
      8.3.3 Reporting
  8.4 Constraints on the sBDBs
      8.4.1 Optional encodings
      8.4.2 Optional encodings from profile standards
      8.4.3 Deviation from the base standard
      8.4.4 Data encapsulation
  8.5 Components
      8.5.1 Components for sufficiency testing
      8.5.2 Establishing modularity requirements
      8.5.3 Components for interoperability testing
      8.5.4 Underlying algorithms
      8.5.5 Capture device user interfaces
      8.5.6 Multimodal components
      8.5.7 Component variability
      8.5.8 Component reporting requirements
  8.6 Planning decisions
      8.6.1 Computational intensity
      8.6.2 Supplier recruitment
      8.6.3 Provision of samples to suppliers
      8.6.4 Equivalency of generator resources
      8.6.5 Handling violations of test requirements
      8.6.6 Comparison subsystem output data
            encapsulation
      8.6.7 Fundamental generator requirement
      8.6.8 Fundamental comparison subsystem
            requirement
      8.6.9 General requirements on software
            implementations
  8.7 Prevention and detection of gaming
      8.7.1 General aspects
      8.7.2 Modes of gaming
      8.7.3 Prevention and detection of gaming
  8.8 Test procedure
      8.8.1 Primary test
      8.8.2 Uncertainty measurement
      8.8.3 Variance estimation
      8.8.4 Remedial testing
      8.8.5 Survey of configurable parameters
9 Interpretation of the interoperability matrix
  9.1 Determination of interoperable subsystems
      9.1.1 General
      9.1.2 Identifying interoperable combinations
            of subsystems
      9.1.3 Acceptable numbers of interoperable subsystems
      9.1.4 Combinatorial search for maximum
            interoperability-classes
      9.1.5 Multiple interoperable subgroups
      9.1.6 Statistical stability of the test result
  9.2 Interoperability with previously certified products
      9.2.1 Decertification considerations
      9.2.2 Continuity of testing
      9.2.3 Interoperability with previously certified
            generators
      9.2.4 Interoperability with previously certified
            comparison subsystems
      9.2.5 Treatment of systematic effects
      9.2.6 Retroactive exclusion from analysis
  9.3 Overall sufficiency
Annex A (informative) - Procedures for conducting a test
        of sufficiency and/or interoperability
Annex B (informative) - Example Interoperability Test
Bibliography