{"id":126461,"date":"2024-10-19T05:37:12","date_gmt":"2024-10-19T05:37:12","guid":{"rendered":"https:\/\/pdfstandards.shop\/product\/uncategorized\/bsi-24-30456154-dc\/"},"modified":"2024-10-24T23:20:14","modified_gmt":"2024-10-24T23:20:14","slug":"bsi-24-30456154-dc","status":"publish","type":"product","link":"https:\/\/pdfstandards.shop\/product\/publishers\/bsi\/bsi-24-30456154-dc\/","title":{"rendered":"BSI 24\/30456154 DC"},"content":{"rendered":"

PDF Catalog<\/h4>\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
PDF Pages<\/th>\nPDF Title<\/th>\n<\/tr>\n
6<\/td>\nFOREWORD <\/td>\n<\/tr>\n
8<\/td>\nINTRODUCTION <\/td>\n<\/tr>\n
9<\/td>\n1 Scope
2 Normative references
3 Terms and definitions <\/td>\n<\/tr>\n
12<\/td>\n3.22 Terms specific to Annex A
4 Test planning
4.1 Test plan <\/td>\n<\/tr>\n
13<\/td>\n4.2 Test objectives
4.3 Test scope
4.4 Responsibilities and roles <\/td>\n<\/tr>\n
14<\/td>\n4.5 Test environment
4.5.1 General
4.5.2 Test tools
4.5.3 Test data
4.6 Deliverables
4.7 Re-testing after changes <\/td>\n<\/tr>\n
15<\/td>\n4.8 Test methods
4.8.1 General
4.8.2 Test oracle
4.8.3 Cross-Validation testing
4.8.3.1 Test method description
4.8.3.2 General
4.8.3.3 Holdout Cross-Validation <\/td>\n<\/tr>\n
16<\/td>\n4.8.3.4 k-Fold Cross-Validation <\/td>\n<\/tr>\n
17<\/td>\n4.8.3.5 Repeated k-folds Cross-Validation <\/td>\n<\/tr>\n
18<\/td>\n4.8.3.6 Stratified k-fold Cross-Validation <\/td>\n<\/tr>\n
19<\/td>\n4.8.3.7 Time Series Cross-Validation <\/td>\n<\/tr>\n
20<\/td>\n4.8.3.8 Test method use cases
4.8.3.9 Test method specific requirements <\/td>\n<\/tr>\n
21<\/td>\n4.8.4 Black-box test methods
4.8.4.1 Combinatorial testing
4.8.4.2 Test method description <\/td>\n<\/tr>\n
22<\/td>\n4.8.4.3 Test method use cases
4.8.4.4 Test method specific requirements
4.8.4.5 Back-to-back testing
4.8.4.6 Test method description
4.8.4.7 Test method use cases <\/td>\n<\/tr>\n
23<\/td>\n4.8.4.8 Test method specific requirements
4.8.4.9 Extended back-to-back testing
4.8.4.10 Test method description
4.8.4.11 Test method use cases
4.8.4.12 Test method specific requirements
4.8.4.13 A\/B testing
4.8.4.14 Test method description <\/td>\n<\/tr>\n
24<\/td>\n4.8.4.15 Test method use cases
4.8.4.16 Test method specific requirements
4.8.4.17 Metamorphic testing
4.8.4.18 Test method description
4.8.4.19 Test method use cases
4.8.4.20 Test method specific requirements <\/td>\n<\/tr>\n
25<\/td>\n4.8.4.21 Exploratory testing
4.8.4.22 Test method description
4.8.4.23 Test method use cases
4.8.4.24 Test method specific requirements
4.8.5 White-box test methods <\/td>\n<\/tr>\n
26<\/td>\n4.8.6 AI explainability\/transparency
4.8.6.1 Explainability
4.8.6.2 LIME <\/td>\n<\/tr>\n
27<\/td>\n4.8.6.3 SHAP
4.8.6.4 Transparency <\/td>\n<\/tr>\n
28<\/td>\n4.9 Statistics
4.9.1 General
4.9.2 Classification metrics
4.9.3 Regression metrics <\/td>\n<\/tr>\n
29<\/td>\n4.10 Test phases \/ stages
5 Test specification
5.1 Test identification
5.2 Test conditions <\/td>\n<\/tr>\n
30<\/td>\n5.3 Acceptance criteria
5.4 Test data
5.4.1 Test data selection
5.4.2 Data relevance
5.4.3 Data representativeness
5.4.4 Test data quantification
5.4.5 Test data preparation <\/td>\n<\/tr>\n
31<\/td>\n5.4.6 DOUP (Data Of Unknown Provenance)
5.4.7 Artificial data
5.4.8 Test data labelling <\/td>\n<\/tr>\n
32<\/td>\n5.4.9 Use of unlabelled data
5.4.10 Traceability
5.4.10.1 Test data identification
5.4.10.2 Test data usage logging
6 Test results
6.1 Test results documentation
6.2 Test deviations <\/td>\n<\/tr>\n
33<\/td>\nAnnex A (normative) Continuous learning
A.1 Scope
A.2 General concepts and requirements <\/td>\n<\/tr>\n
34<\/td>\nA.3 Control mechanisms
A.3.1 Pre-testing by the manufacturer
A.3.2 Evaluation of training algorithm responsiveness <\/td>\n<\/tr>\n
35<\/td>\nA.3.3 Limited learning
A.3.4 Evaluation of change
A.3.5 Utilization of back-to-back testing
A.3.6 Released model as a test oracle
A.4 New data samples
A.4.1 Training data
A.4.2 Test data <\/td>\n<\/tr>\n
37<\/td>\nAnnex B (informative) Data\/information leakage
B.1 Risks of data\/information leakage and impact on resulting AI systems
B.2 Sources of data\/information leakage
B.3 The ideal test set
B.4 How to avoid data\/information leakage <\/td>\n<\/tr>\n
39<\/td>\nBibliography <\/td>\n<\/tr>\n<\/table>\n","protected":false},"excerpt":{"rendered":"

BS EN IEC 63450 Testing of Artificial Intelligence \/ Machine Learning-enabled Medical Devices<\/b><\/p>\n\n\n\n\n
Published By<\/td>\nPublication Date<\/td>\nNumber of Pages<\/td>\n<\/tr>\n
BSI<\/b><\/a><\/td>\n2024<\/td>\n39<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"featured_media":126463,"template":"","meta":{"rank_math_lock_modified_date":false,"ep_exclude_from_search":false},"product_cat":[2641],"product_tag":[],"class_list":{"0":"post-126461","1":"product","2":"type-product","3":"status-publish","4":"has-post-thumbnail","6":"product_cat-bsi","8":"first","9":"instock","10":"sold-individually","11":"shipping-taxable","12":"purchasable","13":"product-type-simple"},"_links":{"self":[{"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/product\/126461","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/product"}],"about":[{"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/types\/product"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/media\/126463"}],"wp:attachment":[{"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/media?parent=126461"}],"wp:term":[{"taxonomy":"product_cat","embeddable":true,"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/product_cat?post=126461"},{"taxonomy":"product_tag","embeddable":true,"href":"https:\/\/pdfstandards.shop\/wp-json\/wp\/v2\/product_tag?post=126461"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}