diff options
| author | Adam Janovsky | 2023-10-19 14:22:48 +0200 |
|---|---|---|
| committer | Adam Janovsky | 2023-10-19 14:22:48 +0200 |
| commit | 597f25e13f9b56508aaf67aef4d518285ca6e676 (patch) | |
| tree | e12f5df591a7737e3361debdc78141a792e8debb /src/sec_certs/data/reference_annotations | |
| parent | 70330b2202f7f4abd99b36b7a3090e3edee6bb1b (diff) | |
| download | sec-certs-597f25e13f9b56508aaf67aef4d518285ca6e676.tar.gz sec-certs-597f25e13f9b56508aaf67aef4d518285ca6e676.tar.zst sec-certs-597f25e13f9b56508aaf67aef4d518285ca6e676.zip | |
finalize annotation labels
Diffstat (limited to 'src/sec_certs/data/reference_annotations')
16 files changed, 1320 insertions, 1492 deletions
diff --git a/src/sec_certs/data/reference_annotations/adam/test.csv b/src/sec_certs/data/reference_annotations/adam/test.csv new file mode 100644 index 00000000..19f4d790 --- /dev/null +++ b/src/sec_certs/data/reference_annotations/adam/test.csv @@ -0,0 +1,201 @@ +dgst,canonical_reference_keyword,label,comment +15ae64b85b3e28d7,BSI-DSZ-CC-0394-2006,recertification,None +15b121492722bffb,BSI-DSZ-CC-0754-2012,recertification,None +16513a1bff79b46a,BSI-DSZ-CC-1044-V2-2019,recertification,None +16b0a0811bc4fe82,BSI-DSZ-CC-0169-2002,component_used,None +16b24ff1bf3c079b,ANSSI-CC-2012/22,component_used,None +173097995b7a7f12,ANSSI-CC-2012/49,component_shared,None +173097995b7a7f12,ANSSI-CC-2013/28,evaluation_reused,None +173704f0d2b8a02f,ANSSI-CC-2018/08,component_used,None +173704f0d2b8a02f,ANSSI-CC-2018/19,component_used,None +177dee4c1051e612,BSI-DSZ-CC-0854-2013,recertification,None +17bfc3d0570ab3d0,ANSSI-CC-2016/09,component_used,None +183a5cd3e2aaa0ec,ANSSI-CC-2017/76,component_used,None +183a5cd3e2aaa0ec,BSI-DSZ-CC-0891-V2-2016,component_used,None +18a515a0fff0c0c3,BSI-DSZ-CC-0957-V2-2016,component_used,None +18b7e5bdf459ca13,NSCIB-CC-07-09219,component_used,None +195366bfba7213a5,BSI-DSZ-CC-0266-2005,component_used,None +195366bfba7213a5,BSI-DSZ-CC-0322-2005,component_used,None +195366bfba7213a5,BSI-DSZ-CC-0399-2007,recertification,None +1999d4ed82b3188e,BSI-DSZ-CC-0451-2007,component_used,None +19d3185c40be008d,ANSSI-CC-2016/65,evaluation_reused,None +1ac8de53c0894d18,BSI-DSZ-CC-0814-2012,recertification,None +1b2764a62ffe86a2,BSI-DSZ-CC-0978-2016,component_used,None +1bcfaefe46abccf0,BSI-DSZ-CC-0917-2014,component_used,None +1c8567a1b1a6c12a,BSI-DSZ-CC-1040-2019,component_used,None +1cc05dbb992431b9,ANSSI-CC-2021/29,component_used,None +1d1df0fb541e49b8,BSI-DSZ-CC-1020-V2-2017,recertification,None +1d9ae732c5dec242,ANSSI-CC-2009/37,component_used,None +1ea31bb5f6a15995,BSI-DSZ-CC-0808-V3-2017,evaluation_reused,None +1ea31bb5f6a15995,BSI-DSZ-CC-0809-V2-2016,recertification,None +1ea31bb5f6a15995,BSI-DSZ-CC-0978-V2-2017,component_used,None +1ff08f79cb89c1de,BSI-DSZ-CC-0939-2015,recertification,None +2078424be58e4db1,OCSI/CERT/SYS/08/2017/RC,recertification,None +21951e191e55b66e,BSI-DSZ-CC-0782-2012,component_used,None +21cffadbbb87c205,BSI-DSZ-CC-0348-2006,component_used,None +22ede463dbf1a105,ANSSI-CC-2015/36,evaluation_reused,None +22ede463dbf1a105,ANSSI-CC-2015/80,evaluation_reused,None +22ede463dbf1a105,ANSSI-CC-2016/43,evaluation_reused,None +22ede463dbf1a105,ANSSI-CC-2016/44,evaluation_reused,None +23a85a7f9c07412f,ANSSI-CC-2014/46,evaluation_reused,None +23a85a7f9c07412f,ANSSI-CC-2016/33,evaluation_reused,None +24624a4e60ddedd4,BSI-DSZ-CC-0868-2014,previous_version,None +24624a4e60ddedd4,BSI-DSZ-CC-0951-2015,component_used,None +259df98e7476a843,BSI-DSZ-CC-0666-2012,recertification,None +259e0ab1c4b690cf,ANSSI-CC-2012/70,component_used,None +25c07c5d0a05d86c,ANSSI-CC-2015/08,component_shared,None +25c07c5d0a05d86c,ANSSI-CC-2015/15,component_used,None +26c4912b140fde9f,BSI-DSZ-CC-0891-V2-2016,evaluation_reused,None +26c7b173668167d8,BSI-DSZ-CC-0813-2012,component_used,None +2760aeedce0b79db,ANSSI-CC-2011/64,evaluation_reused,None +2760aeedce0b79db,BSI-DSZ-CC-0555-2009,component_used,None +27ccec0740bb7915,ANSSI-CC-2010/02,component_used,None +27ccec0740bb7915,ANSSI-CC-2010/20,evaluation_reused,None +27ccec0740bb7915,ANSSI-CC-2010/35,evaluation_reused,None +296618f10b019d9c,BSI-DSZ-CC-0417-2008,evaluation_reused,None +29cc495628e76ffa,BSI-DSZ-CC-0845-2012,component_used,None +29f2dd90f57ea948,BSI-DSZ-CC-0837-V2-2014,component_used,None +29fb07d8f74e734b,BSI-DSZ-CC-0303-2006,recertification,None +2a07b85f61ac08b0,ANSSI-CC-2019/59,evaluation_reused,None +2a91f42389fda90d,BSI-DSZ-CC-0782-V2-2015,component_used,None +2adb03f5294c31c2,BSI-DSZ-CC-0608-2010,recertification,None +2b0342d5b70b7a78,ANSSI-CC-2010/03,component_used,None +2bd9661657e78278,ANSSI-CC-2012/39,previous_version,None +2bd9661657e78278,ANSSI-CC-2013/13,component_used,None +2be10f342e68a89e,BSI-DSZ-CC-0963-V2-2017,recertification,None +2c41f9dfcd5014e6,BSI-DSZ-CC-0973-2016,recertification,None +2d046178aa118fff,BSI-DSZ-CC-0293-2005,recertification,None +2d0b4100c3ead88a,BSI-DSZ-CC-0945-V2-2018,component_used,None +2eee0fdd5cdaf565,ANSSI-CC-2017/07,component_used,None +2eee0fdd5cdaf565,BSI-DSZ-CC-0891-V2-2016,component_used,None +2f9feaf4121720da,BSI-DSZ-CC-0547-2009,recertification,None +30e9ce0969941ffb,BSI-DSZ-CC-0782-V2-2015,component_used,None +3183669bf78db43b,ANSSI-CC-2015/45,component_used,None +3183669bf78db43b,ANSSI-CC-2016/64,component_used,None +3183669bf78db43b,BSI-DSZ-CC-0782-V2-2015,component_used,None +31fd07069aebf013,BSI-DSZ-CC-0466-2008,evaluation_reused,None +328fee1e52f7ac82,BSI-DSZ-CC-0410-2007,component_used,None +328fee1e52f7ac82,BSI-DSZ-CC-0680-2010,component_used,None +3334d22b6559d0e2,BSI-DSZ-CC-0944-2014,recertification,None +3334d22b6559d0e2,BSI-DSZ-CC-0963-V2-2017,component_used,None +337ece90615ed69d,ANSSI-CC-2010/02,component_used,None +3392558f04e04663,BSI-DSZ-CC-0782-V2-2015,component_used,None +33cada8c95bf55c5,BSI-DSZ-CC-0879-V3-2018,component_used,None +33cada8c95bf55c5,BSI-DSZ-CC-1028-2017,recertification,None +34506b8fab6dd7c3,ANSSI-CC-2014/22,evaluation_reused,None +34ed76f0c32d9e93,ANSSI-CC-2012/49,evaluation_reused,None +34ed76f0c32d9e93,ANSSI-CC-2013/18,component_used,None +3519c14e4114d93d,BSI-DSZ-CC-0782-2012,component_used,None +35b9be2203d2b9e6,ANSSI-CC-2012/70,component_used,None +35efe13fa9e93a68,CRP178,component_used,None +35efe13fa9e93a68,CRP182,component_used,None +36641ce7192b5f92,BSI-DSZ-CC-0977-2017,component_used,None +054bd8196e015197,ANSSI-CC-2011/07,None,unclear +122245dd15683e26,BSI-DSZ-CC-0269-2006,None,unclear +25c07c5d0a05d86c,BSI-DSZ-CC-0845-2012,component_used,very difficult +25c07c5d0a05d86c,BSI-DSZ-CC-0845-V2-2013,component_used,None +29cc495628e76ffa,BSI-DSZ-CC-0886-2013,irrelevant,None +2a07b85f61ac08b0,ANSSI-CC-2019/02,component_used,None +30c6777901ae346c,BSI-DSZ-CC-0438-2007,component_used,None +35b9be2203d2b9e6,BSI-DSZ-CC-0895-2014,irrelevant,None +36df04ab9c978ab9,BSI-DSZ-CC-0624-2010,component_used,None +373e7b1bc9066563,BSI-DSZ-CC-1110-V2-2019,component_used,None +3746512864b941d4,ANSSI-CC-2016/15,evaluation_reused,None +37b94c08f8e25249,BSI-DSZ-CC-0404-2007,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0410-2007,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0555-2009,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0633-2010,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0674-2011,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0675-2011,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0709-2010,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0710-2010,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0730-2011,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0797-2012,irrelevant,None +37b94c08f8e25249,BSI-DSZ-CC-0799-2012,irrelevant,None +37c8d23c44b95833,ANSSI-CC-2017/16,evaluation_reused,None +37d28734245a3bb1,BSI-DSZ-CC-0257-2004,component_used,None +37e0d3cb098458d0,ANSSI-CC-2014/50,None,unclear +37e0d3cb098458d0,BSI-DSZ-CC-0999-2016,component_used,None +37fe6036c2ac932b,ANSSI-CC-2014/06,component_used,None +37fe6036c2ac932b,ANSSI-CC-2014/07,component_shared,None +37fe6036c2ac932b,BSI-DSZ-CC-0829-2012,component_used,None +3817c0aca007989e,ANSSI-CC-2011/10,component_used,None +3817c0aca007989e,ANSSI-CC-2011/12,component_shared,None +3817c0aca007989e,BSI-DSZ-CC-0523-2008,component_used,None +3817c0aca007989e,BSI-DSZ-CC-0626-2009,component_used,None +384dca297bd4f1ca,BSI-DSZ-CC-0837-V2-2014,None,unclear +384dca297bd4f1ca,BSI-DSZ-CC-0978-2016,component_used,None +3976c9e492193315,BSI-DSZ-CC-1113-2021,recertification,None +39c07ebbca541145,BSI-DSZ-CC-0917-2014,component_used,None +3a3b0a9113835307,BSI-DSZ-CC-0402-2008,recertification,None +3a3b0a9113835307,BSI-DSZ-CC-0468-2007,component_used,None +3a3b0a9113835307,CCEVS-VR-07-0054,component_used,None +3a3b0a9113835307,CCEVS-VR-VID10271-2007,component_used,None +3a6a5f536bfbd4d4,ANSSI-CC-2009/59,previous_version,None +3ba9f330ce93636b,BSI-DSZ-CC-0640-2010,component_used,None +3ba9f330ce93636b,BSI-DSZ-CC-0677-2010,evaluation_reused,None +3d149fe7c08bfc58,CRP256,previous_version,None +3d756c83419bba28,ANSSI-CC-2011/07,component_used,None +3d756c83419bba28,ANSSI-CC-2011/77,previous_version,None +3d8083b1e6c7b336,BSI-DSZ-CC-1136-V2-2022,component_used,None +3d8083b1e6c7b336,BSI-DSZ-CC-1136-V3-2022,component_used,None +3e08a27e9d9c9b1e,BSI-DSZ-CC-0973-2016,component_used,None +3e08a27e9d9c9b1e,NSCIB-CC-16-99111,irrelevant,self reference +3e182053b03f1faf,CCEVS-VR-06-0044,irrelevant,self reference +3e345d3c6002ad55,BSI-DSZ-CC-0915-2016,component_used,None +3ea02a62856c752a,ANSSI-CC-2012/70,component_used,None +3ea02a62856c752a,ANSSI-CC-2012/72,component_used,None +3ea02a62856c752a,BSI-DSZ-CC-0719-2011,component_used,None +3f188bbf2af01b25,OCSI/CERT/IMQ/07/2017/RC,recertification,None +3f22bd3eaef5d64d,BSI-DSZ-CC-0957-2015,recertification,None +3f22bd3eaef5d64d,BSI-DSZ-CC-0978-2016,component_used,None +3f4b6e4f245f6fab,ANSSI-CC-2017/49,component_used,None +3f8475de6ea558ac,BSI-DSZ-CC-0427-2007,recertification,None +3feda0b8b5637540,BSI-DSZ-CC-1059-V4-2021,component_used,None +3feda0b8b5637540,NSCIB-CC-67206-CR5,component_used,None +4057f5dbe4ffa4cd,ANSSI-CC-2017/57,evaluation_reused,None +40f62cd468a546cc,OCSI/CERT/ATS/05/2020/RC,recertification,None +40fa0a4cb5193977,ANSSI-CC-2018/27,evaluation_reused,None +40fa0a4cb5193977,BSI-DSZ-CC-0879-V3-2018,component_used,None +40fc6ad0aed92913,ANSSI-CC-2017/54,evaluation_reused,None +40fc6ad0aed92913,BSI-DSZ-CC-0891-V2-2016,component_used,None +41bd2924e9afced5,ANSSI-CC-2010/49,component_used,None +41bd2924e9afced5,ANSSI-CC-2010/50,evaluation_reused,None +420876ec1e5ba657,ANSSI-CC-2012/30,component_used,None +424f6d496746258b,ANSSI-CC-2019/12,component_used,None +424f6d496746258b,BSI-DSZ-CC-0995-2018,recertification,None +4285d9b580f8a2a6,ANSSI-CC-2013/59,component_used,None +42bc15eb26cf2eec,BSI-DSZ-CC-0829-2012,component_used,None +42d2e68c29d9eef7,ANSSI-CC-2018/30,evaluation_reused,None +42f53e51476f1a3c,ANSSI-CC-2011/07,previous_version,None +438b59086f6ebd64,BSI-DSZ-CC-1107-2020,component_used,None +43a4ca62d0c0b0da,ANSSI-CC-2017/63,evaluation_reused,None +43a4ca62d0c0b0da,ANSSI-CC-2017/64,component_used,None +43a4ca62d0c0b0da,BSI-DSZ-CC-1059-V3-2019,component_used,None +43d9cb9d3fe30ff2,BSI-DSZ-CC-0555-2009,component_used,None +43d9cb9d3fe30ff2,BSI-DSZ-CC-0857-2013,component_used,None +449c74a92ebb61a4,ANSSI-CC-2017/24,component_used,None +44becd7e128f4ba0,BSI-DSZ-CC-0410-2007,component_used,None +45098872448f5816,NSCIB-CC-0441513-CR,component_used,None +46459cfb9c1045d8,ANSSI-CC-2018/27,component_used,None +46459cfb9c1045d8,BSI-DSZ-CC-0782-V4-2018,component_used,None +4750f5114dcaa60d,BSI-DSZ-CC-0891-V4-2019,previous_version,None +47913a485c3c8a18,ANSSI-CC-2019/28,component_used,None +4832a44c0df0bad2,ANSSI-CC-2019/12,component_used,None +4832a44c0df0bad2,BSI-DSZ-CC-1074-2019,recertification,None +4893140ae5daadaf,BSI-DSZ-CC-0782-2012,component_used,None +4893140ae5daadaf,CRP278,component_used,None +48a41f3f5110db1f,BSI-DSZ-CC-0350-2007,recertification,None +48d897f17754c7ce,BSI-DSZ-CC-0978-2016,component_used,None +48fd3d84b1a0bc68,BSI-DSZ-CC-0348-2006,component_used,None +491c766e35ae9f6e,BSI-DSZ-CC-0879-V4-2020,component_used,None +491c766e35ae9f6e,BSI-DSZ-CC-1071-V3-2020,recertification,None +49e6665ee56d3bfc,ANSSI-CC-2015/45,component_used,None +49e6665ee56d3bfc,ANSSI-CC-2016/64,component_used,None +49e6665ee56d3bfc,BSI-DSZ-CC-0782-V2-2015,component_used,None +4abc83fee59586b2,ANSSI-CC-2020/07,component_used,None +4abc83fee59586b2,BSI-DSZ-CC-1110-V3-2020,component_used,None +4abc83fee59586b2,NSCIB-CC-200270-CR,previous_version,None +4b2f963b48e0f954,ANSSI-CC-2010/11,component_used,None +4b5521f85ab3fff7,BSI-DSZ-CC-0879-V4-2020,component_used,None +4b5521f85ab3fff7,BSI-DSZ-CC-1071-V4-2020,recertification,None diff --git a/src/sec_certs/data/reference_annotations/adam/train.csv b/src/sec_certs/data/reference_annotations/adam/train.csv new file mode 100644 index 00000000..6da4fc05 --- /dev/null +++ b/src/sec_certs/data/reference_annotations/adam/train.csv @@ -0,0 +1,101 @@ +dgst,canonical_reference_keyword,label,comment +e676143c80802a59,BSI-DSZ-CC-0891-V4-2019,component_used,the previously certified M7892 G12 component +0bf7a19b22163465,ANSSI-CC-2016/44,evaluation_reused,unclear whether component used +ab3af998dff7a2ef,ANSSI-CC-2017/47,component_used,None +8ba22f6c9651edc3,ANSSI-CC-2013/55,component_used,None +680aeb0a20a9fed3,BSI-DSZ-CC-0870-2014,component_used,None +3515801dee00995f,BSI-DSZ-CC-0447-2008,recertification,This is a re-certification based on BSI-DSZ-CC-0447-2008 +6a999675c9422dfb,BSI-DSZ-CC-0353-2006,recertification,This is a re-certification based on BSI-DSZ-CC-0353-2006 +12e20466a0f08342,ANSSI-CC-2016/79,evaluation_reused,unclear whether component used +d2a4b8cb9ae7fe8f,BSI-DSZ-CC-1110-V4-2021,component_used,complicated situation where referenced cert is mentioned as recertification of some other cert +921e042759b30033,BSI-DSZ-CC-0978-2016,component_used,composition scheme “[COMP]” mentioned +00efeb17bcaafce6,ANSSI-CC-2009/34,component_used,None +c175537338906951,ANSSI-CC-2016/70,component_shared,None +fb9ec9e846ea4e87,ANSSI-CC-2017/47,component_used,None +ecba01acba8df2ec,BSI-DSZ-CC-0555-2009,component_used,None +f71fca5fc684df8b,BSI-DSZ-CC-0863-2013,recertification,This is a re-certification based on BSI-DSZ-CC-0863-2013 +cacdfdafce47678c,ANSSI-CC-2014/59,component_used,None +dba4b5a166f9456a,ANSSI-CC-2014/76,evaluation_reused,None +aa096ffde94b953b,BSI-DSZ-CC-0411-2007,component_used,None +b42009eb34746731,ANSSI-CC-2021/50,previous_version,maybe previous_version +463ecd64b7506048,ANSSI-CC-2018/52,component_used,None +c5a60dbdb668bc10,BSI-DSZ-CC-0891-2015,recertification,None +c96343baf608174d,BSI-DSZ-CC-0645-2010,component_used,None +0b3e1cdf3ef9413d,BSI-DSZ-CC-0837-V2-2014,component_used,None +2c15dfc106ebf8d8,ANSSI-CC-2012/24,component_used,None +e0265f0fb8e196c0,BSI-DSZ-CC-0827-V8-2020,None,unclear +ee1c6dd97918d74a,ANSSI-CC-2012/71,evaluation_reused,None +e6e8add5e4db2d9d,BSI-DSZ-CC-0891-V4-2019,component_used,None +845bb039719ac5d8,ANSSI-CC-2010/40,previous_version,None +af61a31e3fd0d6f0,ANSSI-CC-2010/02,evaluation_reused,None +d49988efd778ca9d,ANSSI-CC-2010/02,component_used,None +54273dd266fce692,ANSSI-CC-2015/15,component_used,None +4bede5d2af4cb11f,ANSSI-CC-2019/59,evaluation_reused,None +d75282fdda80b6fd,BSI-DSZ-CC-0609-2010,recertification,None +a69ec271f8651d1b,BSI-DSZ-CC-1040-2019,component_used,None +f6579adcbf5faa99,BSI-DSZ-CC-1040-2019,component_used,None +8bdb610131555c12,BSI-DSZ-CC-0645-2010,component_used,None +b3b7ac7aae87793d,BSI-DSZ-CC-0945-V2-2018,None,unclear +371dca18821f7714,BSI-DSZ-CC-0945-2017,component_used,None +f17fe9ceea628f62,BSI-DSZ-CC-0911-2014,component_shared,The Basic Access Control mechanism was subject of the evaluation process BSI-DSZ-CC-0911-2014 +e0b122da55f1f002,BSI-DSZ-CC-0961-V2-2018,recertification,None +4f5f41ecf7517e63,ANSSI-CC-2016/80,evaluation_reused,None +a867d281d34d34b7,BSI-DSZ-CC-0976-2015,recertification,None +16bdbde359584f99,ANSSI-CC-2017/61,component_used,None +34370b67b5e675c3,ANSSI-CC-2013/47,component_used,None +a6fe8fe0aaf2fa92,ANSSI-CC-2018/26,previous_version,None +0bf7a19b22163465,ANSSI-CC-2015/80,evaluation_reused,None +1e40bd733acd56bc,BSI-DSZ-CC-0782-V4-2018,component_used,None +13d95239226aa537,BSI-DSZ-CC-0835-V2-2017,component_shared,"BAC, EAC thingy" +f869956d14ea1694,ANSSI-CC-2012/68,component_used,None +037577fc2019fcfa,ANSSI-CC-2021/49,previous_version,None +17a23970b35a4f44,BSI-DSZ-CC-0782-V5-2020,component_used,None +5a66027d34aafc52,BSI-DSZ-CC-1019-V2-2019,component_used,None +1f9f4b843070fc1b,BSI-DSZ-CC-1105-2020,component_used,None +28e70f46ba4394dd,ANSSI-CC-2012/08,component_used,None +61832cb4291c343f,BSI-DSZ-CC-0955-2016,component_used,None +42799014c183e1b3,BSI-DSZ-CC-0312-2005,component_used,None +627bfd69c2a831cf,ANSSI-CC-2014/37,evaluation_reused,None +aea11fd4d2a7709d,BSI-DSZ-CC-0809-V3-2017,component_shared,The further security mechanism Basic Access Control is subject of the separate evaluation process BSI-DSZ-CC-0809-V3-2017 +05726637bd47a762,BSI-DSZ-CC-0891-V3-2018,component_used,None +9529eb793550093c,ANSSI-CC-2018/40,previous_version,None +7a8d4ed693d443d7,BSI-DSZ-CC-1128-V3-2021,recertification,None +ed22d4c0f09c3e3a,BSI-DSZ-CC-0719-2011,recertification,None +ea6d47427a2bb349,BSI-DSZ-CC-0782-2012,recertification,None +ead1076787fdd7e4,BSI-DSZ-CC-0399-2007,component_used,None +30f71b100c5cebae,ANSSI-CC-2015/15,component_used,None +6eb6b29c45f6355f,BSI-DSZ-CC-0782-V4-2018,component_used,None +06e505abb8dad1b8,ANSSI-CC-2017/54,component_used,None +317713948b4473b3,BSI-DSZ-CC-0798-2012,component_shared,None +055985699aee1e09,ANSSI-CC-2010/02,component_used,None +b61363e51ed90c7a,ANSSI-CC-2019/12,component_used,None +691119fe8a2f8e1c,BSI-DSZ-CC-0963-2015,component_used,None +a07548a64fac5794,BSI-DSZ-CC-0350-2007,recertification,None +19c60923e31777e7,ANSSI-CC-2017/49,component_used,None +f17fe9ceea628f62,BSI-DSZ-CC-0750-V2-2014,component_used,None +c96343baf608174d,BSI-DSZ-CC-0750-2011,component_used,None +42799014c183e1b3,BSI-DSZ-CC-0429-2007,recertification,None +3f45ee333ce457bb,BSI-DSZ-CC-1002-2018,recertification,None +5f4b39feb2a82dac,BSI-DSZ-CC-0266-2005,component_used,unclear +4a6100f1ddaef93b,BSI-DSZ-CC-0410-2007,component_used,None +c06d86db280f9b2b,BSI-DSZ-CC-0437-2008,component_used,None +ab3af998dff7a2ef,BSI-DSZ-CC-0973-V2-2016,component_used,None +30120e4f3aa2f30a,BSI-DSZ-CC-0897-V2-2014,component_used,None +c32378a010479b33,BSI-DSZ-CC-0891-V2-2016,recertification,None +ecba01acba8df2ec,BSI-DSZ-CC-0633-2010,component_used,None +bab97726875c0f14,BSI-DSZ-CC-0957-V2-2016,evaluation_reused,"unclear, mentions that this is a “re-evaluation” but not a “re-certification”" +97d00a9f198a6e57,ANSSI-CC-2015/66,component_used,None +744a7a202d909323,ANSSI-CC-2017/24,component_used,None +df6728b8420ab3b4,BSI-DSZ-CC-0827-V4-2016,component_used,None +6f8d7a6a1dea6a3a,ANSSI-CC-2019/28,component_used,None +1b8705a0486b3be1,NSCIB-CC-0209053-CR,previous_version,None +a9d336b90e8b94a2,BSI-DSZ-CC-0410-2007,recertification,None +cfdacd53c732343c,BSI-DSZ-CC-1110-V2-2019,component_used,None +27d11629261d8806,ANSSI-CC-2014/59,component_used,None +a76d1c0d9964d583,BSI-DSZ-CC-0417-2008,component_used,None +d2b0cb5a911b8ef8,BSI-DSZ-CC-0729-2011,recertification,None +c38734a9eeea0ff8,BSI-DSZ-CC-0950-V2-2018,None,"unclear, mentions just ToE delivery" +84a75b6fc33b669e,ANSSI-CC-2014/08,evaluation_reused,None +36ed04f4b45e3ab9,BSI-DSZ-CC-0555-2009,component_used,None +01e8805514b4ef67,BSI-DSZ-CC-0891-V3-2018,component_used,None +0f3900cdcd0c7f3e,NSCIB-CC-66030-CR5,component_used,None diff --git a/src/sec_certs/data/reference_annotations/adam/valid.csv b/src/sec_certs/data/reference_annotations/adam/valid.csv new file mode 100644 index 00000000..948845eb --- /dev/null +++ b/src/sec_certs/data/reference_annotations/adam/valid.csv @@ -0,0 +1,108 @@ +dgst,canonical_reference_keyword,label,comment +a21d17fd2d8b8edc,BSI-DSZ-CC-0813-2012,component_used,None +657f8d0cc39bbcdc,BSI-DSZ-CC-0946-2014,recertification,None +0efe2627f1ce8ac2,BSI-DSZ-CC-0351-2006,component_used,None +983d16512ae92d46,BSI-DSZ-CC-0891-V3-2018,recertification,None +8dd850c81b49a1f9,BSI-DSZ-CC-0697-2011,recertification,None +774cb0f28f7900f9,BSI-DSZ-CC-0232-2004,evaluation_reused,None +c37a9b7ae53093d8,CCEVS-VR-VID10256-2012,evaluation_reused,None +a5adb726852f5cc5,ANSSI-CC-2009/37,component_used,None +4d983357fd464bb5,BSI-DSZ-CC-1107-V2-2021,component_used,None +cc533c087f06ad0d,BSI-DSZ-CC-1040-2019,component_used,None +24de96ea505af909,ANSSI-CC-2021/29,component_used,None +2793414918738c7f,BSI-DSZ-CC-0857-2013,component_used,None +b402cb61be362e5f,BSI-DSZ-CC-0946-V2-2015,recertification,None +d96438a7165e5d82,BSI-DSZ-CC-0410-2007,component_used,None +4b3f577896c80f8a,ANSSI-CC-2015/80,evaluation_reused,None +22388445fe620ac0,ANSSI-CC-2014/20,evaluation_reused,None +2c2244c35d126bfb,BSI-DSZ-CC-0794-2011,recertification,None +6a85bb1d21a35e7d,BSI-DSZ-CC-0227-2004,component_used,None +120a49c0aa284f68,BSI-DSZ-CC-0813-2012,component_used,None +994ac7d986a99e50,BSI-DSZ-CC-0640-2010,component_used,None +16abf8ee0697e64f,ANSSI-CC-2014/61,component_shared,None +f05de4db911ec8af,CRP243,previous_version,None +38f79f1a48e7844f,ANSSI-CC-2017/47,component_used,None +fe55e99f4f3dc195,ANSSI-CC-2013/33,evaluation_reused,None +fc875e0381a28435,BSI-DSZ-CC-0432-2007,recertification,None +c23bb542201aa511,BSI-DSZ-CC-0829-2012,component_used,None +2532fe8c7214c485,BSI-DSZ-CC-0675-2011,component_used,None +2cbc543a7c7de8b5,BSI-DSZ-CC-0813-2012,component_used,None +833ff87d69cff5db,383-4-184,None,unclear +c7c1215819127a1c,BSI-DSZ-CC-0322-2005,component_used,None +647d17d44745a532,BSI-DSZ-CC-0904-2015,recertification,None +4489bfc781a82281,BSI-DSZ-CC-0817-2013,recertification,None +94fb86d31446e531,BSI-DSZ-CC-0958-2015,component_used,None +37bae9eaf342542b,BSI-DSZ-CC-0349-2006,evaluation_reused,None +5c06e4fb1887fdc7,BSI-DSZ-CC-0782-V2-2015,component_used,None +5bf14a907f9a4c65,BSI-DSZ-CC-0527-2008,recertification,None +d314fa7ee445bd1d,BSI-DSZ-CC-0410-2007,component_used,None +0f53257eb74bee54,BSI-DSZ-CC-0417-2008,component_used,unclear +84d6a370e4f38ddc,ANSSI-CC-2019/12,component_used,None +1a5f86cb1d942c37,BSI-DSZ-CC-1110-2019,recertification,None +d696a9daccdb2a9f,BSI-DSZ-CC-1136-2021,component_used,None +38e7d62918a4f9b6,BSI-DSZ-CC-0688-2013,recertification,None +e6057ffc5085a192,ANSSI-CC-2014/48,evaluation_reused,None +db7627e56b8621b1,BSI-DSZ-CC-0639-2010,component_used,None +4b3f577896c80f8a,ANSSI-CC-2016/44,previous_version,None +5f3c9c6bf76ba72d,ANSSI-CC-2018/51,component_used,None +22d6578b30f5a227,BSI-DSZ-CC-1107-2020,component_used,None +a0c38b4389ad7cf7,ANSSI-CC-2018/12,component_used,None +19c7a1b1a2df87d7,BSI-DSZ-CC-0945-V2-2018,component_used,None +f654c82bca57cf62,BSI-DSZ-CC-0957-V2-2016,None,unclear +2f0be9733140e2c6,BSI-DSZ-CC-0977-V2-2019,component_used,None +3357c28c91cc2ed1,ANSSI-CC-2016/44,evaluation_reused,None +f6317f134f532696,ANSSI-CC-2017/24,component_shared,None +234da54efbcf734b,BSI-DSZ-CC-0917-2014,component_used,None +1b20b1629ba7d3a6,ANSSI-CC-2012/72,component_used,None +2532fe8c7214c485,BSI-DSZ-CC-0633-2010,evaluation_reused,None +b1ef468658a9a0c1,NSCIB-CC-0448219-CR,evaluation_reused,None +35482ae218713d54,BSI-DSZ-CC-0951-V3-2018,recertification,None +edb3056f1838e6ae,BSI-DSZ-CC-0348-2006,component_shared,"Quite weird, The evaluation was performed as a re-evaluation process based on BSI-DSZCC-0227-2004, BSI-DSZ-CC-0312-2005 and BSI-DSZ-CC-0348-2006. +Compared to BSI-DSZ-CC-0227-2004 the TOE was re-evaluated because of +technical and yield improvements. Compared to BSI-DSZ-CC-0348-2006 the +TOE was re-evaluated because of changes on top layers for modified module +packaging requirements. Additional package types (MOB4 and complete +passport inlay) and the relevant production sites were included in the evaluation +process. For production sites, results from BSI-DSZ-CC-0312-2005 were reused. The additional production steps do not influence the configuration of the +TOE itself. The Security Target was updated. " +3f2a6d4893c18634,NSCIB-CC-12-36243-CR2,component_shared,None +0fe8df0e85116b61,ANSSI-CC-2010/33,component_shared,None +bbc41d7d09e40c0c,BSI-DSZ-CC-0404-2007,recertification,None +b00bb452e7a8176c,ANSSI-CC-2016/57,previous_version,None +7e58bfc14edf68e4,OCSI/CERT/TEC/01/2013/RC,recertification,None +81273108dd167b98,BSI-DSZ-CC-0523-2008,recertification,None +63c1045055ec3b58,BSI-DSZ-CC-0266-2005,component_used,None +a3c99646acb0bb6f,BSI-DSZ-CC-0837-V2-2014,component_used,None +4c017087976d05eb,ANSSI-CC-2020/45,evaluation_reused,None +f4d510a39278e687,ANSSI-CC-2018/32,component_used,None +c23bb542201aa511,ANSSI-CC-2014/14,component_shared,None +625b243397001f01,BSI-DSZ-CC-1059-2018,component_used,None +cae968d4926648bd,BSI-DSZ-CC-0754-2012,recertification,None +000176284683faa2,BSI-DSZ-CC-0640-2010,component_used,None +66faa094a9333d1a,ANSSI-CC-2014/86,evaluation_reused,None +a6dc46792d4e41c8,BSI-DSZ-CC-0203-2003,component_used,None +031667f4e242da61,CCEVS-VR-07-0054,component_used,None +459539da9315ccac,ANSSI-CC-2021/30,previous_version,None +69b15e884cc13c70,BSI-DSZ-CC-0891-V2-2016,component_used,None +a4bbf07046109fc9,BSI-DSZ-CC-0935-2015,component_used,None +50aef770cb4f028f,BSI-DSZ-CC-1059-V3-2019,component_used,None +5cf51622fafaf868,BSI-DSZ-CC-1005-2016,recertification,None +1e23ae421d7a2d01,BSI-DSZ-CC-0633-V2-2014,component_used,None +0c7ef6c32cbdee47,ANSSI-CC-2017/61,component_used,None +8928e191ee2fd3b9,BSI-DSZ-CC-0523-2008,component_used,None +6ed3cd21c6a2c9d0,BSI-DSZ-CC-1107-2020,component_used,None +4962c0d8106b8b5e,ANSSI-CC-2015/37,evaluation_reused,None +e6057ffc5085a192,BSI-DSZ-CC-0829-2012,component_used,None +03fad65e5af65088,BSI-DSZ-CC-0696-2011,recertification,None +720aab4f782f4c60,BSI-DSZ-CC-0555-2009,component_used,None +9664c0f0ec6401b9,BSI-DSZ-CC-0891-V2-2016,recertification,None +d55eb8c97d71e843,ANSSI-CC-2021/49,previous_version,None +73e0b884cd04d9bc,NSCIB-CC-12-36243,component_used,None +2793414918738c7f,BSI-DSZ-CC-0633-V2-2014,component_used,None +f6a89befd13a643f,BSI-DSZ-CC-0951-V4-2019,component_used,None +f00a01940be6481d,BSI-DSZ-CC-0837-V2-2014,component_used,None +2f43fe24bd8e91e1,ANSSI-CC-2020/65,component_used,None +d96438a7165e5d82,BSI-DSZ-CC-0411-2007,component_used,None +7623950728f52a71,ANSSI-CC-2016/06,component_used,None +ba69597434946260,BSI-DSZ-CC-0293-2005,component_used,None +50aef770cb4f028f,BSI-DSZ-CC-1059-2018,component_used,None diff --git a/src/sec_certs/data/reference_annotations/conflicts/test.csv b/src/sec_certs/data/reference_annotations/conflicts/test.csv new file mode 100644 index 00000000..dca3c452 --- /dev/null +++ b/src/sec_certs/data/reference_annotations/conflicts/test.csv @@ -0,0 +1,47 @@ +dgst,canonical_reference_keyword,label_adam,label_jano,resolution_label +173097995b7a7f12,ANSSI-CC-2012/49,component_shared,evaluation_reused,component_shared +173097995b7a7f12,ANSSI-CC-2013/28,evaluation_reused,component_used,component_used +18b7e5bdf459ca13,NSCIB-CC-07-09219,component_used,previous_version,previous_version +195366bfba7213a5,BSI-DSZ-CC-0266-2005,component_used,None,component_used +195366bfba7213a5,BSI-DSZ-CC-0322-2005,component_used,None,previous_version +195366bfba7213a5,BSI-DSZ-CC-0399-2007,recertification,None,recertification +1999d4ed82b3188e,BSI-DSZ-CC-0451-2007,component_used,None,component_used +1ea31bb5f6a15995,BSI-DSZ-CC-0808-V3-2017,evaluation_reused,component_shared,component_shared +22ede463dbf1a105,ANSSI-CC-2015/36,evaluation_reused,component_used,component_used +22ede463dbf1a105,ANSSI-CC-2015/80,evaluation_reused,irrelevant,irrelevant +26c4912b140fde9f,BSI-DSZ-CC-0891-V2-2016,evaluation_reused,component_used,component_used +27ccec0740bb7915,ANSSI-CC-2010/35,evaluation_reused,component_shared,component_shared +296618f10b019d9c,BSI-DSZ-CC-0417-2008,evaluation_reused,component_used,component_used +2f9feaf4121720da,BSI-DSZ-CC-0547-2009,recertification,evaluation_reused,recertification +31fd07069aebf013,BSI-DSZ-CC-0466-2008,evaluation_reused,component_used,previous_version +34506b8fab6dd7c3,ANSSI-CC-2014/22,evaluation_reused,previous_version,previous_version +054bd8196e015197,ANSSI-CC-2011/07,None,evaluation_reused,evaluation_reused +25c07c5d0a05d86c,BSI-DSZ-CC-0845-2012,component_used,None,component_used +25c07c5d0a05d86c,BSI-DSZ-CC-0845-V2-2013,component_used,evaluation_reused,component_used +29cc495628e76ffa,BSI-DSZ-CC-0886-2013,irrelevant,component_shared,component_shared +35b9be2203d2b9e6,BSI-DSZ-CC-0895-2014,irrelevant,component_shared,component_shared +3746512864b941d4,ANSSI-CC-2016/15,evaluation_reused,previous_version,evaluation_reused +37b94c08f8e25249,BSI-DSZ-CC-0404-2007,component_used,None,component_used +37b94c08f8e25249,BSI-DSZ-CC-0410-2007,component_used,None,component_used +37b94c08f8e25249,BSI-DSZ-CC-0555-2009,component_used,None,component_used +37b94c08f8e25249,BSI-DSZ-CC-0633-2010,component_used,None,component_used +37b94c08f8e25249,BSI-DSZ-CC-0709-2010,component_used,None,component_used +37b94c08f8e25249,BSI-DSZ-CC-0710-2010,component_used,None,component_used +37b94c08f8e25249,BSI-DSZ-CC-0797-2012,irrelevant,component_shared,component_shared +37b94c08f8e25249,BSI-DSZ-CC-0799-2012,irrelevant,None,component_shared +37c8d23c44b95833,ANSSI-CC-2017/16,evaluation_reused,previous_version,previous_version +37d28734245a3bb1,BSI-DSZ-CC-0257-2004,component_used,previous_version,component_used +37e0d3cb098458d0,ANSSI-CC-2014/50,None,component_used,component_used +37fe6036c2ac932b,ANSSI-CC-2014/07,component_shared,previous_version,previous_version +3817c0aca007989e,ANSSI-CC-2011/12,component_shared,previous_version,component_shared +384dca297bd4f1ca,BSI-DSZ-CC-0837-V2-2014,None,component_used,component_used +3e08a27e9d9c9b1e,NSCIB-CC-16-99111,irrelevant,previous_version,irrelevant +4057f5dbe4ffa4cd,ANSSI-CC-2017/57,evaluation_reused,previous_version,previous_version +40fa0a4cb5193977,ANSSI-CC-2018/27,evaluation_reused,previous_version,component_shared +40fc6ad0aed92913,ANSSI-CC-2017/54,evaluation_reused,component_used,previous_version +41bd2924e9afced5,ANSSI-CC-2010/49,component_used,previous_version,previous_version +41bd2924e9afced5,ANSSI-CC-2010/50,evaluation_reused,previous_version,previous_version +42d2e68c29d9eef7,ANSSI-CC-2018/30,evaluation_reused,previous_version,evaluation_reused +43a4ca62d0c0b0da,ANSSI-CC-2017/64,component_used,irrelevant,component_used +4750f5114dcaa60d,BSI-DSZ-CC-0891-V4-2019,previous_version,irrelevant,irrelevant +4893140ae5daadaf,CRP278,component_used,component_shared,component_used diff --git a/src/sec_certs/data/reference_annotations/conflicts/train.csv b/src/sec_certs/data/reference_annotations/conflicts/train.csv new file mode 100644 index 00000000..8ac397ce --- /dev/null +++ b/src/sec_certs/data/reference_annotations/conflicts/train.csv @@ -0,0 +1,10 @@ +dgst,canonical_reference_keyword,label_adam,label_jano,resolution_label +037577fc2019fcfa,ANSSI-CC-2021/49,previous_version,evaluation_reused,previous_version +1b8705a0486b3be1,NSCIB-CC-0209053-CR,previous_version,evaluation_reused,previous_version +9529eb793550093c,ANSSI-CC-2018/40,previous_version,evaluation_reused,previous_version +a76d1c0d9964d583,BSI-DSZ-CC-0417-2008,component_used,evaluation_reused,component_used +b42009eb34746731,ANSSI-CC-2021/50,previous_version,evaluation_reused,previous_version +bab97726875c0f14,BSI-DSZ-CC-0957-V2-2016,evaluation_reused,None,evaluation_reused +c175537338906951,ANSSI-CC-2016/70,component_shared,component_used,component_shared +c32378a010479b33,BSI-DSZ-CC-0891-V2-2016,recertification,evaluation_reused,evaluation_reused +dba4b5a166f9456a,ANSSI-CC-2014/76,evaluation_reused,previous_version,recertification diff --git a/src/sec_certs/data/reference_annotations/conflicts/valid.csv b/src/sec_certs/data/reference_annotations/conflicts/valid.csv new file mode 100644 index 00000000..b18f88ee --- /dev/null +++ b/src/sec_certs/data/reference_annotations/conflicts/valid.csv @@ -0,0 +1,17 @@ +dgst,canonical_reference_keyword,label_adam,label_jano,resolution_label +0f53257eb74bee54,BSI-DSZ-CC-0417-2008,component_used,None,component_used +0fe8df0e85116b61,ANSSI-CC-2010/33,component_shared,evaluation_reused,previous_version +16abf8ee0697e64f,ANSSI-CC-2014/61,component_shared,evaluation_reused,component_shared +2532fe8c7214c485,BSI-DSZ-CC-0633-2010,evaluation_reused,component_used,component_used +3357c28c91cc2ed1,ANSSI-CC-2016/44,evaluation_reused,component_used,evaluation_reused +3f2a6d4893c18634,NSCIB-CC-12-36243-CR2,component_shared,component_used,component_used +4b3f577896c80f8a,ANSSI-CC-2015/80,evaluation_reused,component_used,evaluation_reused +4b3f577896c80f8a,ANSSI-CC-2016/44,previous_version,component_used,evaluation_reused +774cb0f28f7900f9,BSI-DSZ-CC-0232-2004,evaluation_reused,component_used,evaluation_reused +7e58bfc14edf68e4,OCSI/CERT/TEC/01/2013/RC,recertification,previous_version,recertification +b00bb452e7a8176c,ANSSI-CC-2016/57,previous_version,evaluation_reused,previous_version +c23bb542201aa511,ANSSI-CC-2014/14,component_shared,component_used,previous_version +c37a9b7ae53093d8,CCEVS-VR-VID10256-2012,evaluation_reused,component_shared,None +edb3056f1838e6ae,BSI-DSZ-CC-0348-2006,component_shared,evaluation_reused,evaluation_reused +f05de4db911ec8af,CRP243,previous_version,component_used,previous_version +f6317f134f532696,ANSSI-CC-2017/24,component_shared,evaluation_reused,previous_version diff --git a/src/sec_certs/data/reference_annotations/final/test.csv b/src/sec_certs/data/reference_annotations/final/test.csv new file mode 100644 index 00000000..fbda9fd8 --- /dev/null +++ b/src/sec_certs/data/reference_annotations/final/test.csv @@ -0,0 +1,201 @@ +dgst,canonical_reference_keyword,label,comment +15ae64b85b3e28d7,BSI-DSZ-CC-0394-2006,recertification,None +15b121492722bffb,BSI-DSZ-CC-0754-2012,recertification,None +16513a1bff79b46a,BSI-DSZ-CC-1044-V2-2019,recertification,None +16b0a0811bc4fe82,BSI-DSZ-CC-0169-2002,component_used,None +16b24ff1bf3c079b,ANSSI-CC-2012/22,component_used,None +173097995b7a7f12,ANSSI-CC-2012/49,component_shared,None +173097995b7a7f12,ANSSI-CC-2013/28,component_used,None +173704f0d2b8a02f,ANSSI-CC-2018/08,component_used,None +173704f0d2b8a02f,ANSSI-CC-2018/19,component_used,None +177dee4c1051e612,BSI-DSZ-CC-0854-2013,recertification,None +17bfc3d0570ab3d0,ANSSI-CC-2016/09,component_used,None +183a5cd3e2aaa0ec,ANSSI-CC-2017/76,component_used,None +183a5cd3e2aaa0ec,BSI-DSZ-CC-0891-V2-2016,component_used,None +18a515a0fff0c0c3,BSI-DSZ-CC-0957-V2-2016,component_used,None +18b7e5bdf459ca13,NSCIB-CC-07-09219,previous_version,None +195366bfba7213a5,BSI-DSZ-CC-0266-2005,component_used,None +195366bfba7213a5,BSI-DSZ-CC-0322-2005,previous_version,None +195366bfba7213a5,BSI-DSZ-CC-0399-2007,recertification,None +1999d4ed82b3188e,BSI-DSZ-CC-0451-2007,component_used,None +19d3185c40be008d,ANSSI-CC-2016/65,evaluation_reused,None +1ac8de53c0894d18,BSI-DSZ-CC-0814-2012,recertification,None +1b2764a62ffe86a2,BSI-DSZ-CC-0978-2016,component_used,None +1bcfaefe46abccf0,BSI-DSZ-CC-0917-2014,component_used,None +1c8567a1b1a6c12a,BSI-DSZ-CC-1040-2019,component_used,None +1cc05dbb992431b9,ANSSI-CC-2021/29,component_used,None +1d1df0fb541e49b8,BSI-DSZ-CC-1020-V2-2017,recertification,None +1d9ae732c5dec242,ANSSI-CC-2009/37,component_used,None +1ea31bb5f6a15995,BSI-DSZ-CC-0808-V3-2017,component_shared,None +1ea31bb5f6a15995,BSI-DSZ-CC-0809-V2-2016,recertification,None +1ea31bb5f6a15995,BSI-DSZ-CC-0978-V2-2017,component_used,None +1ff08f79cb89c1de,BSI-DSZ-CC-0939-2015,recertification,None +2078424be58e4db1,OCSI/CERT/SYS/08/2017/RC,recertification,None +21951e191e55b66e,BSI-DSZ-CC-0782-2012,component_used,None +21cffadbbb87c205,BSI-DSZ-CC-0348-2006,component_used,None +22ede463dbf1a105,ANSSI-CC-2015/36,component_used,None +22ede463dbf1a105,ANSSI-CC-2015/80,irrelevant,None +22ede463dbf1a105,ANSSI-CC-2016/43,evaluation_reused,None +22ede463dbf1a105,ANSSI-CC-2016/44,evaluation_reused,None +23a85a7f9c07412f,ANSSI-CC-2014/46,evaluation_reused,None +23a85a7f9c07412f,ANSSI-CC-2016/33,evaluation_reused,None +24624a4e60ddedd4,BSI-DSZ-CC-0868-2014,previous_version,None +24624a4e60ddedd4,BSI-DSZ-CC-0951-2015,component_used,None +259df98e7476a843,BSI-DSZ-CC-0666-2012,recertification,None +259e0ab1c4b690cf,ANSSI-CC-2012/70,component_used,None +25c07c5d0a05d86c,ANSSI-CC-2015/08,component_shared,None +25c07c5d0a05d86c,ANSSI-CC-2015/15,component_used,None +26c4912b140fde9f,BSI-DSZ-CC-0891-V2-2016,component_used,None +26c7b173668167d8,BSI-DSZ-CC-0813-2012,component_used,None +2760aeedce0b79db,ANSSI-CC-2011/64,evaluation_reused,None +2760aeedce0b79db,BSI-DSZ-CC-0555-2009,component_used,None +27ccec0740bb7915,ANSSI-CC-2010/02,component_used,None +27ccec0740bb7915,ANSSI-CC-2010/20,evaluation_reused,None +27ccec0740bb7915,ANSSI-CC-2010/35,component_shared,None +296618f10b019d9c,BSI-DSZ-CC-0417-2008,component_used,None +29cc495628e76ffa,BSI-DSZ-CC-0845-2012,component_used,None +29f2dd90f57ea948,BSI-DSZ-CC-0837-V2-2014,component_used,None +29fb07d8f74e734b,BSI-DSZ-CC-0303-2006,recertification,None +2a07b85f61ac08b0,ANSSI-CC-2019/59,evaluation_reused,None +2a91f42389fda90d,BSI-DSZ-CC-0782-V2-2015,component_used,None +2adb03f5294c31c2,BSI-DSZ-CC-0608-2010,recertification,None +2b0342d5b70b7a78,ANSSI-CC-2010/03,component_used,None +2bd9661657e78278,ANSSI-CC-2012/39,previous_version,None +2bd9661657e78278,ANSSI-CC-2013/13,component_used,None +2be10f342e68a89e,BSI-DSZ-CC-0963-V2-2017,recertification,None +2c41f9dfcd5014e6,BSI-DSZ-CC-0973-2016,recertification,None +2d046178aa118fff,BSI-DSZ-CC-0293-2005,recertification,None +2d0b4100c3ead88a,BSI-DSZ-CC-0945-V2-2018,component_used,None +2eee0fdd5cdaf565,ANSSI-CC-2017/07,component_used,None +2eee0fdd5cdaf565,BSI-DSZ-CC-0891-V2-2016,component_used,None +2f9feaf4121720da,BSI-DSZ-CC-0547-2009,recertification,None +30e9ce0969941ffb,BSI-DSZ-CC-0782-V2-2015,component_used,None +3183669bf78db43b,ANSSI-CC-2015/45,component_used,None +3183669bf78db43b,ANSSI-CC-2016/64,component_used,None +3183669bf78db43b,BSI-DSZ-CC-0782-V2-2015,component_used,None +31fd07069aebf013,BSI-DSZ-CC-0466-2008,previous_version,None +328fee1e52f7ac82,BSI-DSZ-CC-0410-2007,component_used,None +328fee1e52f7ac82,BSI-DSZ-CC-0680-2010,component_used,None +3334d22b6559d0e2,BSI-DSZ-CC-0944-2014,recertification,None +3334d22b6559d0e2,BSI-DSZ-CC-0963-V2-2017,component_used,None +337ece90615ed69d,ANSSI-CC-2010/02,component_used,None +3392558f04e04663,BSI-DSZ-CC-0782-V2-2015,component_used,None +33cada8c95bf55c5,BSI-DSZ-CC-0879-V3-2018,component_used,None +33cada8c95bf55c5,BSI-DSZ-CC-1028-2017,recertification,None +34506b8fab6dd7c3,ANSSI-CC-2014/22,previous_version,None +34ed76f0c32d9e93,ANSSI-CC-2012/49,evaluation_reused,None +34ed76f0c32d9e93,ANSSI-CC-2013/18,component_used,None +3519c14e4114d93d,BSI-DSZ-CC-0782-2012,component_used,None +35b9be2203d2b9e6,ANSSI-CC-2012/70,component_used,None +35efe13fa9e93a68,CRP178,component_used,None +35efe13fa9e93a68,CRP182,component_used,None +36641ce7192b5f92,BSI-DSZ-CC-0977-2017,component_used,None +054bd8196e015197,ANSSI-CC-2011/07,evaluation_reused,unclear +122245dd15683e26,BSI-DSZ-CC-0269-2006,None,unclear +25c07c5d0a05d86c,BSI-DSZ-CC-0845-2012,component_used,very difficult +25c07c5d0a05d86c,BSI-DSZ-CC-0845-V2-2013,component_used,None +29cc495628e76ffa,BSI-DSZ-CC-0886-2013,component_shared,None +2a07b85f61ac08b0,ANSSI-CC-2019/02,component_used,None +30c6777901ae346c,BSI-DSZ-CC-0438-2007,component_used,None +35b9be2203d2b9e6,BSI-DSZ-CC-0895-2014,component_shared,None +36df04ab9c978ab9,BSI-DSZ-CC-0624-2010,component_used,None +373e7b1bc9066563,BSI-DSZ-CC-1110-V2-2019,component_used,None +3746512864b941d4,ANSSI-CC-2016/15,evaluation_reused,None +37b94c08f8e25249,BSI-DSZ-CC-0404-2007,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0410-2007,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0555-2009,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0633-2010,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0674-2011,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0675-2011,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0709-2010,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0710-2010,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0730-2011,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0797-2012,component_shared,None +37b94c08f8e25249,BSI-DSZ-CC-0799-2012,component_shared,None +37c8d23c44b95833,ANSSI-CC-2017/16,previous_version,None +37d28734245a3bb1,BSI-DSZ-CC-0257-2004,component_used,None +37e0d3cb098458d0,ANSSI-CC-2014/50,component_used,unclear +37e0d3cb098458d0,BSI-DSZ-CC-0999-2016,component_used,None +37fe6036c2ac932b,ANSSI-CC-2014/06,component_used,None +37fe6036c2ac932b,ANSSI-CC-2014/07,previous_version,None +37fe6036c2ac932b,BSI-DSZ-CC-0829-2012,component_used,None +3817c0aca007989e,ANSSI-CC-2011/10,component_used,None +3817c0aca007989e,ANSSI-CC-2011/12,component_shared,None +3817c0aca007989e,BSI-DSZ-CC-0523-2008,component_used,None +3817c0aca007989e,BSI-DSZ-CC-0626-2009,component_used,None +384dca297bd4f1ca,BSI-DSZ-CC-0837-V2-2014,component_used,unclear +384dca297bd4f1ca,BSI-DSZ-CC-0978-2016,component_used,None +3976c9e492193315,BSI-DSZ-CC-1113-2021,recertification,None +39c07ebbca541145,BSI-DSZ-CC-0917-2014,component_used,None +3a3b0a9113835307,BSI-DSZ-CC-0402-2008,recertification,None +3a3b0a9113835307,BSI-DSZ-CC-0468-2007,component_used,None +3a3b0a9113835307,CCEVS-VR-07-0054,component_used,None +3a3b0a9113835307,CCEVS-VR-VID10271-2007,component_used,None +3a6a5f536bfbd4d4,ANSSI-CC-2009/59,previous_version,None +3ba9f330ce93636b,BSI-DSZ-CC-0640-2010,component_used,None +3ba9f330ce93636b,BSI-DSZ-CC-0677-2010,evaluation_reused,None +3d149fe7c08bfc58,CRP256,previous_version,None +3d756c83419bba28,ANSSI-CC-2011/07,component_used,None +3d756c83419bba28,ANSSI-CC-2011/77,previous_version,None +3d8083b1e6c7b336,BSI-DSZ-CC-1136-V2-2022,component_used,None +3d8083b1e6c7b336,BSI-DSZ-CC-1136-V3-2022,component_used,None +3e08a27e9d9c9b1e,BSI-DSZ-CC-0973-2016,component_used,None +3e08a27e9d9c9b1e,NSCIB-CC-16-99111,irrelevant,self reference +3e182053b03f1faf,CCEVS-VR-06-0044,irrelevant,self reference +3e345d3c6002ad55,BSI-DSZ-CC-0915-2016,component_used,None +3ea02a62856c752a,ANSSI-CC-2012/70,component_used,None +3ea02a62856c752a,ANSSI-CC-2012/72,component_used,None +3ea02a62856c752a,BSI-DSZ-CC-0719-2011,component_used,None +3f188bbf2af01b25,OCSI/CERT/IMQ/07/2017/RC,recertification,None +3f22bd3eaef5d64d,BSI-DSZ-CC-0957-2015,recertification,None +3f22bd3eaef5d64d,BSI-DSZ-CC-0978-2016,component_used,None +3f4b6e4f245f6fab,ANSSI-CC-2017/49,component_used,None +3f8475de6ea558ac,BSI-DSZ-CC-0427-2007,recertification,None +3feda0b8b5637540,BSI-DSZ-CC-1059-V4-2021,component_used,None +3feda0b8b5637540,NSCIB-CC-67206-CR5,component_used,None +4057f5dbe4ffa4cd,ANSSI-CC-2017/57,previous_version,None +40f62cd468a546cc,OCSI/CERT/ATS/05/2020/RC,recertification,None +40fa0a4cb5193977,ANSSI-CC-2018/27,component_shared,None +40fa0a4cb5193977,BSI-DSZ-CC-0879-V3-2018,component_used,None +40fc6ad0aed92913,ANSSI-CC-2017/54,previous_version,None +40fc6ad0aed92913,BSI-DSZ-CC-0891-V2-2016,component_used,None +41bd2924e9afced5,ANSSI-CC-2010/49,previous_version,None +41bd2924e9afced5,ANSSI-CC-2010/50,previous_version,None +420876ec1e5ba657,ANSSI-CC-2012/30,component_used,None +424f6d496746258b,ANSSI-CC-2019/12,component_used,None +424f6d496746258b,BSI-DSZ-CC-0995-2018,recertification,None +4285d9b580f8a2a6,ANSSI-CC-2013/59,component_used,None +42bc15eb26cf2eec,BSI-DSZ-CC-0829-2012,component_used,None +42d2e68c29d9eef7,ANSSI-CC-2018/30,evaluation_reused,None +42f53e51476f1a3c,ANSSI-CC-2011/07,previous_version,None +438b59086f6ebd64,BSI-DSZ-CC-1107-2020,component_used,None +43a4ca62d0c0b0da,ANSSI-CC-2017/63,evaluation_reused,None +43a4ca62d0c0b0da,ANSSI-CC-2017/64,component_used,None +43a4ca62d0c0b0da,BSI-DSZ-CC-1059-V3-2019,component_used,None +43d9cb9d3fe30ff2,BSI-DSZ-CC-0555-2009,component_used,None +43d9cb9d3fe30ff2,BSI-DSZ-CC-0857-2013,component_used,None +449c74a92ebb61a4,ANSSI-CC-2017/24,component_used,None +44becd7e128f4ba0,BSI-DSZ-CC-0410-2007,component_used,None +45098872448f5816,NSCIB-CC-0441513-CR,component_used,None +46459cfb9c1045d8,ANSSI-CC-2018/27,component_used,None +46459cfb9c1045d8,BSI-DSZ-CC-0782-V4-2018,component_used,None +4750f5114dcaa60d,BSI-DSZ-CC-0891-V4-2019,irrelevant,None +47913a485c3c8a18,ANSSI-CC-2019/28,component_used,None +4832a44c0df0bad2,ANSSI-CC-2019/12,component_used,None +4832a44c0df0bad2,BSI-DSZ-CC-1074-2019,recertification,None +4893140ae5daadaf,BSI-DSZ-CC-0782-2012,component_used,None +4893140ae5daadaf,CRP278,component_used,None +48a41f3f5110db1f,BSI-DSZ-CC-0350-2007,recertification,None +48d897f17754c7ce,BSI-DSZ-CC-0978-2016,component_used,None +48fd3d84b1a0bc68,BSI-DSZ-CC-0348-2006,component_used,None +491c766e35ae9f6e,BSI-DSZ-CC-0879-V4-2020,component_used,None +491c766e35ae9f6e,BSI-DSZ-CC-1071-V3-2020,recertification,None +49e6665ee56d3bfc,ANSSI-CC-2015/45,component_used,None +49e6665ee56d3bfc,ANSSI-CC-2016/64,component_used,None +49e6665ee56d3bfc,BSI-DSZ-CC-0782-V2-2015,component_used,None +4abc83fee59586b2,ANSSI-CC-2020/07,component_used,None +4abc83fee59586b2,BSI-DSZ-CC-1110-V3-2020,component_used,None +4abc83fee59586b2,NSCIB-CC-200270-CR,previous_version,None +4b2f963b48e0f954,ANSSI-CC-2010/11,component_used,None +4b5521f85ab3fff7,BSI-DSZ-CC-0879-V4-2020,component_used,None +4b5521f85ab3fff7,BSI-DSZ-CC-1071-V4-2020,recertification,None diff --git a/src/sec_certs/data/reference_annotations/final/train.csv b/src/sec_certs/data/reference_annotations/final/train.csv new file mode 100644 index 00000000..b6b81d30 --- /dev/null +++ b/src/sec_certs/data/reference_annotations/final/train.csv @@ -0,0 +1,101 @@ +dgst,canonical_reference_keyword,label,comment +00efeb17bcaafce6,ANSSI-CC-2009/34,component_used,None +01e8805514b4ef67,BSI-DSZ-CC-0891-V3-2018,component_used,None +037577fc2019fcfa,ANSSI-CC-2021/49,previous_version,None +055985699aee1e09,ANSSI-CC-2010/02,component_used,None +05726637bd47a762,BSI-DSZ-CC-0891-V3-2018,component_used,None +06e505abb8dad1b8,ANSSI-CC-2017/54,component_used,None +0b3e1cdf3ef9413d,BSI-DSZ-CC-0837-V2-2014,component_used,None +0bf7a19b22163465,ANSSI-CC-2015/80,evaluation_reused,None +0bf7a19b22163465,ANSSI-CC-2016/44,evaluation_reused,unclear whether component used +0f3900cdcd0c7f3e,NSCIB-CC-66030-CR5,component_used,None +12e20466a0f08342,ANSSI-CC-2016/79,evaluation_reused,unclear whether component used +13d95239226aa537,BSI-DSZ-CC-0835-V2-2017,component_shared,"BAC, EAC thingy" +16bdbde359584f99,ANSSI-CC-2017/61,component_used,None +17a23970b35a4f44,BSI-DSZ-CC-0782-V5-2020,component_used,None +19c60923e31777e7,ANSSI-CC-2017/49,component_used,None +1b8705a0486b3be1,NSCIB-CC-0209053-CR,previous_version,None +1e40bd733acd56bc,BSI-DSZ-CC-0782-V4-2018,component_used,None +1f9f4b843070fc1b,BSI-DSZ-CC-1105-2020,component_used,None +27d11629261d8806,ANSSI-CC-2014/59,component_used,None +28e70f46ba4394dd,ANSSI-CC-2012/08,component_used,None +2c15dfc106ebf8d8,ANSSI-CC-2012/24,component_used,None +30120e4f3aa2f30a,BSI-DSZ-CC-0897-V2-2014,component_used,None +30f71b100c5cebae,ANSSI-CC-2015/15,component_used,None +317713948b4473b3,BSI-DSZ-CC-0798-2012,component_shared,None +34370b67b5e675c3,ANSSI-CC-2013/47,component_used,None +3515801dee00995f,BSI-DSZ-CC-0447-2008,recertification,This is a re-certification based on BSI-DSZ-CC-0447-2008 +36ed04f4b45e3ab9,BSI-DSZ-CC-0555-2009,component_used,None +371dca18821f7714,BSI-DSZ-CC-0945-2017,component_used,None +3f45ee333ce457bb,BSI-DSZ-CC-1002-2018,recertification,None +42799014c183e1b3,BSI-DSZ-CC-0312-2005,component_used,None +42799014c183e1b3,BSI-DSZ-CC-0429-2007,recertification,None +463ecd64b7506048,ANSSI-CC-2018/52,component_used,None +4a6100f1ddaef93b,BSI-DSZ-CC-0410-2007,component_used,None +4bede5d2af4cb11f,ANSSI-CC-2019/59,evaluation_reused,None +4f5f41ecf7517e63,ANSSI-CC-2016/80,evaluation_reused,None +54273dd266fce692,ANSSI-CC-2015/15,component_used,None +5a66027d34aafc52,BSI-DSZ-CC-1019-V2-2019,component_used,None +5f4b39feb2a82dac,BSI-DSZ-CC-0266-2005,component_used,unclear +61832cb4291c343f,BSI-DSZ-CC-0955-2016,component_used,None +627bfd69c2a831cf,ANSSI-CC-2014/37,evaluation_reused,None +680aeb0a20a9fed3,BSI-DSZ-CC-0870-2014,component_used,None +691119fe8a2f8e1c,BSI-DSZ-CC-0963-2015,component_used,None +6a999675c9422dfb,BSI-DSZ-CC-0353-2006,recertification,This is a re-certification based on BSI-DSZ-CC-0353-2006 +6eb6b29c45f6355f,BSI-DSZ-CC-0782-V4-2018,component_used,None +6f8d7a6a1dea6a3a,ANSSI-CC-2019/28,component_used,None +744a7a202d909323,ANSSI-CC-2017/24,component_used,None +7a8d4ed693d443d7,BSI-DSZ-CC-1128-V3-2021,recertification,None +845bb039719ac5d8,ANSSI-CC-2010/40,previous_version,None +84a75b6fc33b669e,ANSSI-CC-2014/08,evaluation_reused,None +8ba22f6c9651edc3,ANSSI-CC-2013/55,component_used,None +8bdb610131555c12,BSI-DSZ-CC-0645-2010,component_used,None +921e042759b30033,BSI-DSZ-CC-0978-2016,component_used,composition scheme “[COMP]” mentioned +9529eb793550093c,ANSSI-CC-2018/40,previous_version,None +97d00a9f198a6e57,ANSSI-CC-2015/66,component_used,None +a07548a64fac5794,BSI-DSZ-CC-0350-2007,recertification,None +a69ec271f8651d1b,BSI-DSZ-CC-1040-2019,component_used,None +a6fe8fe0aaf2fa92,ANSSI-CC-2018/26,previous_version,None +a76d1c0d9964d583,BSI-DSZ-CC-0417-2008,component_used,None +a867d281d34d34b7,BSI-DSZ-CC-0976-2015,recertification,None +a9d336b90e8b94a2,BSI-DSZ-CC-0410-2007,recertification,None +aa096ffde94b953b,BSI-DSZ-CC-0411-2007,component_used,None +ab3af998dff7a2ef,ANSSI-CC-2017/47,component_used,None +ab3af998dff7a2ef,BSI-DSZ-CC-0973-V2-2016,component_used,None +aea11fd4d2a7709d,BSI-DSZ-CC-0809-V3-2017,component_shared,The further security mechanism Basic Access Control is subject of the separate evaluation process BSI-DSZ-CC-0809-V3-2017 +af61a31e3fd0d6f0,ANSSI-CC-2010/02,evaluation_reused,None +b42009eb34746731,ANSSI-CC-2021/50,previous_version,maybe previous_version +b61363e51ed90c7a,ANSSI-CC-2019/12,component_used,None +bab97726875c0f14,BSI-DSZ-CC-0957-V2-2016,evaluation_reused,"unclear, mentions that this is a “re-evaluation” but not a “re-certification”" +c06d86db280f9b2b,BSI-DSZ-CC-0437-2008,component_used,None +c175537338906951,ANSSI-CC-2016/70,component_shared,None +c32378a010479b33,BSI-DSZ-CC-0891-V2-2016,evaluation_reused,None +c5a60dbdb668bc10,BSI-DSZ-CC-0891-2015,recertification,None +c96343baf608174d,BSI-DSZ-CC-0645-2010,component_used,None +c96343baf608174d,BSI-DSZ-CC-0750-2011,component_used,None +cacdfdafce47678c,ANSSI-CC-2014/59,component_used,None +cfdacd53c732343c,BSI-DSZ-CC-1110-V2-2019,component_used,None +d2a4b8cb9ae7fe8f,BSI-DSZ-CC-1110-V4-2021,component_used,complicated situation where referenced cert is mentioned as recertification of some other cert +d2b0cb5a911b8ef8,BSI-DSZ-CC-0729-2011,recertification,None +d49988efd778ca9d,ANSSI-CC-2010/02,component_used,None +d75282fdda80b6fd,BSI-DSZ-CC-0609-2010,recertification,None +dba4b5a166f9456a,ANSSI-CC-2014/76,recertification,None +df6728b8420ab3b4,BSI-DSZ-CC-0827-V4-2016,component_used,None +e0b122da55f1f002,BSI-DSZ-CC-0961-V2-2018,recertification,None +e676143c80802a59,BSI-DSZ-CC-0891-V4-2019,component_used,the previously certified M7892 G12 component +e6e8add5e4db2d9d,BSI-DSZ-CC-0891-V4-2019,component_used,None +ea6d47427a2bb349,BSI-DSZ-CC-0782-2012,recertification,None +ead1076787fdd7e4,BSI-DSZ-CC-0399-2007,component_used,None +ecba01acba8df2ec,BSI-DSZ-CC-0555-2009,component_used,None +ecba01acba8df2ec,BSI-DSZ-CC-0633-2010,component_used,None +ed22d4c0f09c3e3a,BSI-DSZ-CC-0719-2011,recertification,None +ee1c6dd97918d74a,ANSSI-CC-2012/71,evaluation_reused,None +f17fe9ceea628f62,BSI-DSZ-CC-0750-V2-2014,component_used,None +f17fe9ceea628f62,BSI-DSZ-CC-0911-2014,component_shared,The Basic Access Control mechanism was subject of the evaluation process BSI-DSZ-CC-0911-2014 +f6579adcbf5faa99,BSI-DSZ-CC-1040-2019,component_used,None +f71fca5fc684df8b,BSI-DSZ-CC-0863-2013,recertification,This is a re-certification based on BSI-DSZ-CC-0863-2013 +f869956d14ea1694,ANSSI-CC-2012/68,component_used,None +fb9ec9e846ea4e87,ANSSI-CC-2017/47,component_used,None +b3b7ac7aae87793d,BSI-DSZ-CC-0945-V2-2018,irrelevant,None +c38734a9eeea0ff8,BSI-DSZ-CC-0950-V2-2018,None,"unclear, mentions just ToE delivery" +e0265f0fb8e196c0,BSI-DSZ-CC-0827-V8-2020,irrelevant,unclear diff --git a/src/sec_certs/data/reference_annotations/final/valid.csv b/src/sec_certs/data/reference_annotations/final/valid.csv new file mode 100644 index 00000000..a74d7a45 --- /dev/null +++ b/src/sec_certs/data/reference_annotations/final/valid.csv @@ -0,0 +1,108 @@ +dgst,canonical_reference_keyword,label,comment +a21d17fd2d8b8edc,BSI-DSZ-CC-0813-2012,component_used,None +657f8d0cc39bbcdc,BSI-DSZ-CC-0946-2014,recertification,None +0efe2627f1ce8ac2,BSI-DSZ-CC-0351-2006,component_used,None +983d16512ae92d46,BSI-DSZ-CC-0891-V3-2018,recertification,None +8dd850c81b49a1f9,BSI-DSZ-CC-0697-2011,recertification,None +774cb0f28f7900f9,BSI-DSZ-CC-0232-2004,evaluation_reused,None +c37a9b7ae53093d8,CCEVS-VR-VID10256-2012,None,None +a5adb726852f5cc5,ANSSI-CC-2009/37,component_used,None +4d983357fd464bb5,BSI-DSZ-CC-1107-V2-2021,component_used,None +cc533c087f06ad0d,BSI-DSZ-CC-1040-2019,component_used,None +24de96ea505af909,ANSSI-CC-2021/29,component_used,None +2793414918738c7f,BSI-DSZ-CC-0857-2013,component_used,None +b402cb61be362e5f,BSI-DSZ-CC-0946-V2-2015,recertification,None +d96438a7165e5d82,BSI-DSZ-CC-0410-2007,component_used,None +4b3f577896c80f8a,ANSSI-CC-2015/80,evaluation_reused,None +22388445fe620ac0,ANSSI-CC-2014/20,evaluation_reused,None +2c2244c35d126bfb,BSI-DSZ-CC-0794-2011,recertification,None +6a85bb1d21a35e7d,BSI-DSZ-CC-0227-2004,component_used,None +120a49c0aa284f68,BSI-DSZ-CC-0813-2012,component_used,None +994ac7d986a99e50,BSI-DSZ-CC-0640-2010,component_used,None +16abf8ee0697e64f,ANSSI-CC-2014/61,component_shared,None +f05de4db911ec8af,CRP243,previous_version,None +38f79f1a48e7844f,ANSSI-CC-2017/47,component_used,None +fe55e99f4f3dc195,ANSSI-CC-2013/33,evaluation_reused,None +fc875e0381a28435,BSI-DSZ-CC-0432-2007,recertification,None +c23bb542201aa511,BSI-DSZ-CC-0829-2012,component_used,None +2532fe8c7214c485,BSI-DSZ-CC-0675-2011,component_shared,None +2cbc543a7c7de8b5,BSI-DSZ-CC-0813-2012,component_used,None +833ff87d69cff5db,383-4-184,None,unclear +c7c1215819127a1c,BSI-DSZ-CC-0322-2005,component_used,None +647d17d44745a532,BSI-DSZ-CC-0904-2015,recertification,None +4489bfc781a82281,BSI-DSZ-CC-0817-2013,recertification,None +94fb86d31446e531,BSI-DSZ-CC-0958-2015,component_used,None +37bae9eaf342542b,BSI-DSZ-CC-0349-2006,evaluation_reused,None +5c06e4fb1887fdc7,BSI-DSZ-CC-0782-V2-2015,component_used,None +5bf14a907f9a4c65,BSI-DSZ-CC-0527-2008,recertification,None +d314fa7ee445bd1d,BSI-DSZ-CC-0410-2007,component_used,None +0f53257eb74bee54,BSI-DSZ-CC-0417-2008,component_used,unclear +84d6a370e4f38ddc,ANSSI-CC-2019/12,component_used,None +1a5f86cb1d942c37,BSI-DSZ-CC-1110-2019,recertification,None +d696a9daccdb2a9f,BSI-DSZ-CC-1136-2021,component_used,None +38e7d62918a4f9b6,BSI-DSZ-CC-0688-2013,recertification,None +e6057ffc5085a192,ANSSI-CC-2014/48,evaluation_reused,None +db7627e56b8621b1,BSI-DSZ-CC-0639-2010,component_used,None +4b3f577896c80f8a,ANSSI-CC-2016/44,evaluation_reused,None +5f3c9c6bf76ba72d,ANSSI-CC-2018/51,component_used,None +22d6578b30f5a227,BSI-DSZ-CC-1107-2020,component_used,None +a0c38b4389ad7cf7,ANSSI-CC-2018/12,component_used,None +19c7a1b1a2df87d7,BSI-DSZ-CC-0945-V2-2018,component_used,None +f654c82bca57cf62,BSI-DSZ-CC-0957-V2-2016,None,unclear +2f0be9733140e2c6,BSI-DSZ-CC-0977-V2-2019,component_used,None +3357c28c91cc2ed1,ANSSI-CC-2016/44,evaluation_reused,None +f6317f134f532696,ANSSI-CC-2017/24,previous_version,None +234da54efbcf734b,BSI-DSZ-CC-0917-2014,component_used,None +1b20b1629ba7d3a6,ANSSI-CC-2012/72,component_used,None +2532fe8c7214c485,BSI-DSZ-CC-0633-2010,component_used,None +b1ef468658a9a0c1,NSCIB-CC-0448219-CR,evaluation_reused,None +35482ae218713d54,BSI-DSZ-CC-0951-V3-2018,recertification,None +edb3056f1838e6ae,BSI-DSZ-CC-0348-2006,evaluation_reused,"Quite weird, The evaluation was performed as a re-evaluation process based on BSI-DSZCC-0227-2004, BSI-DSZ-CC-0312-2005 and BSI-DSZ-CC-0348-2006. +Compared to BSI-DSZ-CC-0227-2004 the TOE was re-evaluated because of +technical and yield improvements. Compared to BSI-DSZ-CC-0348-2006 the +TOE was re-evaluated because of changes on top layers for modified module +packaging requirements. Additional package types (MOB4 and complete +passport inlay) and the relevant production sites were included in the evaluation +process. For production sites, results from BSI-DSZ-CC-0312-2005 were reused. The additional production steps do not influence the configuration of the +TOE itself. The Security Target was updated. " +3f2a6d4893c18634,NSCIB-CC-12-36243-CR2,component_used,None +0fe8df0e85116b61,ANSSI-CC-2010/33,previous_version,None +bbc41d7d09e40c0c,BSI-DSZ-CC-0404-2007,recertification,None +b00bb452e7a8176c,ANSSI-CC-2016/57,previous_version,None +7e58bfc14edf68e4,OCSI/CERT/TEC/01/2013/RC,recertification,None +81273108dd167b98,BSI-DSZ-CC-0523-2008,recertification,None +63c1045055ec3b58,BSI-DSZ-CC-0266-2005,component_used,None +a3c99646acb0bb6f,BSI-DSZ-CC-0837-V2-2014,component_used,None +4c017087976d05eb,ANSSI-CC-2020/45,evaluation_reused,None +f4d510a39278e687,ANSSI-CC-2018/32,component_used,None +c23bb542201aa511,ANSSI-CC-2014/14,previous_version,None +625b243397001f01,BSI-DSZ-CC-1059-2018,component_used,None +cae968d4926648bd,BSI-DSZ-CC-0754-2012,recertification,None +000176284683faa2,BSI-DSZ-CC-0640-2010,component_used,None +66faa094a9333d1a,ANSSI-CC-2014/86,evaluation_reused,None +a6dc46792d4e41c8,BSI-DSZ-CC-0203-2003,component_used,None +031667f4e242da61,CCEVS-VR-07-0054,component_used,None +459539da9315ccac,ANSSI-CC-2021/30,previous_version,None +69b15e884cc13c70,BSI-DSZ-CC-0891-V2-2016,component_used,None +a4bbf07046109fc9,BSI-DSZ-CC-0935-2015,component_used,None +50aef770cb4f028f,BSI-DSZ-CC-1059-V3-2019,component_used,None +5cf51622fafaf868,BSI-DSZ-CC-1005-2016,recertification,None +1e23ae421d7a2d01,BSI-DSZ-CC-0633-V2-2014,component_used,None +0c7ef6c32cbdee47,ANSSI-CC-2017/61,component_used,None +8928e191ee2fd3b9,BSI-DSZ-CC-0523-2008,component_used,None +6ed3cd21c6a2c9d0,BSI-DSZ-CC-1107-2020,component_used,None +4962c0d8106b8b5e,ANSSI-CC-2015/37,evaluation_reused,None +e6057ffc5085a192,BSI-DSZ-CC-0829-2012,component_used,None +03fad65e5af65088,BSI-DSZ-CC-0696-2011,recertification,None +720aab4f782f4c60,BSI-DSZ-CC-0555-2009,component_used,None +9664c0f0ec6401b9,BSI-DSZ-CC-0891-V2-2016,recertification,None +d55eb8c97d71e843,ANSSI-CC-2021/49,previous_version,None +73e0b884cd04d9bc,NSCIB-CC-12-36243,component_used,None +2793414918738c7f,BSI-DSZ-CC-0633-V2-2014,component_used,None +f6a89befd13a643f,BSI-DSZ-CC-0951-V4-2019,component_used,None +f00a01940be6481d,BSI-DSZ-CC-0837-V2-2014,component_used,None +2f43fe24bd8e91e1,ANSSI-CC-2020/65,component_used,None +d96438a7165e5d82,BSI-DSZ-CC-0411-2007,component_used,None +7623950728f52a71,ANSSI-CC-2016/06,component_used,None +ba69597434946260,BSI-DSZ-CC-0293-2005,component_used,None +50aef770cb4f028f,BSI-DSZ-CC-1059-2018,component_used,None diff --git a/src/sec_certs/data/reference_annotations/jano/test.csv b/src/sec_certs/data/reference_annotations/jano/test.csv new file mode 100644 index 00000000..b241171b --- /dev/null +++ b/src/sec_certs/data/reference_annotations/jano/test.csv @@ -0,0 +1,201 @@ +dgst,canonical_reference_keyword,label,comment +15ae64b85b3e28d7,BSI-DSZ-CC-0394-2006,recertification,None +15b121492722bffb,BSI-DSZ-CC-0754-2012,recertification,None +16513a1bff79b46a,BSI-DSZ-CC-1044-V2-2019,recertification,evaluation_reused more like +16b0a0811bc4fe82,BSI-DSZ-CC-0169-2002,component_used,None +16b24ff1bf3c079b,ANSSI-CC-2012/22,component_used,None +173097995b7a7f12,ANSSI-CC-2012/49,evaluation_reused,None +173097995b7a7f12,ANSSI-CC-2013/28,component_used,None +173704f0d2b8a02f,ANSSI-CC-2018/08,component_used,None +173704f0d2b8a02f,ANSSI-CC-2018/19,component_used,None +177dee4c1051e612,BSI-DSZ-CC-0854-2013,recertification,None +17bfc3d0570ab3d0,ANSSI-CC-2016/09,component_used,None +183a5cd3e2aaa0ec,ANSSI-CC-2017/76,component_used,None +183a5cd3e2aaa0ec,BSI-DSZ-CC-0891-V2-2016,component_used,None +18a515a0fff0c0c3,BSI-DSZ-CC-0957-V2-2016,component_used,None +18b7e5bdf459ca13,NSCIB-CC-07-09219,previous_version,also evaluation_reused +195366bfba7213a5,BSI-DSZ-CC-0266-2005,None,None +195366bfba7213a5,BSI-DSZ-CC-0322-2005,None,None +195366bfba7213a5,BSI-DSZ-CC-0399-2007,None,None +1999d4ed82b3188e,BSI-DSZ-CC-0451-2007,None,None +19d3185c40be008d,ANSSI-CC-2016/65,evaluation_reused,None +1ac8de53c0894d18,BSI-DSZ-CC-0814-2012,recertification,None +1b2764a62ffe86a2,BSI-DSZ-CC-0978-2016,component_used,None +1bcfaefe46abccf0,BSI-DSZ-CC-0917-2014,component_used,None +1c8567a1b1a6c12a,BSI-DSZ-CC-1040-2019,component_used,None +1cc05dbb992431b9,ANSSI-CC-2021/29,component_used,None +1d1df0fb541e49b8,BSI-DSZ-CC-1020-V2-2017,recertification,None +1d9ae732c5dec242,ANSSI-CC-2009/37,component_used,also previous version to a degree +1ea31bb5f6a15995,BSI-DSZ-CC-0808-V3-2017,component_shared,None +1ea31bb5f6a15995,BSI-DSZ-CC-0809-V2-2016,recertification,None +1ea31bb5f6a15995,BSI-DSZ-CC-0978-V2-2017,component_used,None +1ff08f79cb89c1de,BSI-DSZ-CC-0939-2015,recertification,None +2078424be58e4db1,OCSI/CERT/SYS/08/2017/RC,recertification,None +21951e191e55b66e,BSI-DSZ-CC-0782-2012,component_used,None +21cffadbbb87c205,BSI-DSZ-CC-0348-2006,component_used,None +22ede463dbf1a105,ANSSI-CC-2015/36,component_used,None +22ede463dbf1a105,ANSSI-CC-2015/80,irrelevant,mistake in report +22ede463dbf1a105,ANSSI-CC-2016/43,evaluation_reused,None +22ede463dbf1a105,ANSSI-CC-2016/44,evaluation_reused,None +23a85a7f9c07412f,ANSSI-CC-2014/46,evaluation_reused,component_used probably +23a85a7f9c07412f,ANSSI-CC-2016/33,evaluation_reused,component_used probably +24624a4e60ddedd4,BSI-DSZ-CC-0868-2014,previous_version,None +24624a4e60ddedd4,BSI-DSZ-CC-0951-2015,component_used,None +259df98e7476a843,BSI-DSZ-CC-0666-2012,recertification,None +259e0ab1c4b690cf,ANSSI-CC-2012/70,component_used,None +25c07c5d0a05d86c,ANSSI-CC-2015/08,component_shared,None +25c07c5d0a05d86c,ANSSI-CC-2015/15,component_used,None +26c4912b140fde9f,BSI-DSZ-CC-0891-V2-2016,component_used,None +26c7b173668167d8,BSI-DSZ-CC-0813-2012,component_used,None +2760aeedce0b79db,ANSSI-CC-2011/64,evaluation_reused,None +2760aeedce0b79db,BSI-DSZ-CC-0555-2009,component_used,None +27ccec0740bb7915,ANSSI-CC-2010/02,component_used,None +27ccec0740bb7915,ANSSI-CC-2010/20,evaluation_reused,None +27ccec0740bb7915,ANSSI-CC-2010/35,component_shared,None +296618f10b019d9c,BSI-DSZ-CC-0417-2008,component_used,None +29cc495628e76ffa,BSI-DSZ-CC-0845-2012,component_used,None +29f2dd90f57ea948,BSI-DSZ-CC-0837-V2-2014,component_used,None +29fb07d8f74e734b,BSI-DSZ-CC-0303-2006,recertification,None +2a07b85f61ac08b0,ANSSI-CC-2019/59,evaluation_reused,None +2a91f42389fda90d,BSI-DSZ-CC-0782-V2-2015,component_used,None +2adb03f5294c31c2,BSI-DSZ-CC-0608-2010,recertification,None +2b0342d5b70b7a78,ANSSI-CC-2010/03,component_used,None +2bd9661657e78278,ANSSI-CC-2012/39,previous_version,None +2bd9661657e78278,ANSSI-CC-2013/13,component_used,None +2be10f342e68a89e,BSI-DSZ-CC-0963-V2-2017,recertification,None +2c41f9dfcd5014e6,BSI-DSZ-CC-0973-2016,recertification,None +2d046178aa118fff,BSI-DSZ-CC-0293-2005,recertification,None +2d0b4100c3ead88a,BSI-DSZ-CC-0945-V2-2018,component_used,None +2eee0fdd5cdaf565,ANSSI-CC-2017/07,component_used,None +2eee0fdd5cdaf565,BSI-DSZ-CC-0891-V2-2016,component_used,None +2f9feaf4121720da,BSI-DSZ-CC-0547-2009,evaluation_reused,maybe recertification? +30e9ce0969941ffb,BSI-DSZ-CC-0782-V2-2015,component_used,None +3183669bf78db43b,ANSSI-CC-2015/45,component_used,None +3183669bf78db43b,ANSSI-CC-2016/64,component_used,None +3183669bf78db43b,BSI-DSZ-CC-0782-V2-2015,component_used,None +31fd07069aebf013,BSI-DSZ-CC-0466-2008,component_used,None +328fee1e52f7ac82,BSI-DSZ-CC-0410-2007,component_used,None +328fee1e52f7ac82,BSI-DSZ-CC-0680-2010,component_used,None +3334d22b6559d0e2,BSI-DSZ-CC-0944-2014,recertification,None +3334d22b6559d0e2,BSI-DSZ-CC-0963-V2-2017,component_used,None +337ece90615ed69d,ANSSI-CC-2010/02,component_used,None +3392558f04e04663,BSI-DSZ-CC-0782-V2-2015,component_used,None +33cada8c95bf55c5,BSI-DSZ-CC-0879-V3-2018,component_used,None +33cada8c95bf55c5,BSI-DSZ-CC-1028-2017,recertification,None +34506b8fab6dd7c3,ANSSI-CC-2014/22,previous_version,None +34ed76f0c32d9e93,ANSSI-CC-2012/49,evaluation_reused,None +34ed76f0c32d9e93,ANSSI-CC-2013/18,component_used,None +3519c14e4114d93d,BSI-DSZ-CC-0782-2012,component_used,None +35b9be2203d2b9e6,ANSSI-CC-2012/70,component_used,None +35efe13fa9e93a68,CRP178,component_used,None +35efe13fa9e93a68,CRP182,component_used,None +36641ce7192b5f92,BSI-DSZ-CC-0977-2017,component_used,None +054bd8196e015197,ANSSI-CC-2011/07,evaluation_reused,None +122245dd15683e26,BSI-DSZ-CC-0269-2006,None,None +25c07c5d0a05d86c,BSI-DSZ-CC-0845-2012,None,None +25c07c5d0a05d86c,BSI-DSZ-CC-0845-V2-2013,evaluation_reused,None +29cc495628e76ffa,BSI-DSZ-CC-0886-2013,component_shared,None +2a07b85f61ac08b0,ANSSI-CC-2019/02,component_used,None +30c6777901ae346c,BSI-DSZ-CC-0438-2007,component_used,None +35b9be2203d2b9e6,BSI-DSZ-CC-0895-2014,component_shared,None +36df04ab9c978ab9,BSI-DSZ-CC-0624-2010,component_used,None +373e7b1bc9066563,BSI-DSZ-CC-1110-V2-2019,component_used,None +3746512864b941d4,ANSSI-CC-2016/15,previous_version,None +37b94c08f8e25249,BSI-DSZ-CC-0404-2007,None,None +37b94c08f8e25249,BSI-DSZ-CC-0410-2007,None,None +37b94c08f8e25249,BSI-DSZ-CC-0555-2009,None,None +37b94c08f8e25249,BSI-DSZ-CC-0633-2010,None,None +37b94c08f8e25249,BSI-DSZ-CC-0674-2011,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0675-2011,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0709-2010,None,None +37b94c08f8e25249,BSI-DSZ-CC-0710-2010,None,None +37b94c08f8e25249,BSI-DSZ-CC-0730-2011,component_used,None +37b94c08f8e25249,BSI-DSZ-CC-0797-2012,component_shared,None +37b94c08f8e25249,BSI-DSZ-CC-0799-2012,None,missing BSI-DSZ-CC-0804-2012 +37c8d23c44b95833,ANSSI-CC-2017/16,previous_version,None +37d28734245a3bb1,BSI-DSZ-CC-0257-2004,previous_version,missing some CRP ids +37e0d3cb098458d0,ANSSI-CC-2014/50,component_used,None +37e0d3cb098458d0,BSI-DSZ-CC-0999-2016,component_used,None +37fe6036c2ac932b,ANSSI-CC-2014/06,component_used,None +37fe6036c2ac932b,ANSSI-CC-2014/07,previous_version,None +37fe6036c2ac932b,BSI-DSZ-CC-0829-2012,component_used,None +3817c0aca007989e,ANSSI-CC-2011/10,component_used,None +3817c0aca007989e,ANSSI-CC-2011/12,previous_version,None +3817c0aca007989e,BSI-DSZ-CC-0523-2008,component_used,None +3817c0aca007989e,BSI-DSZ-CC-0626-2009,component_used,None +384dca297bd4f1ca,BSI-DSZ-CC-0837-V2-2014,component_used,None +384dca297bd4f1ca,BSI-DSZ-CC-0978-2016,component_used,None +3976c9e492193315,BSI-DSZ-CC-1113-2021,recertification,None +39c07ebbca541145,BSI-DSZ-CC-0917-2014,component_used,None +3a3b0a9113835307,BSI-DSZ-CC-0402-2008,recertification,None +3a3b0a9113835307,BSI-DSZ-CC-0468-2007,component_used,None +3a3b0a9113835307,CCEVS-VR-07-0054,component_used,None +3a3b0a9113835307,CCEVS-VR-VID10271-2007,component_used,None +3a6a5f536bfbd4d4,ANSSI-CC-2009/59,previous_version,None +3ba9f330ce93636b,BSI-DSZ-CC-0640-2010,component_used,None +3ba9f330ce93636b,BSI-DSZ-CC-0677-2010,evaluation_reused,None +3d149fe7c08bfc58,CRP256,previous_version,None +3d756c83419bba28,ANSSI-CC-2011/07,component_used,None +3d756c83419bba28,ANSSI-CC-2011/77,previous_version,None +3d8083b1e6c7b336,BSI-DSZ-CC-1136-V2-2022,component_used,None +3d8083b1e6c7b336,BSI-DSZ-CC-1136-V3-2022,component_used,None +3e08a27e9d9c9b1e,BSI-DSZ-CC-0973-2016,component_used,None +3e08a27e9d9c9b1e,NSCIB-CC-16-99111,previous_version,"but also an issue of cert ID assignment, we need to better canonicalize these “V2” and -CR things" +3e182053b03f1faf,CCEVS-VR-06-0044,irrelevant,None +3e345d3c6002ad55,BSI-DSZ-CC-0915-2016,component_used,None +3ea02a62856c752a,ANSSI-CC-2012/70,component_used,None +3ea02a62856c752a,ANSSI-CC-2012/72,component_used,None +3ea02a62856c752a,BSI-DSZ-CC-0719-2011,component_used,None +3f188bbf2af01b25,OCSI/CERT/IMQ/07/2017/RC,recertification,None +3f22bd3eaef5d64d,BSI-DSZ-CC-0957-2015,recertification,None +3f22bd3eaef5d64d,BSI-DSZ-CC-0978-2016,component_used,None +3f4b6e4f245f6fab,ANSSI-CC-2017/49,component_used,None +3f8475de6ea558ac,BSI-DSZ-CC-0427-2007,recertification,None +3feda0b8b5637540,BSI-DSZ-CC-1059-V4-2021,component_used,None +3feda0b8b5637540,NSCIB-CC-67206-CR5,component_used,None +4057f5dbe4ffa4cd,ANSSI-CC-2017/57,previous_version,None +40f62cd468a546cc,OCSI/CERT/ATS/05/2020/RC,recertification,None +40fa0a4cb5193977,ANSSI-CC-2018/27,previous_version,None +40fa0a4cb5193977,BSI-DSZ-CC-0879-V3-2018,component_used,None +40fc6ad0aed92913,ANSSI-CC-2017/54,component_used,None +40fc6ad0aed92913,BSI-DSZ-CC-0891-V2-2016,component_used,None +41bd2924e9afced5,ANSSI-CC-2010/49,previous_version,None +41bd2924e9afced5,ANSSI-CC-2010/50,previous_version,None +420876ec1e5ba657,ANSSI-CC-2012/30,component_used,None +424f6d496746258b,ANSSI-CC-2019/12,component_used,None +424f6d496746258b,BSI-DSZ-CC-0995-2018,recertification,None +4285d9b580f8a2a6,ANSSI-CC-2013/59,component_used,None +42bc15eb26cf2eec,BSI-DSZ-CC-0829-2012,component_used,None +42d2e68c29d9eef7,ANSSI-CC-2018/30,previous_version,None +42f53e51476f1a3c,ANSSI-CC-2011/07,previous_version,None +438b59086f6ebd64,BSI-DSZ-CC-1107-2020,component_used,None +43a4ca62d0c0b0da,ANSSI-CC-2017/63,evaluation_reused,None +43a4ca62d0c0b0da,ANSSI-CC-2017/64,irrelevant,"/63 or /64, unsure" +43a4ca62d0c0b0da,BSI-DSZ-CC-1059-V3-2019,component_used,None +43d9cb9d3fe30ff2,BSI-DSZ-CC-0555-2009,component_used,None +43d9cb9d3fe30ff2,BSI-DSZ-CC-0857-2013,component_used,None +449c74a92ebb61a4,ANSSI-CC-2017/24,component_used,None +44becd7e128f4ba0,BSI-DSZ-CC-0410-2007,component_used,None +45098872448f5816,NSCIB-CC-0441513-CR,component_used,None +46459cfb9c1045d8,ANSSI-CC-2018/27,component_used,None +46459cfb9c1045d8,BSI-DSZ-CC-0782-V4-2018,component_used,None +4750f5114dcaa60d,BSI-DSZ-CC-0891-V4-2019,irrelevant,BSI-DSZ-CC-0891-V4-2018 mentioned in report +47913a485c3c8a18,ANSSI-CC-2019/28,component_used,None +4832a44c0df0bad2,ANSSI-CC-2019/12,component_used,None +4832a44c0df0bad2,BSI-DSZ-CC-1074-2019,recertification,None +4893140ae5daadaf,BSI-DSZ-CC-0782-2012,component_used,None +4893140ae5daadaf,CRP278,component_shared,None +48a41f3f5110db1f,BSI-DSZ-CC-0350-2007,recertification,None +48d897f17754c7ce,BSI-DSZ-CC-0978-2016,component_used,None +48fd3d84b1a0bc68,BSI-DSZ-CC-0348-2006,component_used,None +491c766e35ae9f6e,BSI-DSZ-CC-0879-V4-2020,component_used,None +491c766e35ae9f6e,BSI-DSZ-CC-1071-V3-2020,recertification,None +49e6665ee56d3bfc,ANSSI-CC-2015/45,component_used,None +49e6665ee56d3bfc,ANSSI-CC-2016/64,component_used,None +49e6665ee56d3bfc,BSI-DSZ-CC-0782-V2-2015,component_used,None +4abc83fee59586b2,ANSSI-CC-2020/07,component_used,None +4abc83fee59586b2,BSI-DSZ-CC-1110-V3-2020,component_used,None +4abc83fee59586b2,NSCIB-CC-200270-CR,previous_version,None +4b2f963b48e0f954,ANSSI-CC-2010/11,component_used,None +4b5521f85ab3fff7,BSI-DSZ-CC-0879-V4-2020,component_used,None +4b5521f85ab3fff7,BSI-DSZ-CC-1071-V4-2020,recertification,None diff --git a/src/sec_certs/data/reference_annotations/jano/train.csv b/src/sec_certs/data/reference_annotations/jano/train.csv new file mode 100644 index 00000000..18dce096 --- /dev/null +++ b/src/sec_certs/data/reference_annotations/jano/train.csv @@ -0,0 +1,101 @@ +dgst,canonical_reference_keyword,label,comment +e676143c80802a59,BSI-DSZ-CC-0891-V4-2019,component_used,the previously certified M7892 G12 component +0bf7a19b22163465,ANSSI-CC-2016/44,evaluation_reused,unclear whether component used +ab3af998dff7a2ef,ANSSI-CC-2017/47,component_used,None +8ba22f6c9651edc3,ANSSI-CC-2013/55,component_used,None +680aeb0a20a9fed3,BSI-DSZ-CC-0870-2014,component_used,None +3515801dee00995f,BSI-DSZ-CC-0447-2008,recertification,This is a re-certification based on BSI-DSZ-CC-0447-2008 +6a999675c9422dfb,BSI-DSZ-CC-0353-2006,recertification,This is a re-certification based on BSI-DSZ-CC-0353-2006 +12e20466a0f08342,ANSSI-CC-2016/79,evaluation_reused,unclear whether component used +d2a4b8cb9ae7fe8f,BSI-DSZ-CC-1110-V4-2021,component_used,complicated situation where referenced cert is mentioned as recertification of some other cert +921e042759b30033,BSI-DSZ-CC-0978-2016,component_used,composition scheme “[COMP]” mentioned +00efeb17bcaafce6,ANSSI-CC-2009/34,component_used,None +c175537338906951,ANSSI-CC-2016/70,component_used,None +fb9ec9e846ea4e87,ANSSI-CC-2017/47,component_used,None +ecba01acba8df2ec,BSI-DSZ-CC-0555-2009,component_used,None +f71fca5fc684df8b,BSI-DSZ-CC-0863-2013,recertification,This is a re-certification based on BSI-DSZ-CC-0863-2013 +cacdfdafce47678c,ANSSI-CC-2014/59,component_used,None +dba4b5a166f9456a,ANSSI-CC-2014/76,previous_version,None +aa096ffde94b953b,BSI-DSZ-CC-0411-2007,component_used,None +b42009eb34746731,ANSSI-CC-2021/50,evaluation_reused,maybe previous_version +463ecd64b7506048,ANSSI-CC-2018/52,component_used,None +c5a60dbdb668bc10,BSI-DSZ-CC-0891-2015,recertification,None +c96343baf608174d,BSI-DSZ-CC-0645-2010,component_used,None +0b3e1cdf3ef9413d,BSI-DSZ-CC-0837-V2-2014,component_used,None +2c15dfc106ebf8d8,ANSSI-CC-2012/24,component_used,None +e0265f0fb8e196c0,BSI-DSZ-CC-0827-V8-2020,None,unclear +ee1c6dd97918d74a,ANSSI-CC-2012/71,evaluation_reused,None +e6e8add5e4db2d9d,BSI-DSZ-CC-0891-V4-2019,component_used,None +845bb039719ac5d8,ANSSI-CC-2010/40,previous_version,None +af61a31e3fd0d6f0,ANSSI-CC-2010/02,evaluation_reused,None +d49988efd778ca9d,ANSSI-CC-2010/02,component_used,None +54273dd266fce692,ANSSI-CC-2015/15,component_used,None +4bede5d2af4cb11f,ANSSI-CC-2019/59,evaluation_reused,None +d75282fdda80b6fd,BSI-DSZ-CC-0609-2010,recertification,None +a69ec271f8651d1b,BSI-DSZ-CC-1040-2019,component_used,None +f6579adcbf5faa99,BSI-DSZ-CC-1040-2019,component_used,None +8bdb610131555c12,BSI-DSZ-CC-0645-2010,component_used,None +b3b7ac7aae87793d,BSI-DSZ-CC-0945-V2-2018,None,unclear +371dca18821f7714,BSI-DSZ-CC-0945-2017,component_used,None +f17fe9ceea628f62,BSI-DSZ-CC-0911-2014,component_shared,The Basic Access Control mechanism was subject of the evaluation process BSI-DSZ-CC-0911-2014 +e0b122da55f1f002,BSI-DSZ-CC-0961-V2-2018,recertification,None +4f5f41ecf7517e63,ANSSI-CC-2016/80,evaluation_reused,None +a867d281d34d34b7,BSI-DSZ-CC-0976-2015,recertification,None +16bdbde359584f99,ANSSI-CC-2017/61,component_used,None +34370b67b5e675c3,ANSSI-CC-2013/47,component_used,None +a6fe8fe0aaf2fa92,ANSSI-CC-2018/26,previous_version,None +0bf7a19b22163465,ANSSI-CC-2015/80,evaluation_reused,None +1e40bd733acd56bc,BSI-DSZ-CC-0782-V4-2018,component_used,None +13d95239226aa537,BSI-DSZ-CC-0835-V2-2017,component_shared,"BAC, EAC thingy" +f869956d14ea1694,ANSSI-CC-2012/68,component_used,None +037577fc2019fcfa,ANSSI-CC-2021/49,evaluation_reused,None +17a23970b35a4f44,BSI-DSZ-CC-0782-V5-2020,component_used,None +5a66027d34aafc52,BSI-DSZ-CC-1019-V2-2019,component_used,None +1f9f4b843070fc1b,BSI-DSZ-CC-1105-2020,component_used,None +28e70f46ba4394dd,ANSSI-CC-2012/08,component_used,None +61832cb4291c343f,BSI-DSZ-CC-0955-2016,component_used,None +42799014c183e1b3,BSI-DSZ-CC-0312-2005,component_used,None +627bfd69c2a831cf,ANSSI-CC-2014/37,evaluation_reused,None +aea11fd4d2a7709d,BSI-DSZ-CC-0809-V3-2017,component_shared,The further security mechanism Basic Access Control is subject of the separate evaluation process BSI-DSZ-CC-0809-V3-2017 +05726637bd47a762,BSI-DSZ-CC-0891-V3-2018,component_used,None +9529eb793550093c,ANSSI-CC-2018/40,evaluation_reused,None +7a8d4ed693d443d7,BSI-DSZ-CC-1128-V3-2021,recertification,None +ed22d4c0f09c3e3a,BSI-DSZ-CC-0719-2011,recertification,None +ea6d47427a2bb349,BSI-DSZ-CC-0782-2012,recertification,None +ead1076787fdd7e4,BSI-DSZ-CC-0399-2007,component_used,None +30f71b100c5cebae,ANSSI-CC-2015/15,component_used,None +6eb6b29c45f6355f,BSI-DSZ-CC-0782-V4-2018,component_used,None +06e505abb8dad1b8,ANSSI-CC-2017/54,component_used,None +317713948b4473b3,BSI-DSZ-CC-0798-2012,component_shared,None +055985699aee1e09,ANSSI-CC-2010/02,component_used,None +b61363e51ed90c7a,ANSSI-CC-2019/12,component_used,None +691119fe8a2f8e1c,BSI-DSZ-CC-0963-2015,component_used,None +a07548a64fac5794,BSI-DSZ-CC-0350-2007,recertification,None +19c60923e31777e7,ANSSI-CC-2017/49,component_used,None +f17fe9ceea628f62,BSI-DSZ-CC-0750-V2-2014,component_used,None +c96343baf608174d,BSI-DSZ-CC-0750-2011,component_used,None +42799014c183e1b3,BSI-DSZ-CC-0429-2007,recertification,None +3f45ee333ce457bb,BSI-DSZ-CC-1002-2018,recertification,None +5f4b39feb2a82dac,BSI-DSZ-CC-0266-2005,component_used,unclear +4a6100f1ddaef93b,BSI-DSZ-CC-0410-2007,component_used,None +c06d86db280f9b2b,BSI-DSZ-CC-0437-2008,component_used,None +ab3af998dff7a2ef,BSI-DSZ-CC-0973-V2-2016,component_used,None +30120e4f3aa2f30a,BSI-DSZ-CC-0897-V2-2014,component_used,None +c32378a010479b33,BSI-DSZ-CC-0891-V2-2016,evaluation_reused,None +ecba01acba8df2ec,BSI-DSZ-CC-0633-2010,component_used,None +bab97726875c0f14,BSI-DSZ-CC-0957-V2-2016,None,"unclear, mentions that this is a “re-evaluation” but not a “re-certification”" +97d00a9f198a6e57,ANSSI-CC-2015/66,component_used,None +744a7a202d909323,ANSSI-CC-2017/24,component_used,None +df6728b8420ab3b4,BSI-DSZ-CC-0827-V4-2016,component_used,None +6f8d7a6a1dea6a3a,ANSSI-CC-2019/28,component_used,None +1b8705a0486b3be1,NSCIB-CC-0209053-CR,evaluation_reused,None +a9d336b90e8b94a2,BSI-DSZ-CC-0410-2007,recertification,None +cfdacd53c732343c,BSI-DSZ-CC-1110-V2-2019,component_used,None +27d11629261d8806,ANSSI-CC-2014/59,component_used,None +a76d1c0d9964d583,BSI-DSZ-CC-0417-2008,evaluation_reused,None +d2b0cb5a911b8ef8,BSI-DSZ-CC-0729-2011,recertification,None +c38734a9eeea0ff8,BSI-DSZ-CC-0950-V2-2018,None,"unclear, mentions just ToE delivery" +84a75b6fc33b669e,ANSSI-CC-2014/08,evaluation_reused,None +36ed04f4b45e3ab9,BSI-DSZ-CC-0555-2009,component_used,None +01e8805514b4ef67,BSI-DSZ-CC-0891-V3-2018,component_used,None +0f3900cdcd0c7f3e,NSCIB-CC-66030-CR5,component_used,None diff --git a/src/sec_certs/data/reference_annotations/jano/valid.csv b/src/sec_certs/data/reference_annotations/jano/valid.csv new file mode 100644 index 00000000..a55055f6 --- /dev/null +++ b/src/sec_certs/data/reference_annotations/jano/valid.csv @@ -0,0 +1,108 @@ +dgst,canonical_reference_keyword,label,comment +a21d17fd2d8b8edc,BSI-DSZ-CC-0813-2012,component_used,None +657f8d0cc39bbcdc,BSI-DSZ-CC-0946-2014,recertification,None +0efe2627f1ce8ac2,BSI-DSZ-CC-0351-2006,component_used,None +983d16512ae92d46,BSI-DSZ-CC-0891-V3-2018,recertification,None +8dd850c81b49a1f9,BSI-DSZ-CC-0697-2011,recertification,None +774cb0f28f7900f9,BSI-DSZ-CC-0232-2004,component_used,None +c37a9b7ae53093d8,CCEVS-VR-VID10256-2012,component_shared,None +a5adb726852f5cc5,ANSSI-CC-2009/37,component_used,None +4d983357fd464bb5,BSI-DSZ-CC-1107-V2-2021,component_used,None +cc533c087f06ad0d,BSI-DSZ-CC-1040-2019,component_used,None +24de96ea505af909,ANSSI-CC-2021/29,component_used,None +2793414918738c7f,BSI-DSZ-CC-0857-2013,component_used,None +b402cb61be362e5f,BSI-DSZ-CC-0946-V2-2015,recertification,None +d96438a7165e5d82,BSI-DSZ-CC-0410-2007,component_used,None +4b3f577896c80f8a,ANSSI-CC-2015/80,component_used,None +22388445fe620ac0,ANSSI-CC-2014/20,evaluation_reused,None +2c2244c35d126bfb,BSI-DSZ-CC-0794-2011,recertification,None +6a85bb1d21a35e7d,BSI-DSZ-CC-0227-2004,component_used,None +120a49c0aa284f68,BSI-DSZ-CC-0813-2012,component_used,None +994ac7d986a99e50,BSI-DSZ-CC-0640-2010,component_used,None +16abf8ee0697e64f,ANSSI-CC-2014/61,evaluation_reused,None +f05de4db911ec8af,CRP243,component_used,None +38f79f1a48e7844f,ANSSI-CC-2017/47,component_used,None +fe55e99f4f3dc195,ANSSI-CC-2013/33,evaluation_reused,None +fc875e0381a28435,BSI-DSZ-CC-0432-2007,recertification,None +c23bb542201aa511,BSI-DSZ-CC-0829-2012,component_used,None +2532fe8c7214c485,BSI-DSZ-CC-0675-2011,component_used,None +2cbc543a7c7de8b5,BSI-DSZ-CC-0813-2012,component_used,None +833ff87d69cff5db,383-4-184,None,unclear +c7c1215819127a1c,BSI-DSZ-CC-0322-2005,component_used,None +647d17d44745a532,BSI-DSZ-CC-0904-2015,recertification,None +4489bfc781a82281,BSI-DSZ-CC-0817-2013,recertification,None +94fb86d31446e531,BSI-DSZ-CC-0958-2015,component_used,None +37bae9eaf342542b,BSI-DSZ-CC-0349-2006,evaluation_reused,None +5c06e4fb1887fdc7,BSI-DSZ-CC-0782-V2-2015,component_used,None +5bf14a907f9a4c65,BSI-DSZ-CC-0527-2008,recertification,None +d314fa7ee445bd1d,BSI-DSZ-CC-0410-2007,component_used,None +0f53257eb74bee54,BSI-DSZ-CC-0417-2008,None,unclear +84d6a370e4f38ddc,ANSSI-CC-2019/12,component_used,None +1a5f86cb1d942c37,BSI-DSZ-CC-1110-2019,recertification,None +d696a9daccdb2a9f,BSI-DSZ-CC-1136-2021,component_used,None +38e7d62918a4f9b6,BSI-DSZ-CC-0688-2013,recertification,None +e6057ffc5085a192,ANSSI-CC-2014/48,evaluation_reused,None +db7627e56b8621b1,BSI-DSZ-CC-0639-2010,component_used,None +4b3f577896c80f8a,ANSSI-CC-2016/44,component_used,None +5f3c9c6bf76ba72d,ANSSI-CC-2018/51,component_used,None +22d6578b30f5a227,BSI-DSZ-CC-1107-2020,component_used,None +a0c38b4389ad7cf7,ANSSI-CC-2018/12,component_used,None +19c7a1b1a2df87d7,BSI-DSZ-CC-0945-V2-2018,component_used,None +f654c82bca57cf62,BSI-DSZ-CC-0957-V2-2016,None,unclear +2f0be9733140e2c6,BSI-DSZ-CC-0977-V2-2019,component_used,None +3357c28c91cc2ed1,ANSSI-CC-2016/44,component_used,None +f6317f134f532696,ANSSI-CC-2017/24,evaluation_reused,None +234da54efbcf734b,BSI-DSZ-CC-0917-2014,component_used,None +1b20b1629ba7d3a6,ANSSI-CC-2012/72,component_used,None +2532fe8c7214c485,BSI-DSZ-CC-0633-2010,component_used,None +b1ef468658a9a0c1,NSCIB-CC-0448219-CR,evaluation_reused,None +35482ae218713d54,BSI-DSZ-CC-0951-V3-2018,recertification,None +edb3056f1838e6ae,BSI-DSZ-CC-0348-2006,evaluation_reused,"Quite weird, The evaluation was performed as a re-evaluation process based on BSI-DSZCC-0227-2004, BSI-DSZ-CC-0312-2005 and BSI-DSZ-CC-0348-2006. +Compared to BSI-DSZ-CC-0227-2004 the TOE was re-evaluated because of +technical and yield improvements. Compared to BSI-DSZ-CC-0348-2006 the +TOE was re-evaluated because of changes on top layers for modified module +packaging requirements. Additional package types (MOB4 and complete +passport inlay) and the relevant production sites were included in the evaluation +process. For production sites, results from BSI-DSZ-CC-0312-2005 were reused. The additional production steps do not influence the configuration of the +TOE itself. The Security Target was updated. " +3f2a6d4893c18634,NSCIB-CC-12-36243-CR2,component_used,None +0fe8df0e85116b61,ANSSI-CC-2010/33,evaluation_reused,None +bbc41d7d09e40c0c,BSI-DSZ-CC-0404-2007,recertification,None +b00bb452e7a8176c,ANSSI-CC-2016/57,evaluation_reused,None +7e58bfc14edf68e4,OCSI/CERT/TEC/01/2013/RC,previous_version,None +81273108dd167b98,BSI-DSZ-CC-0523-2008,recertification,None +63c1045055ec3b58,BSI-DSZ-CC-0266-2005,component_used,None +a3c99646acb0bb6f,BSI-DSZ-CC-0837-V2-2014,component_used,None +4c017087976d05eb,ANSSI-CC-2020/45,evaluation_reused,None +f4d510a39278e687,ANSSI-CC-2018/32,component_used,None +c23bb542201aa511,ANSSI-CC-2014/14,component_used,None +625b243397001f01,BSI-DSZ-CC-1059-2018,component_used,None +cae968d4926648bd,BSI-DSZ-CC-0754-2012,recertification,None +000176284683faa2,BSI-DSZ-CC-0640-2010,component_used,None +66faa094a9333d1a,ANSSI-CC-2014/86,evaluation_reused,None +a6dc46792d4e41c8,BSI-DSZ-CC-0203-2003,component_used,None +031667f4e242da61,CCEVS-VR-07-0054,component_used,None +459539da9315ccac,ANSSI-CC-2021/30,previous_version,None +69b15e884cc13c70,BSI-DSZ-CC-0891-V2-2016,component_used,None +a4bbf07046109fc9,BSI-DSZ-CC-0935-2015,component_used,None +50aef770cb4f028f,BSI-DSZ-CC-1059-V3-2019,component_used,None +5cf51622fafaf868,BSI-DSZ-CC-1005-2016,recertification,None +1e23ae421d7a2d01,BSI-DSZ-CC-0633-V2-2014,component_used,None +0c7ef6c32cbdee47,ANSSI-CC-2017/61,component_used,None +8928e191ee2fd3b9,BSI-DSZ-CC-0523-2008,component_used,None +6ed3cd21c6a2c9d0,BSI-DSZ-CC-1107-2020,component_used,None +4962c0d8106b8b5e,ANSSI-CC-2015/37,evaluation_reused,None +e6057ffc5085a192,BSI-DSZ-CC-0829-2012,component_used,None +03fad65e5af65088,BSI-DSZ-CC-0696-2011,recertification,None +720aab4f782f4c60,BSI-DSZ-CC-0555-2009,component_used,None +9664c0f0ec6401b9,BSI-DSZ-CC-0891-V2-2016,recertification,None +d55eb8c97d71e843,ANSSI-CC-2021/49,previous_version,None +73e0b884cd04d9bc,NSCIB-CC-12-36243,component_used,None +2793414918738c7f,BSI-DSZ-CC-0633-V2-2014,component_used,None +f6a89befd13a643f,BSI-DSZ-CC-0951-V4-2019,component_used,None +f00a01940be6481d,BSI-DSZ-CC-0837-V2-2014,component_used,None +2f43fe24bd8e91e1,ANSSI-CC-2020/65,component_used,None +d96438a7165e5d82,BSI-DSZ-CC-0411-2007,component_used,None +7623950728f52a71,ANSSI-CC-2016/06,component_used,None +ba69597434946260,BSI-DSZ-CC-0293-2005,component_used,None +50aef770cb4f028f,BSI-DSZ-CC-1059-2018,component_used,None diff --git a/src/sec_certs/data/reference_annotations/manual_annotations/test.csv b/src/sec_certs/data/reference_annotations/manual_annotations/test.csv deleted file mode 100644 index ad952755..00000000 --- a/src/sec_certs/data/reference_annotations/manual_annotations/test.csv +++ /dev/null @@ -1,1171 +0,0 @@ -dgst,canonical_reference_keyword,source,label,comment -00a2b91e5b58cef1,ANSSI-CC-2014/23,None,None,None -00ad121fa63e5dfb,BSI-DSZ-CC-0973-V2-2016,None,None,None -00ad121fa63e5dfb,BSI-DSZ-CC-0996-2018,None,None,None -00b539d629e60965,CCEVS-VR-02-0025,None,None,None -00eb3e5c7a4537b1,BSI-DSZ-CC-0266-2005,None,None,None -00eb3e5c7a4537b1,BSI-DSZ-CC-0322-2005,None,None,None -00eb3e5c7a4537b1,BSI-DSZ-CC-0399-2007,None,None,None -017f3cea8275a3e1,ANSSI-CC-2015/59,None,None,None -017f3cea8275a3e1,ANSSI-CC-2017/23,None,None,None -01ce6f422bec823d,BSI-DSZ-CC-1040-2019,None,None,None -01dc77d7f8f94d97,ANSSI-CC-2016/78,None,None,None -01dc77d7f8f94d97,ANSSI-CC-2017/39,None,None,None -01e5c6d31f763f56,BSI-DSZ-CC-0917-2014,None,None,None -0208e6b60a0b1a32,ANSSI-CC-2016/01,None,None,None -02c6fbcd90dcf05a,BSI-DSZ-CC-1107-V3-2022,None,None,None -02cb3c385865ad2c,BSI-DSZ-CC-1184-2022,None,None,None -0319b03323f257d1,BSI-DSZ-CC-1118-2020,None,None,None -0319b03323f257d1,BSI-DSZ-CC-1121-2019,None,None,None -032faef0207b715f,BSI-DSZ-CC-0837-V2-2014,None,None,None -0349c893b81f7c1a,BSI-DSZ-CC-1079-V2-2020,None,None,None -04c5a5a66fb7f89a,BSI-DSZ-CC-0827-V2-2014,None,None,None -04cb360502da6492,BSI-DSZ-CC-0344-2005,None,None,None -054bd8196e015197,ANSSI-CC-2011/07,None,None,None -05d96aada7bb839c,BSI-DSZ-CC-0223-2003,None,None,None -06b24bc51eb69188,BSI-DSZ-CC-0813-2012,None,None,None -06e70fa70393d60f,ANSSI-CC-2017/07,None,None,None -06e70fa70393d60f,BSI-DSZ-CC-0891-V2-2016,None,None,None -075ddd00e07fa7ed,ANSSI-CC-2020/76,None,None,None -075ddd00e07fa7ed,BSI-DSZ-CC-1136-2021,None,None,None -07ce7e4844f62c5c,ANSSI-CC-2017/73,None,None,None -07ce7e4844f62c5c,BSI-DSZ-CC-1070-2018,None,None,None -080aa6966d757f05,ANSSI-CC-2010/02,None,None,None -082380caaa153ee6,BSI-DSZ-CC-0891-V2-2016,None,None,None -08408cbc394e7421,ANSSI-CC-2017/59,None,None,None -08408cbc394e7421,BSI-DSZ-CC-0782-V4-2018,None,None,None -09220515a7edf3f9,BSI-DSZ-CC-1110-V2-2019,None,None,None -096b05114ee5e09f,BSI-DSZ-CC-0410-2007,None,None,None -096b05114ee5e09f,BSI-DSZ-CC-0411-2007,None,None,None -096ccb6bcb3d2731,BSI-DSZ-CC-0564-2009,None,None,None -09b07fbbb24e1b04,BSI-DSZ-CC-0964-2015,None,None,None -09f539aedefa9756,ANSSI-CC-2009/41,None,None,None -0a6e50445a906052,BSI-DSZ-CC-0891-V2-2016,None,None,None -0a6e50445a906052,BSI-DSZ-CC-0945-2017,None,None,None -0aad0176e35b3749,BSI-DSZ-CC-0477-2007,None,None,None -0b0648a9b9a26747,BSI-DSZ-CC-0223-2003,None,None,None -0bd651fcbb86f2a9,ANSSI-CC-2020/74,None,None,None -0bd651fcbb86f2a9,BSI-DSZ-CC-1136-2021,None,None,None -0c9e215997d96f44,BSI-DSZ-CC-0555-2009,None,None,None -0cd406e7c5013b74,BSI-DSZ-CC-0304-2006,None,None,None -0d4a95a8b52b787b,BSI-DSZ-CC-0829-2012,None,None,None -0da9d81c9f563df5,BSI-DSZ-CC-0382-2007,None,None,None -0ee132dec087b772,ANSSI-CC-2011/07,None,None,None -0ef56cba2362e463,ANSSI-CC-2015/42,None,None,None -0f1b31ac93459d1f,BSI-DSZ-CC-0720-2011,None,None,None -0f684159ad31f883,BSI-DSZ-CC-0555-2009,None,None,None -0fe0bb1054f49b7f,CCEVS-VR-04-0092,None,None,None -0ff82b1cc24b3105,BSI-DSZ-CC-0302-2005,None,None,None -10233188161519ee,ANSSI-CC-2019/48,None,None,None -10233188161519ee,ANSSI-CC-2020/26,None,None,None -10233188161519ee,BSI-DSZ-CC-1059-2018,None,None,None -10233188161519ee,BSI-DSZ-CC-1059-V3-2019,None,None,None -102707a8c4d8a1b0,ANSSI-CC-2019/35,None,None,None -102707a8c4d8a1b0,ANSSI-CC-2020/26,None,None,None -102707a8c4d8a1b0,BSI-DSZ-CC-1059-2018,None,None,None -102707a8c4d8a1b0,BSI-DSZ-CC-1059-V3-2019,None,None,None -102bbdfcd696d7a9,ANSSI-CC-2018/13,None,None,None -102bbdfcd696d7a9,ANSSI-CC-2019/01,None,None,None -107c348f4ba0a41c,BSI-DSZ-CC-1135-2020,None,None,None -109eb2158ca6a2f9,BSI-DSZ-CC-0410-2007,None,None,None -10af4a6378d0fb7a,ANSSI-CC-2014/07,None,None,None -10af4a6378d0fb7a,ANSSI-CC-2014/86,None,None,None -10af4a6378d0fb7a,BSI-DSZ-CC-0837-V2-2014,None,None,None -10af4a6378d0fb7a,BSI-DSZ-CC-0845-V2-2013,None,None,None -10b17081dd7cad8f,ANSSI-CC-2015/36,None,None,None -10b17081dd7cad8f,ANSSI-CC-2017/39,None,None,None -112fe9f123e277ee,ANSSI-CC-2010/02,None,None,None -112fe9f123e277ee,ANSSI-CC-2010/19,None,None,None -114e39b4da949e6d,ANSSI-CC-2020/08,None,None,None -114e39b4da949e6d,BSI-DSZ-CC-1110-V2-2019,None,None,None -1172a88e009dc248,CRP257,None,None,None -1172a88e009dc248,CRP281,None,None,None -1188aebd8681e4fe,BSI-DSZ-CC-0465-2008,None,None,None -11a98c5d5ff6f40f,BSI-DSZ-CC-0403-2008,None,None,None -11a98c5d5ff6f40f,BSI-DSZ-CC-0468-2007,None,None,None -11a98c5d5ff6f40f,CRP244,None,None,None -122245dd15683e26,BSI-DSZ-CC-0269-2006,None,None,None -123c94418ddf1ad8,BSI-DSZ-CC-0367-2006,None,None,None -131ec924c42ef90b,ANSSI-CC-2017/61,None,None,None -135ca3602f0005bf,BSI-DSZ-CC-0897-V2-2014,None,None,None -135ca3602f0005bf,NSCIB-CC-16-99111,None,None,None -13e5b88ad3becb77,BSI-DSZ-CC-0322-2005,None,None,None -13e5b88ad3becb77,BSI-DSZ-CC-0344-2005,None,None,None -1468948b4f0509ab,BSI-DSZ-CC-0813-2012,None,None,None -1494cff85b3dc2bb,BSI-DSZ-CC-0633-2010,None,None,None -157b741a0f529a0a,ANSSI-CC-2009/37,None,None,None -157f811757a0b29e,BSI-DSZ-CC-0555-2009,None,None,None -157f811757a0b29e,BSI-DSZ-CC-0633-2010,None,None,None -157f811757a0b29e,BSI-DSZ-CC-0675-2011,None,None,None -157f811757a0b29e,BSI-DSZ-CC-0745-2012,None,None,None -158950ed4bc35274,ANSSI-CC-2015/36,None,None,None -158950ed4bc35274,ANSSI-CC-2015/80,None,None,None -158950ed4bc35274,ANSSI-CC-2016/33,None,None,None -15ae64b85b3e28d7,BSI-DSZ-CC-0394-2006,None,None,None -15b121492722bffb,BSI-DSZ-CC-0754-2012,None,None,None -16513a1bff79b46a,BSI-DSZ-CC-1044-V2-2019,None,None,None -16b0a0811bc4fe82,BSI-DSZ-CC-0169-2002,None,None,None -16b24ff1bf3c079b,ANSSI-CC-2012/22,None,None,None -173097995b7a7f12,ANSSI-CC-2012/49,None,None,None -173097995b7a7f12,ANSSI-CC-2013/28,None,None,None -173704f0d2b8a02f,ANSSI-CC-2018/08,None,None,None -173704f0d2b8a02f,ANSSI-CC-2018/19,None,None,None -177dee4c1051e612,BSI-DSZ-CC-0854-2013,None,None,None -17bfc3d0570ab3d0,ANSSI-CC-2016/09,None,None,None -183a5cd3e2aaa0ec,ANSSI-CC-2017/76,None,None,None -183a5cd3e2aaa0ec,BSI-DSZ-CC-0891-V2-2016,None,None,None -18a515a0fff0c0c3,BSI-DSZ-CC-0957-V2-2016,None,None,None -18b7e5bdf459ca13,NSCIB-CC-07-09219,None,None,None -195366bfba7213a5,BSI-DSZ-CC-0266-2005,None,None,None -195366bfba7213a5,BSI-DSZ-CC-0322-2005,None,None,None -195366bfba7213a5,BSI-DSZ-CC-0399-2007,None,None,None -1999d4ed82b3188e,BSI-DSZ-CC-0451-2007,None,None,None -19d3185c40be008d,ANSSI-CC-2016/65,None,None,None -1ac8de53c0894d18,BSI-DSZ-CC-0814-2012,None,None,None -1b2764a62ffe86a2,BSI-DSZ-CC-0978-2016,None,None,None -1bcfaefe46abccf0,BSI-DSZ-CC-0917-2014,None,None,None -1c8567a1b1a6c12a,BSI-DSZ-CC-1040-2019,None,None,None -1cc05dbb992431b9,ANSSI-CC-2021/29,None,None,None -1d1df0fb541e49b8,BSI-DSZ-CC-1020-V2-2017,None,None,None -1d9ae732c5dec242,ANSSI-CC-2009/37,None,None,None -1ea31bb5f6a15995,BSI-DSZ-CC-0808-V3-2017,None,None,None -1ea31bb5f6a15995,BSI-DSZ-CC-0809-V2-2016,None,None,None -1ea31bb5f6a15995,BSI-DSZ-CC-0978-V2-2017,None,None,None -1ff08f79cb89c1de,BSI-DSZ-CC-0939-2015,None,None,None -2078424be58e4db1,OCSI/CERT/SYS/08/2017/RC,None,None,None -21951e191e55b66e,BSI-DSZ-CC-0782-2012,None,None,None -21cffadbbb87c205,BSI-DSZ-CC-0348-2006,None,None,None -22ede463dbf1a105,ANSSI-CC-2015/36,None,None,None -22ede463dbf1a105,ANSSI-CC-2015/80,None,None,None -22ede463dbf1a105,ANSSI-CC-2016/43,None,None,None -22ede463dbf1a105,ANSSI-CC-2016/44,None,None,None -23a85a7f9c07412f,ANSSI-CC-2014/46,None,None,None -23a85a7f9c07412f,ANSSI-CC-2016/33,None,None,None -24624a4e60ddedd4,BSI-DSZ-CC-0868-2014,None,None,None -24624a4e60ddedd4,BSI-DSZ-CC-0951-2015,None,None,None -259df98e7476a843,BSI-DSZ-CC-0666-2012,None,None,None -259e0ab1c4b690cf,ANSSI-CC-2012/70,None,None,None -25c07c5d0a05d86c,ANSSI-CC-2015/08,None,None,None -25c07c5d0a05d86c,ANSSI-CC-2015/15,None,None,None -25c07c5d0a05d86c,BSI-DSZ-CC-0845-2012,None,None,None -25c07c5d0a05d86c,BSI-DSZ-CC-0845-V2-2013,None,None,None -26c4912b140fde9f,BSI-DSZ-CC-0891-V2-2016,None,None,None -26c7b173668167d8,BSI-DSZ-CC-0813-2012,None,None,None -2760aeedce0b79db,ANSSI-CC-2011/64,None,None,None -2760aeedce0b79db,BSI-DSZ-CC-0555-2009,None,None,None -27ccec0740bb7915,ANSSI-CC-2010/02,None,None,None -27ccec0740bb7915,ANSSI-CC-2010/20,None,None,None -27ccec0740bb7915,ANSSI-CC-2010/35,None,None,None -296618f10b019d9c,BSI-DSZ-CC-0417-2008,None,None,None -29cc495628e76ffa,BSI-DSZ-CC-0845-2012,None,None,None -29cc495628e76ffa,BSI-DSZ-CC-0886-2013,None,None,None -29f2dd90f57ea948,BSI-DSZ-CC-0837-V2-2014,None,None,None -29fb07d8f74e734b,BSI-DSZ-CC-0303-2006,None,None,None -2a07b85f61ac08b0,ANSSI-CC-2019/02,None,None,None -2a07b85f61ac08b0,ANSSI-CC-2019/59,None,None,None -2a91f42389fda90d,BSI-DSZ-CC-0782-V2-2015,None,None,None -2adb03f5294c31c2,BSI-DSZ-CC-0608-2010,None,None,None -2b0342d5b70b7a78,ANSSI-CC-2010/03,None,None,None -2bd9661657e78278,ANSSI-CC-2012/39,None,None,None -2bd9661657e78278,ANSSI-CC-2013/13,None,None,None -2be10f342e68a89e,BSI-DSZ-CC-0963-V2-2017,None,None,None -2c41f9dfcd5014e6,BSI-DSZ-CC-0973-2016,None,None,None -2d046178aa118fff,BSI-DSZ-CC-0293-2005,None,None,None -2d0b4100c3ead88a,BSI-DSZ-CC-0945-V2-2018,None,None,None -2eee0fdd5cdaf565,ANSSI-CC-2017/07,None,None,None -2eee0fdd5cdaf565,BSI-DSZ-CC-0891-V2-2016,None,None,None -2f9feaf4121720da,BSI-DSZ-CC-0547-2009,None,None,None -30c6777901ae346c,BSI-DSZ-CC-0438-2007,None,None,None -30e9ce0969941ffb,BSI-DSZ-CC-0782-V2-2015,None,None,None -3183669bf78db43b,ANSSI-CC-2015/45,None,None,None -3183669bf78db43b,ANSSI-CC-2016/64,None,None,None -3183669bf78db43b,BSI-DSZ-CC-0782-V2-2015,None,None,None -31fd07069aebf013,BSI-DSZ-CC-0466-2008,None,None,None -328fee1e52f7ac82,BSI-DSZ-CC-0410-2007,None,None,None -328fee1e52f7ac82,BSI-DSZ-CC-0680-2010,None,None,None -3334d22b6559d0e2,BSI-DSZ-CC-0944-2014,None,None,None -3334d22b6559d0e2,BSI-DSZ-CC-0963-V2-2017,None,None,None -337ece90615ed69d,ANSSI-CC-2010/02,None,None,None -3392558f04e04663,BSI-DSZ-CC-0782-V2-2015,None,None,None -33cada8c95bf55c5,BSI-DSZ-CC-0879-V3-2018,None,None,None -33cada8c95bf55c5,BSI-DSZ-CC-1028-2017,None,None,None -34506b8fab6dd7c3,ANSSI-CC-2014/22,None,None,None -34ed76f0c32d9e93,ANSSI-CC-2012/49,None,None,None -34ed76f0c32d9e93,ANSSI-CC-2013/18,None,None,None -3519c14e4114d93d,BSI-DSZ-CC-0782-2012,None,None,None -35b9be2203d2b9e6,ANSSI-CC-2012/70,None,None,None -35b9be2203d2b9e6,BSI-DSZ-CC-0895-2014,None,None,None -35efe13fa9e93a68,CRP178,None,None,None -35efe13fa9e93a68,CRP182,None,None,None -36641ce7192b5f92,BSI-DSZ-CC-0977-2017,None,None,None -36df04ab9c978ab9,BSI-DSZ-CC-0624-2010,None,None,None -373e7b1bc9066563,BSI-DSZ-CC-1110-V2-2019,None,None,None -3746512864b941d4,ANSSI-CC-2016/15,None,None,None -37b94c08f8e25249,BSI-DSZ-CC-0404-2007,None,None,None -37b94c08f8e25249,BSI-DSZ-CC-0410-2007,None,None,None -37b94c08f8e25249,BSI-DSZ-CC-0555-2009,None,None,None -37b94c08f8e25249,BSI-DSZ-CC-0633-2010,None,None,None -37b94c08f8e25249,BSI-DSZ-CC-0674-2011,None,None,None -37b94c08f8e25249,BSI-DSZ-CC-0675-2011,None,None,None -37b94c08f8e25249,BSI-DSZ-CC-0709-2010,None,None,None -37b94c08f8e25249,BSI-DSZ-CC-0710-2010,None,None,None -37b94c08f8e25249,BSI-DSZ-CC-0730-2011,None,None,None -37b94c08f8e25249,BSI-DSZ-CC-0797-2012,None,None,None -37b94c08f8e25249,BSI-DSZ-CC-0799-2012,None,None,None -37c8d23c44b95833,ANSSI-CC-2017/16,None,None,None -37d28734245a3bb1,BSI-DSZ-CC-0257-2004,None,None,None -37e0d3cb098458d0,ANSSI-CC-2014/50,None,None,None -37e0d3cb098458d0,BSI-DSZ-CC-0999-2016,None,None,None -37fe6036c2ac932b,ANSSI-CC-2014/06,None,None,None -37fe6036c2ac932b,ANSSI-CC-2014/07,None,None,None -37fe6036c2ac932b,BSI-DSZ-CC-0829-2012,None,None,None -3817c0aca007989e,ANSSI-CC-2011/10,None,None,None -3817c0aca007989e,ANSSI-CC-2011/12,None,None,None -3817c0aca007989e,BSI-DSZ-CC-0523-2008,None,None,None -3817c0aca007989e,BSI-DSZ-CC-0626-2009,None,None,None -384dca297bd4f1ca,BSI-DSZ-CC-0837-V2-2014,None,None,None -384dca297bd4f1ca,BSI-DSZ-CC-0978-2016,None,None,None -3976c9e492193315,BSI-DSZ-CC-1113-2021,None,None,None -39c07ebbca541145,BSI-DSZ-CC-0917-2014,None,None,None -3a3b0a9113835307,BSI-DSZ-CC-0402-2008,None,None,None -3a3b0a9113835307,BSI-DSZ-CC-0468-2007,None,None,None -3a3b0a9113835307,CCEVS-VR-07-0054,None,None,None -3a3b0a9113835307,CCEVS-VR-VID10271-2007,None,None,None -3a6a5f536bfbd4d4,ANSSI-CC-2009/59,None,None,None -3ba9f330ce93636b,BSI-DSZ-CC-0640-2010,None,None,None -3ba9f330ce93636b,BSI-DSZ-CC-0677-2010,None,None,None -3d149fe7c08bfc58,CRP256,None,None,None -3d756c83419bba28,ANSSI-CC-2011/07,None,None,None -3d756c83419bba28,ANSSI-CC-2011/77,None,None,None -3d8083b1e6c7b336,BSI-DSZ-CC-1136-V2-2022,None,None,None -3d8083b1e6c7b336,BSI-DSZ-CC-1136-V3-2022,None,None,None -3e08a27e9d9c9b1e,BSI-DSZ-CC-0973-2016,None,None,None -3e08a27e9d9c9b1e,NSCIB-CC-16-99111,None,None,None -3e182053b03f1faf,CCEVS-VR-06-0044,None,None,None -3e345d3c6002ad55,BSI-DSZ-CC-0915-2016,None,None,None -3ea02a62856c752a,ANSSI-CC-2012/70,None,None,None -3ea02a62856c752a,ANSSI-CC-2012/72,None,None,None -3ea02a62856c752a,BSI-DSZ-CC-0719-2011,None,None,None -3f188bbf2af01b25,OCSI/CERT/IMQ/07/2017/RC,None,None,None -3f22bd3eaef5d64d,BSI-DSZ-CC-0957-2015,None,None,None -3f22bd3eaef5d64d,BSI-DSZ-CC-0978-2016,None,None,None -3f4b6e4f245f6fab,ANSSI-CC-2017/49,None,None,None -3f8475de6ea558ac,BSI-DSZ-CC-0427-2007,None,None,None -3feda0b8b5637540,BSI-DSZ-CC-1059-V4-2021,None,None,None -3feda0b8b5637540,NSCIB-CC-67206-CR5,None,None,None -4057f5dbe4ffa4cd,ANSSI-CC-2017/57,None,None,None -40f62cd468a546cc,OCSI/CERT/ATS/05/2020/RC,None,None,None -40fa0a4cb5193977,ANSSI-CC-2018/27,None,None,None -40fa0a4cb5193977,BSI-DSZ-CC-0879-V3-2018,None,None,None -40fc6ad0aed92913,ANSSI-CC-2017/54,None,None,None -40fc6ad0aed92913,BSI-DSZ-CC-0891-V2-2016,None,None,None -41bd2924e9afced5,ANSSI-CC-2010/49,None,None,None -41bd2924e9afced5,ANSSI-CC-2010/50,None,None,None -420876ec1e5ba657,ANSSI-CC-2012/30,None,None,None -424f6d496746258b,ANSSI-CC-2019/12,None,None,None -424f6d496746258b,BSI-DSZ-CC-0995-2018,None,None,None -4285d9b580f8a2a6,ANSSI-CC-2013/59,None,None,None -42bc15eb26cf2eec,BSI-DSZ-CC-0829-2012,None,None,None -42d2e68c29d9eef7,ANSSI-CC-2018/30,None,None,None -42f53e51476f1a3c,ANSSI-CC-2011/07,None,None,None -438b59086f6ebd64,BSI-DSZ-CC-1107-2020,None,None,None -43a4ca62d0c0b0da,ANSSI-CC-2017/63,None,None,None -43a4ca62d0c0b0da,ANSSI-CC-2017/64,None,None,None -43a4ca62d0c0b0da,BSI-DSZ-CC-1059-V3-2019,None,None,None -43d9cb9d3fe30ff2,BSI-DSZ-CC-0555-2009,None,None,None -43d9cb9d3fe30ff2,BSI-DSZ-CC-0857-2013,None,None,None -449c74a92ebb61a4,ANSSI-CC-2017/24,None,None,None -44becd7e128f4ba0,BSI-DSZ-CC-0410-2007,None,None,None -45098872448f5816,NSCIB-CC-0441513-CR,None,None,None -46459cfb9c1045d8,ANSSI-CC-2018/27,None,None,None -46459cfb9c1045d8,BSI-DSZ-CC-0782-V4-2018,None,None,None -4750f5114dcaa60d,BSI-DSZ-CC-0891-V4-2019,None,None,None -47913a485c3c8a18,ANSSI-CC-2019/28,None,None,None -4832a44c0df0bad2,ANSSI-CC-2019/12,None,None,None -4832a44c0df0bad2,BSI-DSZ-CC-1074-2019,None,None,None -4893140ae5daadaf,BSI-DSZ-CC-0782-2012,None,None,None -4893140ae5daadaf,CRP278,None,None,None -48a41f3f5110db1f,BSI-DSZ-CC-0350-2007,None,None,None -48d897f17754c7ce,BSI-DSZ-CC-0978-2016,None,None,None -48fd3d84b1a0bc68,BSI-DSZ-CC-0348-2006,None,None,None -491c766e35ae9f6e,BSI-DSZ-CC-0879-V4-2020,None,None,None -491c766e35ae9f6e,BSI-DSZ-CC-1071-V3-2020,None,None,None -49e6665ee56d3bfc,ANSSI-CC-2015/45,None,None,None -49e6665ee56d3bfc,ANSSI-CC-2016/64,None,None,None -49e6665ee56d3bfc,BSI-DSZ-CC-0782-V2-2015,None,None,None -4abc83fee59586b2,ANSSI-CC-2020/07,None,None,None -4abc83fee59586b2,BSI-DSZ-CC-1110-V3-2020,None,None,None -4abc83fee59586b2,NSCIB-CC-200270-CR,None,None,None -4b2f963b48e0f954,ANSSI-CC-2010/11,None,None,None -4b5521f85ab3fff7,BSI-DSZ-CC-0879-V4-2020,None,None,None -4b5521f85ab3fff7,BSI-DSZ-CC-1071-V4-2020,None,None,None -4bf7d6ef245dd393,ANSSI-CC-2009/60,None,None,None -4bf7d6ef245dd393,ANSSI-CC-2010/02,None,None,None -4c0e2794cb729825,ANSSI-CC-2010/02,None,None,None -4c0e2794cb729825,ANSSI-CC-2010/22,None,None,None -4c90a96fb1ee09f6,BSI-DSZ-CC-0410-2007,None,None,None -4d21561351ecd00a,BSI-DSZ-CC-1052-V3-2021,None,None,None -4d2a177384b23fd6,ANSSI-CC-2016/58,None,None,None -4d885e54f1361d04,BSI-DSZ-CC-0577-2009,None,None,None -4dbb108406acb1a5,ANSSI-CC-2010/02,None,None,None -4dbb108406acb1a5,ANSSI-CC-2012/68,None,None,None -4dc023ea2e3c4115,ANSSI-CC-2017/59,None,None,None -4dc023ea2e3c4115,BSI-DSZ-CC-0782-V3-2017,None,None,None -4dd0daec78093d31,ANSSI-CC-2016/59,None,None,None -4e29916c366fe997,BSI-DSZ-CC-0782-2012,None,None,None -4f3bf0c433b7f54f,BSI-DSZ-CC-0171-2002,None,None,None -4f8db13958be0f75,BSI-DSZ-CC-1051-2019,None,None,None -4f953ae00a24eb85,ANSSI-CC-2015/36,None,None,None -4f953ae00a24eb85,ANSSI-CC-2016/43,None,None,None -4f953ae00a24eb85,ANSSI-CC-2016/44,None,None,None -4f953ae00a24eb85,ANSSI-CC-2016/78,None,None,None -5103648897ba1b3a,BSI-DSZ-CC-0891-2015,None,None,None -5162627872566ada,ANSSI-CC-2020/07,None,None,None -5162627872566ada,BSI-DSZ-CC-1110-V2-2019,None,None,None -51768783ab3e67f3,ANSSI-CC-2010/03,None,None,None -51768783ab3e67f3,ANSSI-CC-2017/47,None,None,None -51768783ab3e67f3,ANSSI-CC-2017/49,None,None,None -51768783ab3e67f3,BSI-DSZ-CC-0955-V2-2016,None,None,None -51768783ab3e67f3,BSI-DSZ-CC-0973-V2-2016,None,None,None -51a4bea9a77a55cf,BSI-DSZ-CC-0410-2007,None,None,None -51a4bea9a77a55cf,BSI-DSZ-CC-0417-2008,None,None,None -51a4bea9a77a55cf,BSI-DSZ-CC-0602-2009,None,None,None -51c589803c349e44,BSI-DSZ-CC-0813-2012,None,None,None -51c589803c349e44,BSI-DSZ-CC-0851-2013,None,None,None -5346d5a4418466ab,BSI-DSZ-CC-1110-V3-2020,None,None,None -53bba35f7ea6edc9,ANSSI-CC-2017/02,None,None,None -53fe111411edfa45,BSI-DSZ-CC-0325-2006,None,None,None -541da571bac5e279,BSI-DSZ-CC-0466-2008,None,None,None -5423483cd3c3b75a,ANSSI-CC-2016/60,None,None,None -5423483cd3c3b75a,ANSSI-CC-2016/69,None,None,None -5423483cd3c3b75a,BSI-DSZ-CC-0946-V2-2015,None,None,None -5498bfcecf19dfa3,ANSSI-CC-2021/08,None,None,None -54f754dc95137c47,NSCIB-CC-13-37760-CR2,None,None,None -54fada9909a1edb3,ANSSI-CC-2009/56,None,None,None -54fada9909a1edb3,BSI-DSZ-CC-0451-2007,None,None,None -5506b5232076d409,CCEVS-VR-VID10334-2010,None,None,None -55669bcb3a9e09c0,BSI-DSZ-CC-1041-2018,None,None,None -55925bc39df20912,BSI-DSZ-CC-0322-2005,None,None,None -559e0907fef71cf6,ANSSI-CC-2014/62,None,None,None -559e0907fef71cf6,BSI-DSZ-CC-0829-2012,None,None,None -559e0907fef71cf6,BSI-DSZ-CC-0829-V2-2015,None,None,None -55e52bcaab69d573,BSI-DSZ-CC-0410-2007,None,None,None -55e52bcaab69d573,BSI-DSZ-CC-0463-2008,None,None,None -55e85aac6594c2fc,BSI-DSZ-CC-0410-2007,None,None,None -55e85aac6594c2fc,BSI-DSZ-CC-0417-2008,None,None,None -55e85aac6594c2fc,BSI-DSZ-CC-0643-2010,None,None,None -55f9f2fedfc7f069,BSI-DSZ-CC-0926-2014,None,None,None -568c473e6e5e95c7,BSI-DSZ-CC-0897-V2-2014,None,None,None -56a56d39dbfe3516,ANSSI-CC-2017/47,None,None,None -56a56d39dbfe3516,ANSSI-CC-2017/49,None,None,None -56a56d39dbfe3516,BSI-DSZ-CC-0973-V2-2016,None,None,None -56bca69ce012d4c1,BSI-DSZ-CC-0951-2015,None,None,None -56bca69ce012d4c1,BSI-DSZ-CC-1028-2017,None,None,None -56ceb1a9c003ac3f,BSI-DSZ-CC-1124-2021,None,None,None -56ebfd7a918891c6,2016-36-INF-1779,None,None,None -5787ff8207fd751d,ANSSI-CC-2021/51,None,None,None -57e108dcd6ee072b,BSI-DSZ-CC-0720-2011,None,None,None -57e929939f1fd1c0,BSI-DSZ-CC-0487-2009,None,None,None -583c12b5bf2423c6,BSI-DSZ-CC-1110-V4-2021,None,None,None -58688dfc2c59d3ab,BSI-DSZ-CC-0831-V2-2020,None,None,None -58688dfc2c59d3ab,BSI-DSZ-CC-0957-V2-2016,None,None,None -587055293e9fa51d,ANSSI-CC-2017/07,None,None,None -587055293e9fa51d,BSI-DSZ-CC-0891-V2-2016,None,None,None -58ece75f7f2b5099,ANSSI-CC-2010/02,None,None,None -58ece75f7f2b5099,ANSSI-CC-2012/68,None,None,None -59820117bb7fa240,ANSSI-CC-2009/61,None,None,None -59820117bb7fa240,ANSSI-CC-2010/02,None,None,None -59820117bb7fa240,ANSSI-CC-2010/31,None,None,None -598e2a9978d3c79c,ANSSI-CC-2013/59,None,None,None -59b026d889aa0309,BSI-DSZ-CC-1025-V2-2019,None,None,None -5a1764ef77908457,BSI-DSZ-CC-1040-2019,None,None,None -5b1b55f1997a9439,OCSI/CERT/IMQ/04/2016/RC,None,None,None -5b67a83de2aaa93a,ANSSI-CC-2013/02,None,None,None -5b67a83de2aaa93a,ANSSI-CC-2014/37,None,None,None -5bf118ffa29520c0,ANSSI-CC-2017/76,None,None,None -5bf118ffa29520c0,BSI-DSZ-CC-0891-V2-2016,None,None,None -5bfbc4a6cbab9eb1,BSI-DSZ-CC-0302-2005,None,None,None -5c5431cca026fb3e,BSI-DSZ-CC-0179-2003,None,None,None -5c5431cca026fb3e,BSI-DSZ-CC-0213-2003,None,None,None -5caf1c90ec7001b7,BSI-DSZ-CC-0410-2007,None,None,None -5caf1c90ec7001b7,BSI-DSZ-CC-0417-2008,None,None,None -5cbd46653c3bea1a,BSI-DSZ-CC-0439-2008,None,None,None -5cec11774890d61e,BSI-DSZ-CC-0750-V2-2014,None,None,None -5cec11774890d61e,BSI-DSZ-CC-0858-2013,None,None,None -5cec11774890d61e,BSI-DSZ-CC-0911-2014,None,None,None -5cec11774890d61e,BSI-DSZ-CC-0912-2014,None,None,None -5cec11774890d61e,BSI-DSZ-CC-0914-2014,None,None,None -5cec11774890d61e,NSCIB-CC-13-37760-CR2,None,None,None -5cfe68ed449e0478,ANSSI-CC-2017/76,None,None,None -5cfe68ed449e0478,BSI-DSZ-CC-0891-V2-2016,None,None,None -5d4aae047020163b,ANSSI-CC-2010/03,None,None,None -5d4aae047020163b,ANSSI-CC-2017/47,None,None,None -5d4aae047020163b,ANSSI-CC-2017/49,None,None,None -5d4aae047020163b,BSI-DSZ-CC-0955-V2-2016,None,None,None -5d4aae047020163b,BSI-DSZ-CC-0973-V2-2016,None,None,None -5d674c06a559a5e7,BSI-DSZ-CC-1128-V4-2022,None,None,None -5e4e16da9d0630dd,ANSSI-CC-2016/70,None,None,None -5e4e16da9d0630dd,ANSSI-CC-2017/59,None,None,None -5eb91b620bbf5bfc,ANSSI-CC-2009/39,None,None,None -5eb91b620bbf5bfc,ANSSI-CC-2009/40,None,None,None -5eda77c801e2df86,BSI-DSZ-CC-0891-V4-2019,None,None,None -5edefd19948ad581,CRP237,None,None,None -5ee9898421c06859,BSI-DSZ-CC-0758-2012,None,None,None -5efe98a1ba4df4d7,BSI-DSZ-CC-0757-2011,None,None,None -5f259ce91f0234a0,BSI-DSZ-CC-1110-V3-2020,None,None,None -5f4cd1504f8b18e3,CCEVS-VR-05-0131,None,None,None -5f84cd800ee96468,BSI-DSZ-CC-0750-V2-2014,None,None,None -5f84cd800ee96468,NSCIB-CC-13-37760-CR2,None,None,None -5f99b00bf258f32f,ANSSI-CC-2010/03,None,None,None -5f99b00bf258f32f,ANSSI-CC-2017/47,None,None,None -5f99b00bf258f32f,ANSSI-CC-2017/49,None,None,None -5f99b00bf258f32f,BSI-DSZ-CC-0955-V2-2016,None,None,None -5f99b00bf258f32f,BSI-DSZ-CC-0973-V2-2016,None,None,None -60ec8738947badb0,ANSSI-CC-2017/12,None,None,None -60ec8738947badb0,ANSSI-CC-2018/12,None,None,None -60f08c85a518de1c,ANSSI-CC-2009/61,None,None,None -60f08c85a518de1c,ANSSI-CC-2010/02,None,None,None -60f0dd83c8f32b8c,ANSSI-CC-2014/46,None,None,None -6136acacc653106c,BSI-DSZ-CC-0555-2009,None,None,None -61e862ed07d3cb03,BSI-DSZ-CC-0875-2015,None,None,None -62313881916550ca,ANSSI-CC-2019/28,None,None,None -62eb991153211de6,ANSSI-CC-2010/02,None,None,None -62eb991153211de6,BSI-DSZ-CC-0671-2011,None,None,None -6313a92bf426d2bb,BSI-DSZ-CC-0411-2007,None,None,None -6337d3dcc5362dc6,ANSSI-CC-2019/12,None,None,None -637657613004dbbd,BSI-DSZ-CC-0293-2005,None,None,None -63e55780fa1766de,ANSSI-CC-2010/01,None,None,None -64e80c255d51ff37,BSI-DSZ-CC-0404-2007,None,None,None -64e80c255d51ff37,BSI-DSZ-CC-0410-2007,None,None,None -64e80c255d51ff37,BSI-DSZ-CC-0411-2007,None,None,None -64ed7e55bdc50177,ANSSI-CC-2020/07,None,None,None -64ed7e55bdc50177,BSI-DSZ-CC-1110-V2-2019,None,None,None -6529877d9799822a,BSI-DSZ-CC-1113-V3-2022,None,None,None -654554952ecb20ac,ANSSI-CC-2010/01,None,None,None -6587b26878da24b5,ANSSI-CC-2015/08,None,None,None -6587b26878da24b5,ANSSI-CC-2015/15,None,None,None -6587b26878da24b5,ANSSI-CC-2015/30,None,None,None -6587b26878da24b5,BSI-DSZ-CC-0845-2012,None,None,None -6587b26878da24b5,BSI-DSZ-CC-0870-2014,None,None,None -65a47f93451f13de,BSI-DSZ-CC-1079-V2-2020,None,None,None -65af80e5c6538215,BSI-DSZ-CC-1059-V2-2019,None,None,None -65fba51313f65938,ANSSI-CC-2015/66,None,None,None -6700028a309c3f7f,CRP271,None,None,None -6700028a309c3f7f,CRP282,None,None,None -67240adc18be338d,BSI-DSZ-CC-1044-V5-2022,None,None,None -67e75c6c6538110e,BSI-DSZ-CC-0963-2015,None,None,None -68875c05e00bd1aa,ANSSI-CC-2009/26,None,None,None -692e91451741ef49,BSI-DSZ-CC-0268-2005,None,None,None -693325ca20a6325b,BSI-DSZ-CC-0917-2014,None,None,None -696c193b3d13924e,OCSI/CERT/RES/03/2012/RC,None,None,None -6999db84bd629b32,BSI-DSZ-CC-0293-2005,None,None,None -6999db84bd629b32,BSI-DSZ-CC-0296-2006,None,None,None -69b877d99c360f97,BSI-DSZ-CC-0837-V2-2014,None,None,None -6a46ff1d1a5154b0,BSI-DSZ-CC-0845-2012,None,None,None -6abef2102c86c0fc,ANSSI-CC-2011/07,None,None,None -6ae356d8abbfdeb9,BSI-DSZ-CC-1153-2021,None,None,None -6b605ff743c859d0,ANSSI-CC-2015/36,None,None,None -6b605ff743c859d0,ANSSI-CC-2017/02,None,None,None -6b605ff743c859d0,ANSSI-CC-2018/41,None,None,None -6bdca9f13e19572e,ANSSI-CC-2019/34,None,None,None -6bdca9f13e19572e,ANSSI-CC-2020/26,None,None,None -6bdca9f13e19572e,BSI-DSZ-CC-1059-2018,None,None,None -6bdca9f13e19572e,BSI-DSZ-CC-1059-V3-2019,None,None,None -6c2fc8308efeccb4,BSI-DSZ-CC-0555-2009,None,None,None -6c2fc8308efeccb4,BSI-DSZ-CC-0633-2010,None,None,None -6c2fc8308efeccb4,BSI-DSZ-CC-0675-2011,None,None,None -6c3e0fe95400f1f5,BSI-DSZ-CC-0939-V2-2016,None,None,None -6cef8442092da1da,ANSSI-CC-2021/52,None,None,None -6d9c2bab8cc8d28c,ANSSI-CC-2014/06,None,None,None -6d9c2bab8cc8d28c,ANSSI-CC-2014/14,None,None,None -6d9c2bab8cc8d28c,ANSSI-CC-2014/49,None,None,None -6d9c2bab8cc8d28c,BSI-DSZ-CC-0695-2011,None,None,None -6d9c2bab8cc8d28c,BSI-DSZ-CC-0829-2012,None,None,None -6dde54b8c6d592ef,BSI-DSZ-CC-1086-2018,None,None,None -6df8f86449e56c05,ANSSI-CC-2017/24,None,None,None -6df8f86449e56c05,ANSSI-CC-2018/32,None,None,None -6e9496b7254e02e2,ANSSI-CC-2020/08,None,None,None -6e9496b7254e02e2,BSI-DSZ-CC-1110-V2-2019,None,None,None -6eacef3b2f976ce9,BSI-DSZ-CC-0814-2012,None,None,None -6eeed6fefb1f0243,ANSSI-CC-2019/28,None,None,None -6ef82dead8e3437f,BSI-DSZ-CC-0837-2013,None,None,None -6ef82dead8e3437f,BSI-DSZ-CC-0892-2014,None,None,None -6ef82dead8e3437f,NSCIB-CC-12-36243,None,None,None -6f13e8b708b43383,ANSSI-CC-2009/28,None,None,None -6f480809fc73b635,BSI-DSZ-CC-0978-V2-2017,None,None,None -6f90b0bf6bbe884b,BSI-DSZ-CC-0916-2015,None,None,None -6f90b0bf6bbe884b,BSI-DSZ-CC-0950-2017,None,None,None -6fd73557577cf9ed,ANSSI-CC-2020/21,None,None,None -6fe5828936663aed,BSI-DSZ-CC-0482-2008,None,None,None -6ff89f3123a6a98f,BSI-DSZ-CC-0782-V3-2017,None,None,None -70908a4cfdc5585c,BSI-DSZ-CC-0266-2005,None,None,None -70908a4cfdc5585c,BSI-DSZ-CC-0437-2008,None,None,None -7096b882b315807a,BSI-DSZ-CC-0955-V2-2016,None,None,None -70f75a14390522b6,BSI-DSZ-CC-0837-V2-2014,None,None,None -711a7b593ed41b02,ANSSI-CC-2010/49,None,None,None -71d3720cad53b289,BSI-DSZ-CC-0891-V4-2019,None,None,None -71d3720cad53b289,BSI-DSZ-CC-1105-2020,None,None,None -71eae9be60b7fb6c,BSI-DSZ-CC-0555-2009,None,None,None -71eae9be60b7fb6c,BSI-DSZ-CC-0633-2010,None,None,None -723ba544431f7874,BSI-DSZ-CC-1110-V4-2021,None,None,None -731aac44217611ec,ANSSI-CC-2014/24,None,None,None -736ede0289146b59,BSI-DSZ-CC-1067-2020,None,None,None -7386d04b20f354f4,BSI-DSZ-CC-0829-2012,None,None,None -7386d04b20f354f4,BSI-DSZ-CC-0829-V2-2015,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0404-2007,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0410-2007,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0555-2009,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0633-2010,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0674-2011,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0675-2011,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0709-2010,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0710-2010,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0730-2011,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0797-2012,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0798-2012,None,None,None -743318f3a2b4e281,BSI-DSZ-CC-0799-2012,None,None,None -74d685c3723bdf92,BSI-DSZ-CC-0978-2016,None,None,None -75ce95f62fc65fac,BSI-DSZ-CC-0269-2006,None,None,None -75ce95f62fc65fac,BSI-DSZ-CC-0376-2006,None,None,None -76d52f916b4222b1,BSI-DSZ-CC-0266-2005,None,None,None -76d52f916b4222b1,BSI-DSZ-CC-0470-2008,None,None,None -781c243d0021d4c5,BSI-DSZ-CC-0223-2003,None,None,None -78a279b07a6d3367,CCEVS-VR-05-0119,None,None,None -78ef46252d580af0,ANSSI-CC-2016/22,None,None,None -793075287bf70a81,BSI-DSZ-CC-1139-V2-2021,None,None,None -7942e835fb18c4ac,BSI-DSZ-CC-0482-2008,None,None,None -797ea41cc2e95f08,ANSSI-CC-2012/22,None,None,None -797ea41cc2e95f08,ANSSI-CC-2013/36,None,None,None -7980d204dbc3ecee,BSI-DSZ-CC-1113-2021,None,None,None -7a059d2754e088a3,ANSSI-CC-2022/10,None,None,None -7a059d2754e088a3,ANSSI-CC-2022/13,None,None,None -7a059d2754e088a3,BSI-DSZ-CC-1107-V2-2021,None,None,None -7a26d92281df3e8e,BSI-DSZ-CC-0451-2007,None,None,None -7a5a4a9578503a55,BSI-DSZ-CC-1072-V3-2019,None,None,None -7b63c31cfd0eb65f,BSI-DSZ-CC-0977-V2-2019,None,None,None -7b63c31cfd0eb65f,BSI-DSZ-CC-1019-V2-2019,None,None,None -7c04881c9a46b337,NSCIB-CC-09-11025,None,None,None -7c708f62e3280ec3,BSI-DSZ-CC-0354-2006,None,None,None -7c7e48e3aed8bfd4,ANSSI-CC-2020/08,None,None,None -7c7e48e3aed8bfd4,BSI-DSZ-CC-1110-V2-2019,None,None,None -7d4585a4b5b6e873,ANSSI-CC-2010/02,None,None,None -7dfcefd1ffeaa941,ANSSI-CC-2018/12,None,None,None -7e24168630d5124e,ANSSI-CC-2021/02,None,None,None -7e37ff763a97bc72,BSI-DSZ-CC-0555-2009,None,None,None -7e37ff763a97bc72,BSI-DSZ-CC-0857-2013,None,None,None -7e8763f553e43d12,BSI-DSZ-CC-0782-2012,None,None,None -7e92dcac20e009a5,BSI-DSZ-CC-0827-V3-2015,None,None,None -7f02a580f5219377,BSI-DSZ-CC-1040-2019,None,None,None -8035f242b12cec6d,ANSSI-CC-2009/26,None,None,None -8035f242b12cec6d,ANSSI-CC-2009/28,None,None,None -8035f242b12cec6d,ANSSI-CC-2009/50,None,None,None -808de32aa819821d,BSI-DSZ-CC-1021-V2-2017,None,None,None -80fe3ba3d9c9bf64,BSI-DSZ-CC-0406-2007,None,None,None -80fe3ba3d9c9bf64,BSI-DSZ-CC-0410-2007,None,None,None -819d92a6492415d3,BSI-DSZ-CC-0728-2011,None,None,None -819d92a6492415d3,BSI-DSZ-CC-0763-2012,None,None,None -82a2bd8fe4ed2087,BSI-DSZ-CC-0645-2010,None,None,None -82a2bd8fe4ed2087,BSI-DSZ-CC-0731-2011,None,None,None -82a2bd8fe4ed2087,BSI-DSZ-CC-0743-2011,None,None,None -82a2bd8fe4ed2087,BSI-DSZ-CC-0750-2011,None,None,None -83020f91ce1aaf68,ANSSI-CC-2017/24,None,None,None -83020f91ce1aaf68,ANSSI-CC-2018/32,None,None,None -835211383d281d89,BSI-DSZ-CC-1079-V2-2020,None,None,None -83b4d7d35a747d1b,BSI-DSZ-CC-0829-2012,None,None,None -83bb8420c3cccf85,BSI-DSZ-CC-0464-2008,None,None,None -83c1ee8ab43ea00a,ANSSI-CC-2010/02,None,None,None -84444ea4fabcc66c,BSI-DSZ-CC-1107-V2-2021,None,None,None -84501b4439b66fd9,BSI-DSZ-CC-0837-V2-2014,None,None,None -84b1520706c3d784,NSCIB-CC-13-37760-CR2,None,None,None -84b1520706c3d784,OCSI/CERT/SYS/05/2015/RC,None,None,None -84c8bf1f809380bc,ANSSI-CC-2018/12,None,None,None -84ff17001564ea47,BSI-DSZ-CC-1040-2019,None,None,None -85fa17a19251a2ea,BSI-DSZ-CC-0410-2007,None,None,None -85fa17a19251a2ea,BSI-DSZ-CC-0709-2010,None,None,None -86462bcec4492bfa,ANSSI-CC-2017/73,None,None,None -86462bcec4492bfa,ANSSI-CC-2020/22,None,None,None -86e9da10bc176267,ANSSI-CC-2020/05,None,None,None -871066e9e2eaba52,ANSSI-CC-2022/39,None,None,None -8782c7c292ef2759,BSI-DSZ-CC-0782-V2-2015,None,None,None -8782c7c292ef2759,BSI-DSZ-CC-0879-V2-2015,None,None,None -878af76320373ba0,BSI-DSZ-CC-0874-2014,None,None,None -87abd998f3b7e26f,ANSSI-CC-2015/36,None,None,None -87abd998f3b7e26f,ANSSI-CC-2016/43,None,None,None -87abd998f3b7e26f,ANSSI-CC-2016/44,None,None,None -87abd998f3b7e26f,ANSSI-CC-2016/77,None,None,None -8817adf6eaf4f06c,OCSI/CERT/SYS/10/2016/RC,None,None,None -8820852f4a1163b3,BSI-DSZ-CC-1110-V2-2019,None,None,None -8825e2c99223c084,BSI-DSZ-CC-0427-2007,None,None,None -882a9d016c7e1f36,ANSSI-CC-2009/38,None,None,None -8865aed38c79d3fc,BSI-DSZ-CC-0606-2010,None,None,None -8870ddf70bf57890,ANSSI-CC-2012/70,None,None,None -8870ddf70bf57890,ANSSI-CC-2012/72,None,None,None -8944c4f14bbcaa74,ANSSI-CC-2020/94,None,None,None -89d1f7ab8b77e41d,BSI-DSZ-CC-0831-2018,None,None,None -89d1f7ab8b77e41d,BSI-DSZ-CC-0957-V2-2016,None,None,None -8a5f8686ab9de19e,BSI-DSZ-CC-0891-2015,None,None,None -8a7731e9eb363fb4,BSI-DSZ-CC-0410-2007,None,None,None -8a7731e9eb363fb4,BSI-DSZ-CC-0417-2008,None,None,None -8ade0910a89717a8,BSI-DSZ-CC-0977-2017,None,None,None -8ae9a7fbbb50b6ed,ANSSI-CC-2012/77,None,None,None -8b0204e041dd3eb8,ANSSI-CC-2019/12,None,None,None -8b7145c13f36c324,BSI-DSZ-CC-1110-V3-2020,None,None,None -8bbbd89d09bb82ab,BSI-DSZ-CC-0555-2009,None,None,None -8bbbd89d09bb82ab,BSI-DSZ-CC-0857-2013,None,None,None -8bc3658bc958f81f,BSI-DSZ-CC-0837-V2-2014,None,None,None -8c6c4b4606608dfe,ANSSI-CC-2012/08,None,None,None -8cfcf8dc64485a74,ANSSI-CC-2009/28,None,None,None -8cfd0c9f4bcd21b8,BSI-DSZ-CC-0707-2012,None,None,None -8cfd0c9f4bcd21b8,BSI-DSZ-CC-0864-2012,None,None,None -8d2c50e41a1a0061,ANSSI-CC-2012/77,None,None,None -8d68ee5c283ca6b0,BSI-DSZ-CC-0552-2009,None,None,None -8d92202f35f15712,ANSSI-CC-2013/27,None,None,None -8d92202f35f15712,ANSSI-CC-2014/56,None,None,None -8dcdbce3262bfcd6,ANSSI-CC-2014/58,None,None,None -8e713eb632acc712,BSI-DSZ-CC-0782-V4-2018,None,None,None -8ee7145a1b48b578,ANSSI-CC-2017/76,None,None,None -8ee7145a1b48b578,BSI-DSZ-CC-0891-V4-2019,None,None,None -8f7cc0f456186028,BSI-DSZ-CC-0203-2003,None,None,None -8f7cc0f456186028,BSI-DSZ-CC-0205-2003,None,None,None -8f7e22207cb3dd8b,ANSSI-CC-2014/06,None,None,None -8f7e22207cb3dd8b,BSI-DSZ-CC-0829-2012,None,None,None -8f81bb35e37f1b4c,ANSSI-CC-2021/29,None,None,None -8f81bb35e37f1b4c,BSI-DSZ-CC-1107-2020,None,None,None -902dbd430adb77a5,BSI-DSZ-CC-0869-V2-2019,None,None,None -902dbd430adb77a5,BSI-DSZ-CC-0891-V3-2018,None,None,None -915e919390e6f58b,ANSSI-CC-2015/59,None,None,None -921ecc7c3e5f4884,BSI-DSZ-CC-0309-2006,None,None,None -9231adbf747903df,ANSSI-CC-2012/27,None,None,None -925da3b468003e72,ANSSI-CC-2021/35-R01,None,None,None -925da3b468003e72,NSCIB-CC-0530096-CR,None,None,None -9292ab2134e8a712,BSI-DSZ-CC-0827-V7-2018,None,None,None -9292ab2134e8a712,BSI-DSZ-CC-1015-2017,None,None,None -9299f6cd8a266541,BSI-DSZ-CC-0404-2007,None,None,None -9299f6cd8a266541,BSI-DSZ-CC-0417-2008,None,None,None -92ae986997c1d45c,BSI-DSZ-CC-0977-2017,None,None,None -92ae986997c1d45c,BSI-DSZ-CC-1019-2017,None,None,None -92c7355f5ea28e52,CRP225,None,None,None -932cef2b9698dde8,BSI-DSZ-CC-0283-2006,None,None,None -9337ab9573b366c1,BSI-DSZ-CC-0329-2006,None,None,None -93f14cad1cb201fa,BSI-DSZ-CC-0827-V6-2017,None,None,None -940a18f62c79ffae,ANSSI-CC-2021/51,None,None,None -953e132dd43ec03f,BSI-DSZ-CC-1058-2018,None,None,None -9545f2b0b8b92c8d,BSI-DSZ-CC-0410-2007,None,None,None -9545f2b0b8b92c8d,BSI-DSZ-CC-0527-2008,None,None,None -95774db1eb19b767,ANSSI-CC-2018/27,None,None,None -95c52fa37ef1eb3b,BSI-DSZ-CC-0791-2012,None,None,None -96106c2d31eea8b2,BSI-DSZ-CC-1039-2017,None,None,None -966a03f9f111aa35,ANSSI-CC-2021/42,None,None,None -966a03f9f111aa35,BSI-DSZ-CC-1107-V2-2021,None,None,None -96b0895b9f712d2f,BSI-DSZ-CC-0410-2007,None,None,None -96b0895b9f712d2f,BSI-DSZ-CC-0518-2008,None,None,None -96c685a3cdd9ed59,BSI-DSZ-CC-0510-2008,None,None,None -96c904c81aa2a241,ANSSI-CC-2017/07,None,None,None -96c904c81aa2a241,BSI-DSZ-CC-0891-V2-2016,None,None,None -975dae6e02765a90,ANSSI-CC-2009/63,None,None,None -977b04d04def60a7,ANSSI-CC-2019/28,None,None,None -97eb8171b51f9aad,BSI-DSZ-CC-0944-2014,None,None,None -97eb8171b51f9aad,BSI-DSZ-CC-0963-V2-2017,None,None,None -97f302708066dc04,BSI-DSZ-CC-0639-2010,None,None,None -981f7ea91d7bdcb6,ANSSI-CC-2014/06,None,None,None -981f7ea91d7bdcb6,BSI-DSZ-CC-0837-2013,None,None,None -983d431922822165,BSI-DSZ-CC-0837-2013,None,None,None -98642c6f99438194,ANSSI-CC-2020/04,None,None,None -988394e53c8e52d9,BSI-DSZ-CC-0976-V3-2019,None,None,None -988394e53c8e52d9,BSI-DSZ-CC-1110-V3-2020,None,None,None -98a578f7758bb518,BSI-DSZ-CC-0438-2007,None,None,None -9938be53082a02e6,NSCIB-CC-16-99111,None,None,None -994a2bf994b4facd,ANSSI-CC-2010/02,None,None,None -994a2bf994b4facd,ANSSI-CC-2012/68,None,None,None -994a2bf994b4facd,ANSSI-CC-2015/16,None,None,None -996691f0e03e303d,BSI-DSZ-CC-0555-2009,None,None,None -997281c99ac93b3b,ANSSI-CC-2010/03,None,None,None -997281c99ac93b3b,ANSSI-CC-2010/04,None,None,None -9973eb31c46f8637,ANSSI-CC-2010/08,None,None,None -9973eb31c46f8637,ANSSI-CC-2011/67,None,None,None -9ac6a8bda4fb7dc4,BSI-DSZ-CC-0751-2013,None,None,None -9ac6a8bda4fb7dc4,BSI-DSZ-CC-0813-2012,None,None,None -9ae7edbd0444982d,BSI-DSZ-CC-0837-V2-2014,None,None,None -9b30bcdbccfd4c68,BSI-DSZ-CC-0740-2011,None,None,None -9ba1fa1ae8c3ae67,ANSSI-CC-2016/65,None,None,None -9be0c86102117436,ANSSI-CC-2021/35-R01,None,None,None -9be76c10474e0c80,BSI-DSZ-CC-0758-2012,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0404-2007,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0410-2007,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0555-2009,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0633-2010,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0674-2011,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0675-2011,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0680-2010,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0709-2010,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0710-2010,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0730-2011,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0798-2012,None,None,None -9cc6c08cbaa694f2,BSI-DSZ-CC-0799-2012,None,None,None -9d36f8ab4e1b45dc,BSI-DSZ-CC-0324-2006,None,None,None -9e55246befe96fb4,ANSSI-CC-2010/01,None,None,None -9e7c513fdd35df17,ANSSI-CC-2010/40,None,None,None -9e7c513fdd35df17,ANSSI-CC-2011/64,None,None,None -9e7c513fdd35df17,BSI-DSZ-CC-0555-2009,None,None,None -9e7c513fdd35df17,BSI-DSZ-CC-0645-2010,None,None,None -9f400f89490fb8d5,BSI-DSZ-CC-0813-2012,None,None,None -9f8c9a3aa64a9f8e,ANSSI-CC-2019/01,None,None,None -a00e93f2981ef418,CRP292,None,None,None -a0fff0700364df49,BSI-DSZ-CC-0829-V2-2015,None,None,None -a0fff0700364df49,BSI-DSZ-CC-0952-2014,None,None,None -a14f221cf1761a8c,ANSSI-CC-2015/15,None,None,None -a14f221cf1761a8c,BSI-DSZ-CC-0845-V2-2013,None,None,None -a191b2da409f3518,BSI-DSZ-CC-0410-2007,None,None,None -a191b2da409f3518,BSI-DSZ-CC-0521-2008,None,None,None -a289b9d43310182b,BSI-DSZ-CC-0973-2016,None,None,None -a289b9d43310182b,BSI-DSZ-CC-0973-V2-2016,None,None,None -a29d46ab6efee468,BSI-DSZ-CC-0837-V2-2014,None,None,None -a2a5ccdf0846ce67,BSI-DSZ-CC-0460-2008,None,None,None -a2cbd066271b6b3b,BSI-DSZ-CC-0586-2009,None,None,None -a334142059d865a2,ANSSI-CC-2017/75,None,None,None -a334142059d865a2,ANSSI-CC-2018/61,None,None,None -a35ed74b7ea3ec4b,ANSSI-CC-2012/68,None,None,None -a3d152e25f8ce6c9,BSI-DSZ-CC-0870-2014,None,None,None -a465a767ceb7fd30,BSI-DSZ-CC-1015-2017,None,None,None -a49706f436a6873d,ANSSI-CC-2012/22,None,None,None -a49706f436a6873d,ANSSI-CC-2013/36,None,None,None -a5451ba38050a44d,BSI-DSZ-CC-0400-2007,None,None,None -a57845715134651a,BSI-DSZ-CC-1040-2019,None,None,None -a5898123ec124b34,ANSSI-CC-2015/36,None,None,None -a5898123ec124b34,ANSSI-CC-2015/80,None,None,None -a5898123ec124b34,ANSSI-CC-2016/43,None,None,None -a5898123ec124b34,ANSSI-CC-2016/44,None,None,None -a596f2412c0f8fe2,BSI-DSZ-CC-0808-2013,None,None,None -a596f2412c0f8fe2,BSI-DSZ-CC-0845-2012,None,None,None -a596f2412c0f8fe2,BSI-DSZ-CC-0885-2013,None,None,None -a5e8267322d0d7a6,ANSSI-CC-2010/40,None,None,None -a5e8267322d0d7a6,ANSSI-CC-2011/64,None,None,None -a5e8267322d0d7a6,BSI-DSZ-CC-0555-2009,None,None,None -a5e8267322d0d7a6,BSI-DSZ-CC-0645-2010,None,None,None -a64e6bf63ab6a299,ANSSI-CC-2013/32,None,None,None -a64e6bf63ab6a299,BSI-DSZ-CC-0829-2012,None,None,None -a67919286833a7df,BSI-DSZ-CC-0918-V2-2021,None,None,None -a67919286833a7df,BSI-DSZ-CC-0957-V2-2016,None,None,None -a6c1dd30884a197c,ANSSI-CC-2010/08,None,None,None -a76054a284f0ce61,ANSSI-CC-2014/86,None,None,None -a76054a284f0ce61,BSI-DSZ-CC-0837-V2-2014,None,None,None -a851c3b4377f4923,ANSSI-CC-2011/07,None,None,None -a9004216663480de,BSI-DSZ-CC-0782-V2-2015,None,None,None -a925d8f1adc5cfe2,BSI-DSZ-CC-0891-V3-2018,None,None,None -a925d8f1adc5cfe2,BSI-DSZ-CC-1001-2018,None,None,None -a925d8f1adc5cfe2,BSI-DSZ-CC-1033-2019,None,None,None -a925d8f1adc5cfe2,BSI-DSZ-CC-1034-2019,None,None,None -a93edea77d9f3338,BSI-DSZ-CC-0410-2007,None,None,None -a9f542d8e2be69fd,BSI-DSZ-CC-0782-2012,None,None,None -aa0213dd9f727219,BSI-DSZ-CC-0782-2012,None,None,None -aa0213dd9f727219,BSI-DSZ-CC-0879-2014,None,None,None -aa3f466daa34d3ff,BSI-DSZ-CC-0377-2007,None,None,None -aadbb9992a672a1b,ANSSI-CC-2019/01,None,None,None -ab769495f97aab9c,BSI-DSZ-CC-0879-V3-2018,None,None,None -ab88698a0c6ee1bb,BSI-DSZ-CC-0640-2010,None,None,None -ab8cf6af80a5c0e0,ANSSI-CC-2017/49,None,None,None -abef2b316c54f9e7,BSI-DSZ-CC-0978-2016,None,None,None -ac1257069b2f4afd,BSI-DSZ-CC-1113-V2-2021,None,None,None -ac4687f4b15507b6,ANSSI-CC-2014/58,None,None,None -ac4687f4b15507b6,ANSSI-CC-2014/59,None,None,None -acee5f619f09bf79,2015-27-INF-1539,None,None,None -ad2351479ff6ee84,ANSSI-CC-2009/61,None,None,None -ad2351479ff6ee84,ANSSI-CC-2010/02,None,None,None -ad2351479ff6ee84,ANSSI-CC-2010/29,None,None,None -adb678f7143014a0,ANSSI-CC-2015/15,None,None,None -adb678f7143014a0,BSI-DSZ-CC-0845-V2-2013,None,None,None -adc6971cdb0613b0,ANSSI-CC-2011/10,None,None,None -adc6971cdb0613b0,BSI-DSZ-CC-0523-2008,None,None,None -adc6971cdb0613b0,BSI-DSZ-CC-0626-2009,None,None,None -adc9df2489ce090a,BSI-DSZ-CC-0891-V4-2019,None,None,None -adc9df2489ce090a,BSI-DSZ-CC-1033-2019,None,None,None -adc9df2489ce090a,BSI-DSZ-CC-1034-V2-2021,None,None,None -adc9df2489ce090a,BSI-DSZ-CC-1105-2020,None,None,None -ae175aa839dbf692,NSCIB-CC-217812-CR3,None,None,None -ae9574428bd713e6,BSI-DSZ-CC-0891-V3-2018,None,None,None -ae9574428bd713e6,BSI-DSZ-CC-0995-2018,None,None,None -ae9574428bd713e6,BSI-DSZ-CC-1034-2019,None,None,None -aeb79c7e573de0e5,ANSSI-CC-2014/14,None,None,None -aeb79c7e573de0e5,ANSSI-CC-2014/86,None,None,None -aeb79c7e573de0e5,BSI-DSZ-CC-0837-2013,None,None,None -aeb79c7e573de0e5,BSI-DSZ-CC-0837-V2-2014,None,None,None -aeb79c7e573de0e5,BSI-DSZ-CC-0845-2012,None,None,None -af373587f2c57a24,BSI-DSZ-CC-0262-2005,None,None,None -af373587f2c57a24,CCEVS-VR-05-0131,None,None,None -af4c9b6e93062fde,ANSSI-CC-2010/03,None,None,None -af4c9b6e93062fde,ANSSI-CC-2017/47,None,None,None -af4c9b6e93062fde,ANSSI-CC-2017/49,None,None,None -af4c9b6e93062fde,BSI-DSZ-CC-0955-V2-2016,None,None,None -af4c9b6e93062fde,BSI-DSZ-CC-0973-V2-2016,None,None,None -af58ba642f4fc3d2,BSI-DSZ-CC-0891-V3-2018,None,None,None -af58ba642f4fc3d2,BSI-DSZ-CC-0980-2017,None,None,None -af78198822da03a7,ANSSI-CC-2010/03,None,None,None -afcf1165734847de,BSI-DSZ-CC-0207-2003,None,None,None -afe441f40a42865e,BSI-DSZ-CC-0902-2017,None,None,None -b0fd694500bfffab,BSI-DSZ-CC-0234-2004,None,None,None -b12b4e4eacad1497,BSI-DSZ-CC-0399-2007,None,None,None -b12b4e4eacad1497,BSI-DSZ-CC-0445-2007,None,None,None -b1401488f998c1f0,BSI-DSZ-CC-1136-2021,None,None,None -b15c099c68671895,ANSSI-CC-2017/49,None,None,None -b168db2651cbc1d6,ANSSI-CC-2010/02,None,None,None -b168db2651cbc1d6,ANSSI-CC-2012/69,None,None,None -b1b04d862f4c32af,BSI-DSZ-CC-0349-2006,None,None,None -b1b385d5bad724ed,BSI-DSZ-CC-1081-2020,None,None,None -b21be5dd6fdec83b,BSI-DSZ-CC-0965-2015,None,None,None -b2436dcf1c8e5dc5,BSI-DSZ-CC-0482-2008,None,None,None -b2436dcf1c8e5dc5,BSI-DSZ-CC-0528-2008,None,None,None -b24a14935edd51ad,BSI-DSZ-CC-0645-2010,None,None,None -b24a14935edd51ad,BSI-DSZ-CC-0750-2011,None,None,None -b252ff42ce0b7443,BSI-DSZ-CC-1040-2019,None,None,None -b2ba4d07e03b47ea,BSI-DSZ-CC-1178-V2-2022,None,None,None -b3855f3a6c06c01c,BSI-DSZ-CC-0645-2010,None,None,None -b4768c31e98b2170,BSI-DSZ-CC-0782-2012,None,None,None -b47b457f73c42c60,BSI-DSZ-CC-0918-2020,None,None,None -b47b457f73c42c60,BSI-DSZ-CC-0957-V2-2016,None,None,None -b49efd086851f84d,ANSSI-CC-2013/29,None,None,None -b49efd086851f84d,BSI-DSZ-CC-0555-2009,None,None,None -b49efd086851f84d,BSI-DSZ-CC-0645-2010,None,None,None -b4fc6a7b6c200b1b,BSI-DSZ-CC-1109-2019,None,None,None -b584e424a8b3dabe,BSI-DSZ-CC-0907-2013,None,None,None -b5968cd571a14cf3,BSI-DSZ-CC-0760-2013,None,None,None -b5968cd571a14cf3,BSI-DSZ-CC-0813-2012,None,None,None -b5985efd378af972,BSI-DSZ-CC-0897-V2-2014,None,None,None -b5b8bd0cb8bb7658,ANSSI-CC-2010/02,None,None,None -b5b8de155e4e40e6,ANSSI-CC-2015/36,None,None,None -b5b8de155e4e40e6,ANSSI-CC-2015/80,None,None,None -b644b78aafc367b0,BSI-DSZ-CC-0687-2011,None,None,None -b6a96b0dcf6eadf0,BSI-DSZ-CC-0955-V2-2016,None,None,None -b6c15035f759ec50,BSI-DSZ-CC-0269-2006,None,None,None -b6c3a9d53b9e784a,BSI-DSZ-CC-0750-V2-2014,None,None,None -b6c3a9d53b9e784a,NSCIB-CC-13-37760-CR2,None,None,None -b6e60b9025d116e4,ANSSI-CC-2014/46,None,None,None -b7132fe23fbdf9e1,BSI-DSZ-CC-0434-2007,None,None,None -b7132fe23fbdf9e1,BSI-DSZ-CC-0489-2008,None,None,None -b7209eec8fe7fc58,ANSSI-CC-2009/39,None,None,None -b764f5d5391e431e,BSI-DSZ-CC-0479-2008,None,None,None -b764f5d5391e431e,BSI-DSZ-CC-0482-2008,None,None,None -b804c318fc0c1e9b,BSI-DSZ-CC-0465-2008,None,None,None -b804c318fc0c1e9b,BSI-DSZ-CC-0550-2008,None,None,None -b82b48b0e915aaac,BSI-DSZ-CC-0169-2002,None,None,None -b883e389d34b1bb1,BSI-DSZ-CC-0410-2007,None,None,None -b883e389d34b1bb1,BSI-DSZ-CC-0417-2008,None,None,None -b883e389d34b1bb1,BSI-DSZ-CC-0521-2008,None,None,None -b887b7dcd6f1fdbb,BSI-DSZ-CC-0234-2004,None,None,None -b95f2b009d70fad1,BSI-DSZ-CC-0534-2009,None,None,None -b965c3b6a03aefc4,BSI-DSZ-CC-0348-2006,None,None,None -b99c572f58cfb19e,ANSSI-CC-2010/02,None,None,None -b99c572f58cfb19e,ANSSI-CC-2010/17,None,None,None -b99c572f58cfb19e,ANSSI-CC-2010/33,None,None,None -b9a6922899b66b8b,BSI-DSZ-CC-0813-2012,None,None,None -ba521df2c728c5a2,ANSSI-CC-2010/02,None,None,None -baead73ecc6e4a33,BSI-DSZ-CC-0421-2008,None,None,None -bb02df07a0d95e77,BSI-DSZ-CC-0322-2005,None,None,None -bb21cecb8bbfdf63,BSI-DSZ-CC-0269-2006,None,None,None -bb21cecb8bbfdf63,BSI-DSZ-CC-0376-2006,None,None,None -bb509db67c18bc40,BSI-DSZ-CC-0322-2005,None,None,None -bbc9a3a1d685d5f1,ANSSI-CC-2014/75,None,None,None -bc1452fff95744b9,BSI-DSZ-CC-0349-2006,None,None,None -bc25a76284e7c7ce,BSI-DSZ-CC-0782-2012,None,None,None -bc715a45d7584d95,BSI-DSZ-CC-0891-V2-2016,None,None,None -bd346dd3e46dff68,BSI-DSZ-CC-0639-2010,None,None,None -bdf8d5624e230986,BSI-DSZ-CC-0808-V2-2016,None,None,None -bdf8d5624e230986,BSI-DSZ-CC-0809-2013,None,None,None -bdf8d5624e230986,BSI-DSZ-CC-0978-2016,None,None,None -be9ca77bec616fe5,ANSSI-CC-2010/02,None,None,None -be9ca77bec616fe5,ANSSI-CC-2013/54,None,None,None -bec58e970e8cd6c8,BSI-DSZ-CC-0955-V2-2016,None,None,None -bf0f48ffd0dff903,BSI-DSZ-CC-0410-2007,None,None,None -bf0f48ffd0dff903,BSI-DSZ-CC-0463-2008,None,None,None -bf1338e9abe85c39,BSI-DSZ-CC-0410-2007,None,None,None -bff1330c13ccd99b,BSI-DSZ-CC-0293-2005,None,None,None -bff1330c13ccd99b,BSI-DSZ-CC-0346-2006,None,None,None -c06c7eb3afa4aea0,ANSSI-CC-2016/08,None,None,None -c10a3a62bf9fe782,BSI-DSZ-CC-1130-2021,None,None,None -c16f3dafab92df61,CCEVS-VR-05-0094,None,None,None -c1754dc2e7d666d8,BSI-DSZ-CC-0837-V2-2014,None,None,None -c18dc9f29967fe7f,BSI-DSZ-CC-0845-V2-2013,None,None,None -c1e14f36f031a342,BSI-DSZ-CC-1107-2020,None,None,None -c23218b044706800,BSI-DSZ-CC-0404-2007,None,None,None -c23218b044706800,BSI-DSZ-CC-0410-2007,None,None,None -c23218b044706800,BSI-DSZ-CC-0411-2007,None,None,None -c28289a45fc012a6,CRP210,None,None,None -c3dc8cfd97735115,BSI-DSZ-CC-0231-2004,None,None,None -c459c68e95d54f87,ANSSI-CC-2019/47,None,None,None -c459c68e95d54f87,ANSSI-CC-2020/26,None,None,None -c459c68e95d54f87,BSI-DSZ-CC-1059-2018,None,None,None -c459c68e95d54f87,BSI-DSZ-CC-1059-V3-2019,None,None,None -c483baec90d76587,BSI-DSZ-CC-0917-2014,None,None,None -c497da3fdb2f5027,ANSSI-CC-2017/49,None,None,None -c497da3fdb2f5027,BSI-DSZ-CC-1059-2018,None,None,None -c4ca6565698f0e49,BSI-DSZ-CC-1055-2018,None,None,None -c4e6a655a15144dd,BSI-DSZ-CC-0234-2004,None,None,None -c4f5a7748428e7d1,BSI-DSZ-CC-0349-2006,None,None,None -c518dd59d12daf17,BSI-DSZ-CC-0852-2013,None,None,None -c572cacbeb840621,BSI-DSZ-CC-0978-2016,None,None,None -c5bc8b961a199646,ANSSI-CC-2014/70,None,None,None -c621d1371b314913,BSI-DSZ-CC-0978-2016,None,None,None -c67724216ed5a318,BSI-DSZ-CC-0928-2018,None,None,None -c6c291cd525225b7,BSI-DSZ-CC-1025-2018,None,None,None -c8e381408b191a02,BSI-DSZ-CC-0410-2007,None,None,None -c8e381408b191a02,BSI-DSZ-CC-0417-2008,None,None,None -c8e381408b191a02,BSI-DSZ-CC-0575-2009,None,None,None -c8fc487eec95c21e,ANSSI-CC-2010/02,None,None,None -c902a788d699fe4a,SERTIT-003,None,None,None -c902a788d699fe4a,SERTIT-006,None,None,None -c96ac4c4015414ad,BSI-DSZ-CC-0782-V2-2015,None,None,None -ca1fa7c3f26bb3c5,BSI-DSZ-CC-0178-2003,None,None,None -ca63425a882729f3,BSI-DSZ-CC-0891-V4-2019,None,None,None -ca63425a882729f3,BSI-DSZ-CC-1033-V2-2021,None,None,None -ca63425a882729f3,BSI-DSZ-CC-1105-2020,None,None,None -ca88a34b0fcc5b0e,BSI-DSZ-CC-0280-2004,None,None,None -cb9a110799bc37f8,BSI-DSZ-CC-0954-2015,None,None,None -cbe5be4b63677c25,BSI-DSZ-CC-0752-2013,None,None,None -cc5a3d2a52f99ab3,ANSSI-CC-2018/25,None,None,None -cc5e2f58b681e555,BSI-DSZ-CC-0437-2008,None,None,None -cc5e2f58b681e555,BSI-DSZ-CC-0668-2010,None,None,None -cc64f3b8666b17bf,BSI-DSZ-CC-1072-2018,None,None,None -cc6918e95b803734,BSI-DSZ-CC-0891-V4-2019,None,None,None -cc6918e95b803734,BSI-DSZ-CC-1112-2020,None,None,None -cc932dbc293df39e,BSI-DSZ-CC-0973-2016,None,None,None -cc99b5d3806b1e97,ANSSI-CC-2016/66,None,None,None -cc99b5d3806b1e97,ANSSI-CC-2016/67,None,None,None -cc99b5d3806b1e97,BSI-DSZ-CC-0782-V2-2015,None,None,None -cc99b5d3806b1e97,BSI-DSZ-CC-0879-V2-2015,None,None,None -cce1a95634c6972b,BSI-DSZ-CC-0583-2009,None,None,None -cce214002aca738f,BSI-DSZ-CC-0897-V2-2014,None,None,None -cce214002aca738f,NSCIB-CC-16-99111,None,None,None -cd72fc2b62780a43,ANSSI-CC-2010/02,None,None,None -cd72fc2b62780a43,ANSSI-CC-2010/21,None,None,None -cdbbbad526f0aa13,BSI-DSZ-CC-1110-V4-2021,None,None,None -cdecc0eedcf05d2c,BSI-DSZ-CC-0285-2005,None,None,None -ce22219c2049985c,ANSSI-CC-2020/32,None,None,None -ce92195cf4a19084,BSI-DSZ-CC-0494-2008,None,None,None -cecb6a5d441fba98,BSI-DSZ-CC-0801-2012,None,None,None -cf1c544add4bf860,BSI-DSZ-CC-1137-2020,None,None,None -d063a93beba2dd65,BSI-DSZ-CC-0555-2009,None,None,None -d07b6e3036abb8f1,BSI-DSZ-CC-0645-2010,None,None,None -d07b6e3036abb8f1,BSI-DSZ-CC-0731-2011,None,None,None -d07b6e3036abb8f1,BSI-DSZ-CC-0741-2011,None,None,None -d07b6e3036abb8f1,BSI-DSZ-CC-0750-2011,None,None,None -d08b5ddedd34448d,ANSSI-CC-2018/35,None,None,None -d08b5ddedd34448d,BSI-DSZ-CC-0945-2017,None,None,None -d12a50d33b1c4253,CCEVS-VR-05-0094,None,None,None -d1fe94ee32cbbf05,BSI-DSZ-CC-0266-2005,None,None,None -d2bece2b0eebce5b,BSI-DSZ-CC-0879-V4-2020,None,None,None -d2bece2b0eebce5b,BSI-DSZ-CC-1071-V2-2019,None,None,None -d2d43918e5447c09,BSI-DSZ-CC-1156-V2-2021,None,None,None -d317c9c2e53ce427,BSI-DSZ-CC-0808-2013,None,None,None -d317c9c2e53ce427,BSI-DSZ-CC-0809-V2-2016,None,None,None -d317c9c2e53ce427,BSI-DSZ-CC-0978-2016,None,None,None -d32e5d4d5ff8b871,ANSSI-CC-2017/76,None,None,None -d32e5d4d5ff8b871,BSI-DSZ-CC-0891-V2-2016,None,None,None -d3323745a51a604d,BSI-DSZ-CC-0695-2011,None,None,None -d3323745a51a604d,BSI-DSZ-CC-0813-2012,None,None,None -d3323745a51a604d,BSI-DSZ-CC-0829-2012,None,None,None -d3420c2bf8974a5d,BSI-DSZ-CC-0782-V2-2015,None,None,None -d3420c2bf8974a5d,BSI-DSZ-CC-0967-2016,None,None,None -d34363168b1590bd,BSI-DSZ-CC-0964-V3-2017,None,None,None -d3987535a95fbffd,BSI-DSZ-CC-1040-2019,None,None,None -d3c2a59a2cffa30c,BSI-DSZ-CC-0555-2009,None,None,None -d3d257648d4c3105,ANSSI-CC-2010/02,None,None,None -d3d257648d4c3105,ANSSI-CC-2010/19,None,None,None -d3d257648d4c3105,ANSSI-CC-2010/56,None,None,None -d3d257648d4c3105,ANSSI-CC-2010/57,None,None,None -d4647f5217d84ba3,BSI-DSZ-CC-1040-2019,None,None,None -d4a1feebc1e1cb5d,BSI-DSZ-CC-0858-2013,None,None,None -d5187fc1cd590073,ANSSI-CC-2013/18,None,None,None -d67edade78d25033,ANSSI-CC-2009/27,None,None,None -d67edade78d25033,ANSSI-CC-2010/03,None,None,None -d69309b0a27c929c,BSI-DSZ-CC-1133-2020,None,None,None -d6ade0a63d0f9130,BSI-DSZ-CC-0897-V2-2014,None,None,None -d6ade0a63d0f9130,NSCIB-CC-12-36243-CR2,None,None,None -d6d129c94c368155,BSI-DSZ-CC-0217-2003,None,None,None -d71d0b082233758e,CRP260,None,None,None -d7501476836cf315,ANSSI-CC-2019/61,None,None,None -d75ff490c057793c,BSI-DSZ-CC-0727-2011,None,None,None -d80c26c2484dc87d,ANSSI-CC-2010/03,None,None,None -d9bfffa3cc6d1c53,BSI-DSZ-CC-0879-2014,None,None,None -da1139ecdc3512da,ANSSI-CC-2015/36,None,None,None -da2d3567a814d2d7,ANSSI-CC-2017/62,None,None,None -da2d3567a814d2d7,BSI-DSZ-CC-1059-V3-2019,None,None,None -da6845ee99cfa275,BSI-DSZ-CC-0266-2005,None,None,None -da6845ee99cfa275,BSI-DSZ-CC-0322-2005,None,None,None -da6845ee99cfa275,BSI-DSZ-CC-0399-2007,None,None,None -db28c1d7f201af1a,BSI-DSZ-CC-0640-2010,None,None,None -db28c203846775d8,ANSSI-CC-2014/06,None,None,None -db28c203846775d8,ANSSI-CC-2014/07,None,None,None -db28c203846775d8,BSI-DSZ-CC-0829-2012,None,None,None -db9267bdc717c801,BSI-DSZ-CC-0399-2007,None,None,None -db9267bdc717c801,BSI-DSZ-CC-0446-2007,None,None,None -dbbb56b48acbaf22,ANSSI-CC-2018/51,None,None,None -dbcf1311b3d95cdc,BSI-DSZ-CC-0332-2007,None,None,None -dbd62ef3bd952bad,BSI-DSZ-CC-0399-2007,None,None,None -dbe20d7c305b24eb,BSI-DSZ-CC-0750-V2-2014,None,None,None -dbe20d7c305b24eb,BSI-DSZ-CC-0858-2013,None,None,None -dbe20d7c305b24eb,NSCIB-CC-13-37762,None,None,None -dc51cf4e51f01086,NSCIB-CC-0351632-CR,None,None,None -dcd67613012044b3,BSI-DSZ-CC-0964-2015,None,None,None -dd4cfd03d9b3f25f,ANSSI-CC-2011/10,None,None,None -dd4cfd03d9b3f25f,BSI-DSZ-CC-0523-2008,None,None,None -dd4cfd03d9b3f25f,BSI-DSZ-CC-0626-2009,None,None,None -ddd9691cb063b07d,BSI-DSZ-CC-0973-V2-2016,None,None,None -ddd9691cb063b07d,BSI-DSZ-CC-0995-2018,None,None,None -ddd9691cb063b07d,BSI-DSZ-CC-0996-2018,None,None,None -de2ce0c1b72d5c90,BSI-DSZ-CC-0437-2008,None,None,None -de50abaf95e79d34,BSI-DSZ-CC-0813-2012,None,None,None -e0283686d26420d9,BSI-DSZ-CC-1021-2016,None,None,None -e0999b85d2f77733,BSI-DSZ-CC-0782-V2-2015,None,None,None -e0be32a08b66d264,BSI-DSZ-CC-0754-2012,None,None,None -e23f9c02819688f6,ANSSI-CC-2012/22,None,None,None -e247b50a301ce26c,BSI-DSZ-CC-1136-2021,None,None,None -e2a45ce49bb2b731,BSI-DSZ-CC-0829-2012,None,None,None -e2a45ce49bb2b731,BSI-DSZ-CC-0829-V2-2015,None,None,None -e3129aad84d5c40c,BSI-DSZ-CC-0837-V2-2014,None,None,None -e3231fac88242d81,BSI-DSZ-CC-0754-2012,None,None,None -e359ab2e436adf36,BSI-DSZ-CC-1040-2019,None,None,None -e359ab2e436adf36,BSI-DSZ-CC-1120-2020,None,None,None -e367ecaf05dacedb,BSI-DSZ-CC-0322-2005,None,None,None -e367ecaf05dacedb,BSI-DSZ-CC-0482-2008,None,None,None -e3a743ef04ecfb64,ANSSI-CC-2010/02,None,None,None -e4dc90de190437b8,CRP178,None,None,None -e4dc90de190437b8,CRP182,None,None,None -e501cafa3b025fb9,BSI-DSZ-CC-0750-2011,None,None,None -e501cafa3b025fb9,BSI-DSZ-CC-0858-2013,None,None,None -e501cafa3b025fb9,BSI-DSZ-CC-0866-2013,None,None,None -e501cafa3b025fb9,BSI-DSZ-CC-0866-V2-2014,None,None,None -e56d5d27cb2b3e6f,BSI-DSZ-CC-0403-2008,None,None,None -e56e14e8cbf89e3c,ANSSI-CC-2018/60,None,None,None -e56e14e8cbf89e3c,ANSSI-CC-2019/23,None,None,None -e5863682239df24b,BSI-DSZ-CC-0857-2013,None,None,None -e5b04a0a3872954f,ANSSI-CC-2011/07,None,None,None -e5b04a0a3872954f,ANSSI-CC-2012/48,None,None,None -e64266a9c13fc74e,ANSSI-CC-2014/81,None,None,None -e64266a9c13fc74e,BSI-DSZ-CC-0946-2014,None,None,None -e64266a9c13fc74e,BSI-DSZ-CC-0946-V2-2015,None,None,None -e64eedbb40d09a50,ANSSI-CC-2017/73,None,None,None -e6959c2b66202cb8,BSI-DSZ-CC-0891-V4-2019,None,None,None -e6aaffd588f2832e,ANSSI-CC-2013/56,None,None,None -e6aaffd588f2832e,ANSSI-CC-2014/83,None,None,None -e6dd3d435bd1b82e,BSI-DSZ-CC-0606-2010,None,None,None -e7a197d6aefb66df,BSI-DSZ-CC-0541-2010,None,None,None -e89a1a7817dae7e4,BSI-DSZ-CC-1089-2020,None,None,None -e8a37e48a8d34410,BSI-DSZ-CC-0466-2008,None,None,None -e8adf99d340489ce,ANSSI-CC-2017/76,None,None,None -e8adf99d340489ce,BSI-DSZ-CC-0891-V2-2016,None,None,None -e92ba97c2742e63d,ANSSI-CC-2019/33,None,None,None -e92ba97c2742e63d,ANSSI-CC-2020/26,None,None,None -e92ba97c2742e63d,BSI-DSZ-CC-1059-2018,None,None,None -e92ba97c2742e63d,BSI-DSZ-CC-1059-V3-2019,None,None,None -e93cb94a06c6957e,BSI-DSZ-CC-0964-V3-2017,None,None,None -e9845b4128afd538,BSI-DSZ-CC-1107-2020,None,None,None -e9c5d02aae54cdc5,BSI-DSZ-CC-0891-V4-2019,None,None,None -ea17788d9a9d12eb,CRP253,None,None,None -ea1b5ef156502d98,BSI-DSZ-CC-0862-2016,None,None,None -ea316d47c03f9fdf,BSI-DSZ-CC-0813-2012,None,None,None -ea330145d3ba738d,BSI-DSZ-CC-0322-2005,None,None,None -ea330145d3ba738d,BSI-DSZ-CC-0456-2009,None,None,None -ea4f0c0a7b82f526,BSI-DSZ-CC-0964-2015,None,None,None -eac2041efb4cf9f7,ANSSI-CC-2019/12,None,None,None -ec21d3c76c5ef65d,BSI-DSZ-CC-0904-V2-2021,None,None,None -ec21d3c76c5ef65d,BSI-DSZ-CC-1068-V2-2022,None,None,None -ec8a2a25cdbda634,ANSSI-CC-2020/07,None,None,None -ec8a2a25cdbda634,BSI-DSZ-CC-1110-V2-2019,None,None,None -ecee66b37d7576db,BSI-DSZ-CC-0244-2004,None,None,None -ed511caf8988dc45,BSI-DSZ-CC-0827-2013,None,None,None -ee35d872179a1397,BSI-DSZ-CC-0341-2006,None,None,None -ee35d872179a1397,BSI-DSZ-CC-0379-2006,None,None,None -ee3a996c18ace68e,BSI-DSZ-CC-0897-V2-2014,None,None,None -ee4e169753085913,BSI-DSZ-CC-0645-2010,None,None,None -ee4e169753085913,BSI-DSZ-CC-0682-2010,None,None,None -ee6718f7a7e3d30b,BSI-DSZ-CC-0266-2005,None,None,None -ee6718f7a7e3d30b,BSI-DSZ-CC-0338-2005,None,None,None -ef02bc67ebead2a2,BSI-DSZ-CC-0645-2010,None,None,None -ef02bc67ebead2a2,BSI-DSZ-CC-0675-2011,None,None,None -ef02bc67ebead2a2,BSI-DSZ-CC-0750-2011,None,None,None -f0bd6a29eee94a2c,ANSSI-CC-2018/08,None,None,None -f1300cb717ea9335,BSI-DSZ-CC-0900-2014,None,None,None -f14484e630df1dec,ANSSI-CC-2011/07,None,None,None -f14484e630df1dec,ANSSI-CC-2011/77,None,None,None -f14484e630df1dec,ANSSI-CC-2012/48,None,None,None -f14484e630df1dec,ANSSI-CC-2013/18,None,None,None -f1a73b2232787b26,ANSSI-CC-2010/02,None,None,None -f1a73b2232787b26,BSI-DSZ-CC-0664-2011,None,None,None -f1b9158cc2b98388,BSI-DSZ-CC-0782-2012,None,None,None -f1b9158cc2b98388,CRP279,None,None,None -f229a8078cb4ff82,BSI-DSZ-CC-1059-V2-2019,None,None,None -f2327302df1aa660,ANSSI-CC-2012/70,None,None,None -f2516946c797b1a0,ANSSI-CC-2013/42,None,None,None -f2516946c797b1a0,BSI-DSZ-CC-0829-2012,None,None,None -f2e7c6dfd6a431c8,BSI-DSZ-CC-0782-V5-2020,None,None,None -f2eb0ef953f3f147,ANSSI-CC-2015/45,None,None,None -f2eb0ef953f3f147,BSI-DSZ-CC-0782-V2-2015,None,None,None -f2fd56c195593dd8,ANSSI-CC-2020/94,None,None,None -f34df0dd7011366e,ANSSI-CC-2016/58,None,None,None -f34df0dd7011366e,ANSSI-CC-2017/61,None,None,None -f3bedaa5ffeeadb1,ANSSI-CC-2015/36,None,None,None -f4b4b026e87b5086,ANSSI-CC-2019/01,None,None,None -f4da9e13977580f4,BSI-DSZ-CC-0916-2015,None,None,None -f569fb2a6ddae452,BSI-DSZ-CC-0410-2007,None,None,None -f569fb2a6ddae452,BSI-DSZ-CC-0446-2007,None,None,None -f588fbe6fd36bc6b,BSI-DSZ-CC-0312-2005,None,None,None -f588fbe6fd36bc6b,BSI-DSZ-CC-0338-2005,None,None,None -f5a53fa6d2c3d9b2,ANSSI-CC-2017/11,None,None,None -f621ca835cf98a6d,BSI-DSZ-CC-0622-2012,None,None,None -f67f3737a3b47208,BSI-DSZ-CC-0782-2012,None,None,None -f68006f6c05e1211,BSI-DSZ-CC-0410-2007,None,None,None -f68006f6c05e1211,BSI-DSZ-CC-0411-2007,None,None,None -f731aaaab07bdca2,BSI-DSZ-CC-0973-2016,None,None,None -f731aaaab07bdca2,BSI-DSZ-CC-0973-V2-2016,None,None,None -f7941427d5fa40ea,BSI-DSZ-CC-0374-2006,None,None,None -f7cbb33cc639b5b5,BSI-DSZ-CC-0438-2007,None,None,None -f7cbb33cc639b5b5,BSI-DSZ-CC-0501-2008,None,None,None -f8a3fde3a557f44d,ANSSI-CC-2015/73,None,None,None -f8a3fde3a557f44d,BSI-DSZ-CC-0917-2014,None,None,None -f96bfb09bb1bd640,ANSSI-CC-2019/41,None,None,None -f96bfb09bb1bd640,ANSSI-CC-2020/07,None,None,None -f96bfb09bb1bd640,BSI-DSZ-CC-1110-V4-2021,None,None,None -f9d96d0eb2bc85cc,BSI-DSZ-CC-0750-V2-2014,None,None,None -f9d96d0eb2bc85cc,BSI-DSZ-CC-0858-2013,None,None,None -f9d96d0eb2bc85cc,BSI-DSZ-CC-0912-2014,None,None,None -f9d96d0eb2bc85cc,BSI-DSZ-CC-0913-2014,None,None,None -f9d96d0eb2bc85cc,BSI-DSZ-CC-0914-2014,None,None,None -f9d96d0eb2bc85cc,NSCIB-CC-13-37760-CR2,None,None,None -f9d9fe0dd9f7f110,BSI-DSZ-CC-0523-2008,None,None,None -f9e9366287e79e4d,BSI-DSZ-CC-0470-2008,None,None,None -f9fb8170cecedc23,BSI-DSZ-CC-1107-V3-2022,None,None,None -f9fb8170cecedc23,NSCIB-CC-0289060-CR,None,None,None -fa8384342c25ec59,BSI-DSZ-CC-0955-V2-2016,None,None,None -fb1fff87c87b82d6,ANSSI-CC-2012/70,None,None,None -fb1fff87c87b82d6,BSI-DSZ-CC-0894-2014,None,None,None -fb2cfdfef4f93536,BSI-DSZ-CC-0951-V2-2017,None,None,None -fb8010928a4bb56b,BSI-DSZ-CC-0837-V2-2014,None,None,None -fb8010928a4bb56b,BSI-DSZ-CC-0892-2014,None,None,None -fb8010928a4bb56b,BSI-DSZ-CC-0893-2014,None,None,None -fb8010928a4bb56b,NSCIB-CC-12-36243-CR2,None,None,None -fbdaf22c4f50391c,BSI-DSZ-CC-0891-V3-2018,None,None,None -fbe41655a05a01ff,BSI-DSZ-CC-0718-2012,None,None,None -fca98ecd003e1b82,ANSSI-CC-2009/11,None,None,None -fca98ecd003e1b82,BSI-DSZ-CC-0421-2008,None,None,None -fce7e01f2cd0cac0,ANSSI-CC-2011/10,None,None,None -fce7e01f2cd0cac0,ANSSI-CC-2011/12,None,None,None -fce7e01f2cd0cac0,BSI-DSZ-CC-0523-2008,None,None,None -fce7e01f2cd0cac0,BSI-DSZ-CC-0630-2010,None,None,None -fd3f988b7a505c45,BSI-DSZ-CC-0169-2002,None,None,None -fd583001a87023fd,BSI-DSZ-CC-0481-2008,None,None,None -fd583001a87023fd,BSI-DSZ-CC-0579-2009,None,None,None -fd583001a87023fd,CCEVS-VR-07-0054,None,None,None -fd966f807d3ba9fe,BSI-DSZ-CC-0813-2012,None,None,None -fd966f807d3ba9fe,BSI-DSZ-CC-0850-2013,None,None,None -ff0ffb9a32873433,BSI-DSZ-CC-0266-2005,None,None,None -ff0ffb9a32873433,BSI-DSZ-CC-0322-2005,None,None,None -ff45605151ec4eb1,ANSSI-CC-2013/39,None,None,None -ff45605151ec4eb1,BSI-DSZ-CC-0606-2010,None,None,None -ff45605151ec4eb1,BSI-DSZ-CC-0640-2010,None,None,None -ff45605151ec4eb1,BSI-DSZ-CC-0813-2012,None,None,None -ffc97a8fff838fa8,BSI-DSZ-CC-0266-2005,None,None,None -ffc97a8fff838fa8,BSI-DSZ-CC-0322-2005,None,None,None -ffc97a8fff838fa8,BSI-DSZ-CC-0538-2008,None,None,None -ffd213e55eee8cc8,BSI-DSZ-CC-0976-V2-2018,None,None,None -ffd213e55eee8cc8,BSI-DSZ-CC-1110-V2-2019,None,None,None -ffe4328dcdc6b538,BSI-DSZ-CC-0715-2011,None,None,None -fff289a66cb9ce4b,NSCIB-CC-0351632-CR,None,None,None diff --git a/src/sec_certs/data/reference_annotations/manual_annotations/train.csv b/src/sec_certs/data/reference_annotations/manual_annotations/train.csv deleted file mode 100644 index 2cab70dd..00000000 --- a/src/sec_certs/data/reference_annotations/manual_annotations/train.csv +++ /dev/null @@ -1,197 +0,0 @@ -dgst,canonical_reference_keyword,source,label,comment -00a2b91e5b58cef1,ANSSI-CC-2014/23,None,None,None -00ad121fa63e5dfb,BSI-DSZ-CC-0973-V2-2016,None,None,None -00ad121fa63e5dfb,BSI-DSZ-CC-0996-2018,None,None,None -00b539d629e60965,CCEVS-VR-02-0025,None,None,None -00eb3e5c7a4537b1,BSI-DSZ-CC-0322-2005,None,None,None -00eb3e5c7a4537b1,BSI-DSZ-CC-0399-2007,None,None,None -00efeb17bcaafce6,ANSSI-CC-2009/34,report,component_used,None -017f3cea8275a3e1,ANSSI-CC-2017/23,None,None,None -01ce6f422bec823d,BSI-DSZ-CC-1040-2019,None,None,None -01dc77d7f8f94d97,ANSSI-CC-2016/78,None,None,None -01dc77d7f8f94d97,ANSSI-CC-2017/39,None,None,None -01e5c6d31f763f56,BSI-DSZ-CC-0917-2014,None,None,None -01e8805514b4ef67,BSI-DSZ-CC-0891-V3-2018,report,component_used,None -0208e6b60a0b1a32,ANSSI-CC-2016/01,None,None,None -02c6fbcd90dcf05a,BSI-DSZ-CC-1107-V3-2022,None,None,None -02cb3c385865ad2c,BSI-DSZ-CC-1184-2022,None,None,None -0319b03323f257d1,BSI-DSZ-CC-1118-2020,None,None,None -0319b03323f257d1,BSI-DSZ-CC-1121-2019,None,None,None -032faef0207b715f,BSI-DSZ-CC-0837-V2-2014,None,None,None -037577fc2019fcfa,ANSSI-CC-2021/49,report,previous_version,None -04c5a5a66fb7f89a,BSI-DSZ-CC-0827-V2-2014,None,None,None -04cb360502da6492,BSI-DSZ-CC-0344-2005,None,None,None -054bd8196e015197,ANSSI-CC-2011/07,None,None,None -055985699aee1e09,ANSSI-CC-2010/02,report,component_used,None -05726637bd47a762,BSI-DSZ-CC-0891-V3-2018,report,component_used,None -05d96aada7bb839c,BSI-DSZ-CC-0223-2003,None,None,None -06b24bc51eb69188,BSI-DSZ-CC-0813-2012,None,None,None -06e505abb8dad1b8,ANSSI-CC-2017/54,report,component_used,None -06e70fa70393d60f,ANSSI-CC-2017/07,None,None,None -06e70fa70393d60f,BSI-DSZ-CC-0891-V2-2016,None,None,None -075ddd00e07fa7ed,ANSSI-CC-2020/76,None,None,None -075ddd00e07fa7ed,BSI-DSZ-CC-1136-2021,None,None,None -07ce7e4844f62c5c,ANSSI-CC-2017/73,None,None,None -07ce7e4844f62c5c,BSI-DSZ-CC-1070-2018,None,None,None -080aa6966d757f05,ANSSI-CC-2010/02,None,None,None -080aa6966d757f05,ANSSI-CC-2010/05,None,None,None -08408cbc394e7421,ANSSI-CC-2017/59,None,None,None -08408cbc394e7421,BSI-DSZ-CC-0782-V4-2018,None,None,None -09220515a7edf3f9,BSI-DSZ-CC-1110-V2-2019,None,None,None -096b05114ee5e09f,ANSSI-CC-2008/45,None,None,None -096b05114ee5e09f,BSI-DSZ-CC-0410-2007,None,None,None -096b05114ee5e09f,BSI-DSZ-CC-0411-2007,None,None,None -096ccb6bcb3d2731,BSI-DSZ-CC-0564-2009,None,None,None -09b07fbbb24e1b04,BSI-DSZ-CC-0964-2015,None,None,None -09f539aedefa9756,ANSSI-CC-2008/05,None,None,None -09f539aedefa9756,ANSSI-CC-2009/11,None,None,None -09f539aedefa9756,ANSSI-CC-2009/41,None,None,None -0a6e50445a906052,BSI-DSZ-CC-0891-V2-2016,None,None,None -0a6e50445a906052,BSI-DSZ-CC-0945-2017,None,None,None -0aad0176e35b3749,BSI-DSZ-CC-0477-2007,None,None,None -0b3e1cdf3ef9413d,BSI-DSZ-CC-0837-V2-2014,report,component_used,None -0bd651fcbb86f2a9,ANSSI-CC-2020/74,None,None,None -0bd651fcbb86f2a9,BSI-DSZ-CC-1136-2021,None,None,None -0bf7a19b22163465,ANSSI-CC-2015/80,report,evaluation_reused,None -0bf7a19b22163465,ANSSI-CC-2016/44,report,evaluation_reused,unclear whether component used -0c9e215997d96f44,BSI-DSZ-CC-0555-2009,None,None,None -0cd406e7c5013b74,BSI-DSZ-CC-0304-2006,None,None,None -0d4a95a8b52b787b,BSI-DSZ-CC-0829-2012,None,None,None -0da9d81c9f563df5,BSI-DSZ-CC-0382-2007,None,None,None -0ee132dec087b772,ANSSI-CC-2011/07,None,None,None -0ef56cba2362e463,ANSSI-CC-2015/42,None,None,None -0f1b31ac93459d1f,BSI-DSZ-CC-0720-2011,None,None,None -0f3900cdcd0c7f3e,NSCIB-CC-66030-CR5,report,component_used,None -0f684159ad31f883,BSI-DSZ-CC-0555-2009,None,None,None -0fe0bb1054f49b7f,CCEVS-VR-04-0092,None,None,None -0ff82b1cc24b3105,BSI-DSZ-CC-0302-2005,None,None,None -10233188161519ee,ANSSI-CC-2019/48,None,None,None -10233188161519ee,ANSSI-CC-2020/26,None,None,None -10233188161519ee,BSI-DSZ-CC-1059-2018,None,None,None -10233188161519ee,BSI-DSZ-CC-1059-V3-2019,None,None,None -102707a8c4d8a1b0,ANSSI-CC-2019/35,None,None,None -102707a8c4d8a1b0,ANSSI-CC-2020/26,None,None,None -102707a8c4d8a1b0,BSI-DSZ-CC-1059-2018,None,None,None -102707a8c4d8a1b0,BSI-DSZ-CC-1059-V3-2019,None,None,None -102bbdfcd696d7a9,ANSSI-CC-2018/13,None,None,None -102bbdfcd696d7a9,ANSSI-CC-2019/01,None,None,None -107c348f4ba0a41c,BSI-DSZ-CC-1135-2020,None,None,None -109eb2158ca6a2f9,BSI-DSZ-CC-0410-2007,None,None,None -10af4a6378d0fb7a,ANSSI-CC-2014/07,None,None,None -10af4a6378d0fb7a,ANSSI-CC-2014/86,None,None,None -10af4a6378d0fb7a,BSI-DSZ-CC-0837-V2-2014,None,None,None -10b17081dd7cad8f,ANSSI-CC-2015/36,None,None,None -10b17081dd7cad8f,ANSSI-CC-2017/39,None,None,None -112fe9f123e277ee,ANSSI-CC-2010/02,None,None,None -112fe9f123e277ee,ANSSI-CC-2010/19,None,None,None -114e39b4da949e6d,ANSSI-CC-2020/08,None,None,None -114e39b4da949e6d,BSI-DSZ-CC-1110-V2-2019,None,None,None -1172a88e009dc248,CRP257,None,None,None -1172a88e009dc248,CRP281,None,None,None -1188aebd8681e4fe,BSI-DSZ-CC-0465-2008,None,None,None -122245dd15683e26,ANSSI-CC-2007/08,None,None,None -122245dd15683e26,BSI-DSZ-CC-0269-2006,None,None,None -123c94418ddf1ad8,BSI-DSZ-CC-0367-2006,None,None,None -12e20466a0f08342,ANSSI-CC-2016/79,report,evaluation_reused,unclear whether component used -131ec924c42ef90b,ANSSI-CC-2017/61,None,None,None -135ca3602f0005bf,NSCIB-CC-16-99111-CR2,None,None,None -13d95239226aa537,BSI-DSZ-CC-0835-V2-2017,report,component_shared,"BAC, EAC thingy" -13e5b88ad3becb77,BSI-DSZ-CC-0322-2005,None,None,None -13e5b88ad3becb77,BSI-DSZ-CC-0344-2005,None,None,None -1468948b4f0509ab,BSI-DSZ-CC-0813-2012,None,None,None -157b741a0f529a0a,ANSSI-CC-2009/37,None,None,None -157f811757a0b29e,BSI-DSZ-CC-0555-2009,None,None,None -157f811757a0b29e,BSI-DSZ-CC-0633-2010,None,None,None -157f811757a0b29e,BSI-DSZ-CC-0675-2011,None,None,None -157f811757a0b29e,BSI-DSZ-CC-0745-2012,None,None,None -158950ed4bc35274,ANSSI-CC-2015/36,None,None,None -158950ed4bc35274,ANSSI-CC-2015/80,None,None,None -158950ed4bc35274,ANSSI-CC-2016/33,None,None,None -16bdbde359584f99,ANSSI-CC-2017/61,report,component_used,None -17a23970b35a4f44,BSI-DSZ-CC-0782-V5-2020,report,component_used,None -19c60923e31777e7,ANSSI-CC-2017/49,report,component_used,None -1b8705a0486b3be1,NSCIB-CC-0209053-CR,report,previous_version,None -1e40bd733acd56bc,BSI-DSZ-CC-0782-V4-2018,target,component_used,None -1f9f4b843070fc1b,BSI-DSZ-CC-1105-2020,report,component_used,None -27d11629261d8806,ANSSI-CC-2014/59,report,component_used,None -28e70f46ba4394dd,ANSSI-CC-2012/08,report,component_used,None -2c15dfc106ebf8d8,ANSSI-CC-2012/24,report,component_used,None -30120e4f3aa2f30a,BSI-DSZ-CC-0897-V2-2014,report,component_used,None -30f71b100c5cebae,ANSSI-CC-2015/15,report,component_used,None -317713948b4473b3,BSI-DSZ-CC-0798-2012,report,component_shared,None -34370b67b5e675c3,ANSSI-CC-2013/47,report,component_used,None -3515801dee00995f,BSI-DSZ-CC-0447-2008,report,recertification,This is a re-certification based on BSI-DSZ-CC-0447-2008 -36ed04f4b45e3ab9,BSI-DSZ-CC-0555-2009,report,component_used,None -371dca18821f7714,BSI-DSZ-CC-0945-2017,report,component_used,None -3f45ee333ce457bb,BSI-DSZ-CC-1002-2018,report,recertification,None -42799014c183e1b3,BSI-DSZ-CC-0312-2005,report,component_used,None -42799014c183e1b3,BSI-DSZ-CC-0429-2007,report,recertification,None -463ecd64b7506048,ANSSI-CC-2018/52,report,component_used,None -4a6100f1ddaef93b,BSI-DSZ-CC-0410-2007,report,component_used,None -4bede5d2af4cb11f,ANSSI-CC-2019/59,report,evaluation_reused,None -4f5f41ecf7517e63,ANSSI-CC-2016/80,report,evaluation_reused,None -54273dd266fce692,ANSSI-CC-2015/15,report,component_used,None -5a66027d34aafc52,BSI-DSZ-CC-1019-V2-2019,target,component_used,None -5f4b39feb2a82dac,BSI-DSZ-CC-0266-2005,target,component_used,unclear -61832cb4291c343f,BSI-DSZ-CC-0955-2016,report,component_used,None -627bfd69c2a831cf,ANSSI-CC-2014/37,report,evaluation_reused,None -680aeb0a20a9fed3,BSI-DSZ-CC-0870-2014,report,component_used,None -691119fe8a2f8e1c,BSI-DSZ-CC-0963-2015,report,component_used,None -6a999675c9422dfb,BSI-DSZ-CC-0353-2006,report,recertification,This is a re-certification based on BSI-DSZ-CC-0353-2006 -6eb6b29c45f6355f,BSI-DSZ-CC-0782-V4-2018,target,component_used,None -6f8d7a6a1dea6a3a,ANSSI-CC-2019/28,report,component_used,None -744a7a202d909323,ANSSI-CC-2017/24,report,component_used,None -7a8d4ed693d443d7,BSI-DSZ-CC-1128-V3-2021,report,recertification,None -845bb039719ac5d8,ANSSI-CC-2010/40,report,previous_version,None -84a75b6fc33b669e,ANSSI-CC-2014/08,report,evaluation_reused,None -8ba22f6c9651edc3,ANSSI-CC-2013/55,report,component_used,None -8bdb610131555c12,BSI-DSZ-CC-0645-2010,report,component_used,None -921e042759b30033,BSI-DSZ-CC-0978-2016,report,component_used,composition scheme “[COMP]” mentioned -9529eb793550093c,ANSSI-CC-2018/40,report,previous_version,None -97d00a9f198a6e57,ANSSI-CC-2015/66,report,component_used,None -a07548a64fac5794,BSI-DSZ-CC-0350-2007,report,recertification,None -a69ec271f8651d1b,BSI-DSZ-CC-1040-2019,report,component_used,None -a6fe8fe0aaf2fa92,ANSSI-CC-2018/26,report,previous_version,None -a76d1c0d9964d583,BSI-DSZ-CC-0417-2008,report,component_used,None -a867d281d34d34b7,BSI-DSZ-CC-0976-2015,report,recertification,None -a9d336b90e8b94a2,BSI-DSZ-CC-0410-2007,report,recertification,None -aa096ffde94b953b,BSI-DSZ-CC-0411-2007,report,component_used,None -ab3af998dff7a2ef,ANSSI-CC-2017/47,report,component_used,None -ab3af998dff7a2ef,BSI-DSZ-CC-0973-V2-2016,report,component_used,None -aea11fd4d2a7709d,BSI-DSZ-CC-0809-V3-2017,report,component_shared,The further security mechanism Basic Access Control is subject of the separate evaluation process BSI-DSZ-CC-0809-V3-2017 -af61a31e3fd0d6f0,ANSSI-CC-2010/02,report,evaluation_reused,None -b3b7ac7aae87793d,BSI-DSZ-CC-0945-V2-2018,None,None,unclear -b42009eb34746731,ANSSI-CC-2021/50,report,previous_version,maybe previous_version -b61363e51ed90c7a,ANSSI-CC-2019/12,report,component_used,None -bab97726875c0f14,BSI-DSZ-CC-0957-V2-2016,report,evaluation_reused,"unclear, mentions that this is a “re-evaluation” but not a “re-certification”" -c06d86db280f9b2b,BSI-DSZ-CC-0437-2008,report,component_used,None -c175537338906951,ANSSI-CC-2016/70,report,component_shared,None -c32378a010479b33,BSI-DSZ-CC-0891-V2-2016,report,evaluation_reused,None -c38734a9eeea0ff8,BSI-DSZ-CC-0950-V2-2018,None,None,"unclear, mentions just ToE delivery" -c5a60dbdb668bc10,BSI-DSZ-CC-0891-2015,report,recertification,None -c96343baf608174d,BSI-DSZ-CC-0645-2010,report,component_used,None -c96343baf608174d,BSI-DSZ-CC-0750-2011,report,component_used,None -cacdfdafce47678c,ANSSI-CC-2014/59,target,component_used,None -cfdacd53c732343c,BSI-DSZ-CC-1110-V2-2019,report,component_used,None -d2a4b8cb9ae7fe8f,BSI-DSZ-CC-1110-V4-2021,report,component_used,complicated situation where referenced cert is mentioned as recertification of some other cert -d2b0cb5a911b8ef8,BSI-DSZ-CC-0729-2011,report,recertification,None -d49988efd778ca9d,ANSSI-CC-2010/02,report,component_used,None -d75282fdda80b6fd,BSI-DSZ-CC-0609-2010,report,recertification,None -dba4b5a166f9456a,ANSSI-CC-2014/76,report,recertification,None -df6728b8420ab3b4,BSI-DSZ-CC-0827-V4-2016,report,component_used,None -e0265f0fb8e196c0,BSI-DSZ-CC-0827-V8-2020,None,None,unclear -e0b122da55f1f002,BSI-DSZ-CC-0961-V2-2018,report,recertification,None -e676143c80802a59,BSI-DSZ-CC-0891-V4-2019,report,component_used,the previously certified M7892 G12 component -e6e8add5e4db2d9d,BSI-DSZ-CC-0891-V4-2019,report,component_used,None -ea6d47427a2bb349,BSI-DSZ-CC-0782-2012,report,recertification,None -ead1076787fdd7e4,BSI-DSZ-CC-0399-2007,target,component_used,None -ecba01acba8df2ec,BSI-DSZ-CC-0555-2009,report,component_used,None -ecba01acba8df2ec,BSI-DSZ-CC-0633-2010,report,component_used,None -ed22d4c0f09c3e3a,BSI-DSZ-CC-0719-2011,report,recertification,None -ee1c6dd97918d74a,ANSSI-CC-2012/71,target,evaluation_reused,None -f17fe9ceea628f62,BSI-DSZ-CC-0750-V2-2014,report,component_used,None -f17fe9ceea628f62,BSI-DSZ-CC-0911-2014,report,component_shared,The Basic Access Control mechanism was subject of the evaluation process BSI-DSZ-CC-0911-2014 -f6579adcbf5faa99,BSI-DSZ-CC-1040-2019,target,component_used,None -f71fca5fc684df8b,BSI-DSZ-CC-0863-2013,report,recertification,This is a re-certification based on BSI-DSZ-CC-0863-2013 -f869956d14ea1694,ANSSI-CC-2012/68,report,component_used,None -fb9ec9e846ea4e87,ANSSI-CC-2017/47,report,component_used,None diff --git a/src/sec_certs/data/reference_annotations/manual_annotations/valid.csv b/src/sec_certs/data/reference_annotations/manual_annotations/valid.csv deleted file mode 100644 index e1896fe3..00000000 --- a/src/sec_certs/data/reference_annotations/manual_annotations/valid.csv +++ /dev/null @@ -1,108 +0,0 @@ -dgst,canonical_reference_keyword,source,label,comment -a21d17fd2d8b8edc,BSI-DSZ-CC-0813-2012,report,component_used,None -657f8d0cc39bbcdc,BSI-DSZ-CC-0946-2014,report,recertification,None -0efe2627f1ce8ac2,BSI-DSZ-CC-0351-2006,report,component_used,None -983d16512ae92d46,BSI-DSZ-CC-0891-V3-2018,report,recertification,None -8dd850c81b49a1f9,BSI-DSZ-CC-0697-2011,report,recertification,None -774cb0f28f7900f9,BSI-DSZ-CC-0232-2004,report,evaluation_reused,None -c37a9b7ae53093d8,CCEVS-VR-VID10256-2012,None,None,None -a5adb726852f5cc5,ANSSI-CC-2009/37,report,component_used,None -4d983357fd464bb5,BSI-DSZ-CC-1107-V2-2021,report,component_used,None -cc533c087f06ad0d,BSI-DSZ-CC-1040-2019,report,component_used,None -24de96ea505af909,ANSSI-CC-2021/29,report,component_used,None -2793414918738c7f,BSI-DSZ-CC-0857-2013,target,component_used,None -b402cb61be362e5f,BSI-DSZ-CC-0946-V2-2015,report,recertification,None -d96438a7165e5d82,BSI-DSZ-CC-0410-2007,report,component_used,None -4b3f577896c80f8a,ANSSI-CC-2015/80,report,evaluation_reused,None -22388445fe620ac0,ANSSI-CC-2014/20,report,evaluation_reused,None -2c2244c35d126bfb,BSI-DSZ-CC-0794-2011,report,recertification,None -6a85bb1d21a35e7d,BSI-DSZ-CC-0227-2004,report,component_used,None -120a49c0aa284f68,BSI-DSZ-CC-0813-2012,report,component_used,None -994ac7d986a99e50,BSI-DSZ-CC-0640-2010,report,component_used,None -16abf8ee0697e64f,ANSSI-CC-2014/61,report,component_shared,None -f05de4db911ec8af,CRP243,report,previous_version,None -38f79f1a48e7844f,ANSSI-CC-2017/47,report,component_used,None -fe55e99f4f3dc195,ANSSI-CC-2013/33,report,evaluation_reused,None -fc875e0381a28435,BSI-DSZ-CC-0432-2007,report,recertification,None -c23bb542201aa511,BSI-DSZ-CC-0829-2012,report,component_used,None -2532fe8c7214c485,BSI-DSZ-CC-0675-2011,report,component_shared,None -2cbc543a7c7de8b5,BSI-DSZ-CC-0813-2012,report,component_used,None -833ff87d69cff5db,383-4-184,None,None,unclear -c7c1215819127a1c,BSI-DSZ-CC-0322-2005,report,component_used,None -647d17d44745a532,BSI-DSZ-CC-0904-2015,report,recertification,None -4489bfc781a82281,BSI-DSZ-CC-0817-2013,report,recertification,None -94fb86d31446e531,BSI-DSZ-CC-0958-2015,report,component_used,None -37bae9eaf342542b,BSI-DSZ-CC-0349-2006,report,evaluation_reused,None -5c06e4fb1887fdc7,BSI-DSZ-CC-0782-V2-2015,report,component_used,None -5bf14a907f9a4c65,BSI-DSZ-CC-0527-2008,report,recertification,None -d314fa7ee445bd1d,BSI-DSZ-CC-0410-2007,report,component_used,None -0f53257eb74bee54,BSI-DSZ-CC-0417-2008,report,component_used,unclear -84d6a370e4f38ddc,ANSSI-CC-2019/12,report,component_used,None -1a5f86cb1d942c37,BSI-DSZ-CC-1110-2019,report,recertification,None -d696a9daccdb2a9f,BSI-DSZ-CC-1136-2021,report,component_used,None -38e7d62918a4f9b6,BSI-DSZ-CC-0688-2013,report,recertification,None -e6057ffc5085a192,ANSSI-CC-2014/48,report,evaluation_reused,None -db7627e56b8621b1,BSI-DSZ-CC-0639-2010,report,component_used,None -4b3f577896c80f8a,ANSSI-CC-2016/44,report,evaluation_reused,None -5f3c9c6bf76ba72d,ANSSI-CC-2018/51,report,component_used,None -22d6578b30f5a227,BSI-DSZ-CC-1107-2020,report,component_used,None -a0c38b4389ad7cf7,ANSSI-CC-2018/12,report,component_used,None -19c7a1b1a2df87d7,BSI-DSZ-CC-0945-V2-2018,report,component_used,None -f654c82bca57cf62,BSI-DSZ-CC-0957-V2-2016,None,None,unclear -2f0be9733140e2c6,BSI-DSZ-CC-0977-V2-2019,report,component_used,None -3357c28c91cc2ed1,ANSSI-CC-2016/44,report,evaluation_reused,None -f6317f134f532696,ANSSI-CC-2017/24,report,previous_version,None -234da54efbcf734b,BSI-DSZ-CC-0917-2014,report,component_used,None -1b20b1629ba7d3a6,ANSSI-CC-2012/72,target,component_used,None -2532fe8c7214c485,BSI-DSZ-CC-0633-2010,report,component_used,None -b1ef468658a9a0c1,NSCIB-CC-0448219-CR,report,evaluation_reused,None -35482ae218713d54,BSI-DSZ-CC-0951-V3-2018,report,recertification,None -edb3056f1838e6ae,BSI-DSZ-CC-0348-2006,report,evaluation_reused,"Quite weird, The evaluation was performed as a re-evaluation process based on BSI-DSZCC-0227-2004, BSI-DSZ-CC-0312-2005 and BSI-DSZ-CC-0348-2006. -Compared to BSI-DSZ-CC-0227-2004 the TOE was re-evaluated because of -technical and yield improvements. Compared to BSI-DSZ-CC-0348-2006 the -TOE was re-evaluated because of changes on top layers for modified module -packaging requirements. Additional package types (MOB4 and complete -passport inlay) and the relevant production sites were included in the evaluation -process. For production sites, results from BSI-DSZ-CC-0312-2005 were reused. The additional production steps do not influence the configuration of the -TOE itself. The Security Target was updated. " -3f2a6d4893c18634,NSCIB-CC-12-36243-CR2,report,component_used,None -0fe8df0e85116b61,ANSSI-CC-2010/33,report,previous_version,None -bbc41d7d09e40c0c,BSI-DSZ-CC-0404-2007,report,recertification,None -b00bb452e7a8176c,ANSSI-CC-2016/57,report,previous_version,None -7e58bfc14edf68e4,OCSI/CERT/TEC/01/2013/RC,report,recertification,None -81273108dd167b98,BSI-DSZ-CC-0523-2008,report,recertification,None -63c1045055ec3b58,BSI-DSZ-CC-0266-2005,report,component_used,None -a3c99646acb0bb6f,BSI-DSZ-CC-0837-V2-2014,report,component_used,None -4c017087976d05eb,ANSSI-CC-2020/45,report,evaluation_reused,None -f4d510a39278e687,ANSSI-CC-2018/32,report,component_used,None -c23bb542201aa511,ANSSI-CC-2014/14,report,previous_version,None -625b243397001f01,BSI-DSZ-CC-1059-2018,target,component_used,None -cae968d4926648bd,BSI-DSZ-CC-0754-2012,report,recertification,None -000176284683faa2,BSI-DSZ-CC-0640-2010,report,component_used,None -66faa094a9333d1a,ANSSI-CC-2014/86,report,evaluation_reused,None -a6dc46792d4e41c8,BSI-DSZ-CC-0203-2003,report,component_used,None -031667f4e242da61,CCEVS-VR-07-0054,report,component_used,None -459539da9315ccac,ANSSI-CC-2021/30,report,previous_version,None -69b15e884cc13c70,BSI-DSZ-CC-0891-V2-2016,report,component_used,None -a4bbf07046109fc9,BSI-DSZ-CC-0935-2015,report,component_used,None -50aef770cb4f028f,BSI-DSZ-CC-1059-V3-2019,report,component_used,None -5cf51622fafaf868,BSI-DSZ-CC-1005-2016,report,recertification,None -1e23ae421d7a2d01,BSI-DSZ-CC-0633-V2-2014,report,component_used,None -0c7ef6c32cbdee47,ANSSI-CC-2017/61,report,component_used,None -8928e191ee2fd3b9,BSI-DSZ-CC-0523-2008,report,component_used,None -6ed3cd21c6a2c9d0,BSI-DSZ-CC-1107-2020,report,component_used,None -4962c0d8106b8b5e,ANSSI-CC-2015/37,report,evaluation_reused,None -e6057ffc5085a192,BSI-DSZ-CC-0829-2012,report,component_used,None -03fad65e5af65088,BSI-DSZ-CC-0696-2011,report,recertification,None -720aab4f782f4c60,BSI-DSZ-CC-0555-2009,report,component_used,None -9664c0f0ec6401b9,BSI-DSZ-CC-0891-V2-2016,report,recertification,None -d55eb8c97d71e843,ANSSI-CC-2021/49,report,previous_version,None -73e0b884cd04d9bc,NSCIB-CC-12-36243,report,component_used,None -2793414918738c7f,BSI-DSZ-CC-0633-V2-2014,report,component_used,None -f6a89befd13a643f,BSI-DSZ-CC-0951-V4-2019,report,component_used,None -f00a01940be6481d,BSI-DSZ-CC-0837-V2-2014,report,component_used,None -2f43fe24bd8e91e1,ANSSI-CC-2020/65,report,component_used,None -d96438a7165e5d82,BSI-DSZ-CC-0411-2007,report,component_used,None -7623950728f52a71,ANSSI-CC-2016/06,report,component_used,None -ba69597434946260,BSI-DSZ-CC-0293-2005,report,component_used,None -50aef770cb4f028f,BSI-DSZ-CC-1059-2018,report,component_used,None diff --git a/src/sec_certs/data/reference_annotations/readme.md b/src/sec_certs/data/reference_annotations/readme.md index b3a240a9..8ed7eecd 100644 --- a/src/sec_certs/data/reference_annotations/readme.md +++ b/src/sec_certs/data/reference_annotations/readme.md @@ -4,6 +4,10 @@ This folder contains data and the methodology (presented below) related to learn - The folder [split](split) contains split of the CC Dataset to `train/valid/test` splits for learning. - The csv file [manually_annotated_references.csv](./manually_annotated_references.csv) contains manually acquired labels to references obtained with the methodology outlined below. +- The folder `adam` contains manual annotations created by Adam +- The folder `jano` contains manual annotations created by Jano +- The folder `conflicts` contains conflicting annotations between Adam and Jano, as weel as their resolution +- The contents of the `final` folder can thus be obtained by taking annotations either from `adam` or `jano` folder and masking them by `resolution_label` from `conflicts` folder. ### Reference taxonomy @@ -12,31 +16,27 @@ After manually inspecting random certificates, we have identified the following - **Component used**: The referenced certificate is a component used in the examined certificate (e.g., IC used by a smartcard). Some evaluation results were likely shared/re-used. - **Component shared**: The referenced certificate shares some components with the examined certificate. Some evaluation results were likely shared/re-used. - **Evaluation reused**: The evaluation results of the referenced certificate were used for evaluation of the examined certificate, due to reasons that could not be resolved. -- **Re-certification**: The examined certificate is a re-certification of the referenced certificate. +- **Recertification**: The examined certificate is a re-certification of the referenced certificate. - **Previous version**: The product in the referenced certificate is a previous version of the product in the examined certificate and the re-certification is not explicitly mentioned. -- **Unknown**: The annotator could not assign any of the previous contexts. +- **None**: The annotator could not assign any of the previous contexts. +- **Irrelevant**: The reference is irrelevant to the studied certificate (typo, left-out reference from a template, ...) These can be further merged into the following super-categories: -- **Component used or shared** -- **Previous version of re-certification** -- **Evaluation reused** - these cases should be manually visited -- **Unknown** +- **Some sub-component relationship** `component_used`, `component_shared`, and `evaluation_reused` +- **Previous version**: `previous_version` and `recertification` +- **None**: `None` or `irrelevant` ### Reference classification methodology **Data splits and manual annotations**: -1. Inspect random certificates (>100) and capture the observed relations into reference taxonomy -2. Split all certificates for which we register a direct outgoing reference in either security target or certification report into `train/valid/test` splits in `30/20/50` fashion. - - See [split](split/) -3. Label all references in as follows: - - Extract the text segments (using `ReferenceSegmentExtractor`) related to the references - - Use label-studio `Natural Language Processing -> text classification` setup to assign 1 label to each of the references. - - All text segments both from certification report and security target are displayed for the given instance - - The instances labeled with `Unknown` are re-visited and labeled after manual inspection of both certification report and security target pdfs - - Artifacts of the referenced certificate are not examined. - - The labeling is done by a pair of co-authors, the inter-annotator agreement is measured with Cohen's Kappa +1. Two authors inspect random certificates (~100) and capture the observed relations into reference taxonomy +2. Split all certificates for which we register a direct outgoing reference in either security target or certification report into `train/valid/test` splits in `30/20/50` fashion (see [split](split/)). +3. Sample 100 train, 100 valid, 200 test pairs of `(dgst, canonical_reference_keyword)` for manual annotations. +4. Two co-authors independently assign each of these pairs with a single label from the reference taxonomy. +5. Measure the inter-annotator agreement with Cohen's Kappa. +6. Resolve conflicts in the annotations in a meeting held by the co-authors. Use this consensual annotations for training and evaluation described below. **Learning the annotations**: |