From 4b1f47a7243c1a0d4118107386440ffef53affb9 Mon Sep 17 00:00:00 2001 From: Adam Janovsky Date: Thu, 4 Nov 2021 08:58:42 +0100 Subject: move data readme --- data/validation_test_split/readme.md | 9 --------- 1 file changed, 9 deletions(-) delete mode 100644 data/validation_test_split/readme.md (limited to 'data/validation_test_split') diff --git a/data/validation_test_split/readme.md b/data/validation_test_split/readme.md deleted file mode 100644 index 623eb9af..00000000 --- a/data/validation_test_split/readme.md +++ /dev/null @@ -1,9 +0,0 @@ -## Dataset split into validation / test set - -To evaluate quality of our automatic matching of CPE names to certificates (which in turn allows us to assign CVEs to certificates), we manually evaluated candidate CPE records for all of the certificates both in FIPS and CC framework. - -Not to cause data leakage, prior to developing automatic method of CPE matching, we split the dataset into validation a test parts in 50:50 fashion. The automatic CPE matching was finetuned using the validation set and only then evaluated using the test set. - -This directory contains digests (primary keys of certificates) of the formed validation and test sets. The output present herein was produced with [validation_test_split.ipnyb](https://github.com/crocs-muni/sec-certs/tree/dev/notebooks/validation_test_split.ipynb). - -To see how the evaluation was performed, take a look at [cc_cpe_labeling.py](https://github.com/crocs-muni/sec-certs/blob/dev/examples/cc_cpe_labeling.py) and [fips_cpe_labeling.py](https://github.com/crocs-muni/sec-certs/blob/dev/examples/fips_cpe_labeling.py). \ No newline at end of file -- cgit v1.3.1