aboutsummaryrefslogtreecommitdiffhomepage
path: root/data/reference_annotations
diff options
context:
space:
mode:
authoradamjanovsky2023-02-23 13:03:53 +0100
committeradamjanovsky2023-02-23 13:03:53 +0100
commitc9c16140b9a54d98ac381d45d6d94ce5a51b1f69 (patch)
tree40c9775f31665732230c3910a11b420402275512 /data/reference_annotations
parent2cc17ac4134fc223e8bb0a2aed38e235a9ad3a7b (diff)
downloadsec-certs-c9c16140b9a54d98ac381d45d6d94ce5a51b1f69.tar.gz
sec-certs-c9c16140b9a54d98ac381d45d6d94ce5a51b1f69.tar.zst
sec-certs-c9c16140b9a54d98ac381d45d6d94ce5a51b1f69.zip
add note about self references
Diffstat (limited to 'data/reference_annotations')
-rw-r--r--data/reference_annotations/readme.md2
1 files changed, 2 insertions, 0 deletions
diff --git a/data/reference_annotations/readme.md b/data/reference_annotations/readme.md
index fbb3fd4a..c17c55dd 100644
--- a/data/reference_annotations/readme.md
+++ b/data/reference_annotations/readme.md
@@ -15,6 +15,7 @@ After manually inspecting random certificates, we have identified the following
- **Recertification**: The examined certificate is a re-certification of the referenced certificate.
- **Previous version**: The product in the referenced certificate is a previous version of the product in the examined certificate and the recertification is not explicitly mentioned.
- **On platform**: The examined certificate runs on a platform that is certified in the referenced certificate.
+- **Self**: The referenced certificate is the same as the examined certificate.
### Reference classification methodology
@@ -34,6 +35,7 @@ After manually inspecting random certificates, we have identified the following
- `target` if he/she decided purely based on the data from security target
- `report+target` if both artifacts were needed for resolution
- Note that this label is only internal, not intended to be used for research
+ - The label should be in lowercase letters with underscore, e.g., `evaluation_reused`.
- Artifacts of the referenced certificate are not examined.
- The labeling is done by a pair of co-authors, the inter-annotator agreement is measured with Cohen's Kappa