aboutsummaryrefslogtreecommitdiffhomepage
path: root/sec_certs/dataset.py
Commit message (Collapse)AuthorAgeFilesLines
* refactor folder strucureAdam Janovsky2021-04-191-1250/+0
|
* log->print on cpe promptAdam Janovsky2021-04-191-0/+1
|
* update type hint in CCDatasetAdam Janovsky2021-04-191-1/+2
|
* fix typo in dataset classAdam Janovsky2021-04-191-1/+1
|
* rename get -> computeAdam Janovsky2021-04-191-3/+3
|
* default update json when downloadingAdam Janovsky2021-04-161-1/+1
|
* remove dumb mistake in cpe labelingAdam Janovsky2021-04-161-3/+2
|
* minor UI improvements of manual cpe matchingAdam Janovsky2021-04-161-5/+9
|
* relaxing version if no good cpe match foundAdam Janovsky2021-04-161-7/+4
|
* improves pandas representationAdam Janovsky2021-04-161-3/+13
|
* CVE and CPE dataset serializationAdam Janovsky2021-04-161-18/+51
| | | | | | | | - Allows for fresh download of CPE and CVE dataset - Ties the aforementioned dataset to CCDataset - Fixes error in computation of related CVEs - Allows for computation of related CVEs only after verified CPEs are computed - CPEDataset has its special json representation as a list of CPE uris
* implements function for manual cpe match verificationAdam Janovsky2021-04-161-23/+34
|
* function to manually verify CPE matchesAdam Janovsky2021-04-151-1/+25
|
* delete stale fuzzy matching procedureAdam Janovsky2021-04-151-40/+0
|
* add deterministic cpe-cve matchingAdam Janovsky2021-04-151-1/+14
|
* serialize non ascii characters to preserve link functionalityAdam Janovsky2021-04-151-1/+1
|
* set test csv file to windows-1252 encodingAdam Janovsky2021-04-151-1/+1
|
* cc demo contains heuristicsAdam Janovsky2021-04-141-2/+5
|
* moves CPE matching from notebook to pythonAdam Janovsky2021-04-141-2/+16
|
* move cpe match under heuristics fieldAdam Janovsky2021-04-131-1/+12
|
* add class for capturing heuristicly obtained dataAdam Janovsky2021-04-131-6/+10
|
* jupyter PoC for CPE matchingAdam Janovsky2021-03-251-5/+17
|
* Algorithm matching + saner usage (#43)Stanislav Boboň2021-03-201-81/+118
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * fixed continuous adding certs * little push * date * added switches * json file + formatting + match algs * matching algs * moved downloading of algorithms, boolean switch and logging * parsing rules to match random matches * Description match fix * removed unnecessary check for web redo * match_algs sane + web redo * processing always from scratch, redo wipes web * nist pages seem a bit... slower * download htmls twice + small cleanup * added weirdly shaped "-" * added matching web algs to pdf * redo quick fix * security functions included in table finding * saner logging * repeated downloading now just works :tm: * redo in demo + matching algs demo * moved plotting and parsing to helpers * removed dependency Co-authored-by: Stanislav Boboň <xbobon@fi.muni.cz>
* adds pandas serializaitonAdam Janovsky2021-03-021-0/+5
|
* Implements alpha version of cpe fuzzy matchingAdam Janovsky2021-03-021-1/+30
|
* hotfixAdam Janovsky2021-02-241-1/+1
|
* adds implicit dataset serializationAdam Janovsky2021-02-241-4/+20
|
* Error messages of certificate are now serializedAdam Janovsky2021-02-241-0/+2
| | | | - Stored as a part of InternalState complex variable in json
* dgst is serialized as a field in certificateAdam Janovsky2021-02-231-2/+2
| | | | | - Previously as a part of dataset where certs changed to dictionary - For rendering at webserver, list is more convenient
* Serialize digest of the certificateAdam Janovsky2021-02-221-2/+2
|
* Introduce state variable of CCDatasetAdam Janovsky2021-02-201-22/+72
| | | | | | - The variable checks which actions were already performed - Dataset now checks if someone attempts to e.g. convert pdf->txt prior to downloading - Also, operations on certificates are performed only on those certs for which the preceeding operation was successful
* Add explicit certificate status active/archivedAdam Janovsky2021-02-201-4/+14
| | | | | | | - Status active or archived held as a string variable - Instead of implicit computation from not-valid-before/after - The status is computed from the filename of the csv/html source - The status is serialized into json
* Plug-in old extractions methods to new OOP frameAdam Janovsky2021-02-191-7/+53
| | | | | | | | - Tests for txt file processing still missing - The internals of the txt processing methods are still authored by petrs - They are however fully parallel and called in an OOP fashion - Overall, all results are gathered in a single json file - All results are implicitly paired
* Fix in Web source parsing, pdf metadata parsingAdam Janovsky2021-02-191-5/+35
| | | | | | - Rows of csv that are corrupted are now skipped and logged - Links from csv and html are now identical and thus correctly matched - Implements extraction of pdf metadata from ST and reports
* fixed requestsStanislav Boboň2021-02-131-6/+3
|
* yaml + saner configurationStanislav Boboň2021-02-121-4/+4
|
* group vendors with more sanityStanislav Boboň2021-02-121-3/+4
|
* web/pdf/processed + html tagsStanislav Boboň2021-02-081-43/+58
|
* rules as constantsStanislav Boboň2021-02-031-4/+3
|
* regexes overdoneStanislav Boboň2021-01-281-1/+11
|
* continuous downloading of alg pagesStanislav Boboň2021-01-211-1/+10
|
* common rules matchingStanislav Boboň2021-01-211-1/+1
|
* raw linksStanislav Boboň2021-01-161-1/+1
|
* settings addedStanislav Boboň2021-01-071-21/+21
|
* little changesStanislav Boboň2021-01-071-1/+2
|
* datetime in validationsStanislav Boboň2020-12-291-4/+4
|
* small improvementsStanislav Boboň2020-12-291-4/+4
|
* magic constantStanislav Boboň2020-12-271-1/+2
|
* types + cleanupStanislav Boboň2020-12-271-16/+13
|
* default parametersStanislav Boboň2020-12-211-1/+1
|
generated by cgit v1.3.1 (git 2.54.0) at 2026-08-23 07:34:51 +0000