aboutsummaryrefslogtreecommitdiffhomepage
path: root/sec_certs/dataset
Commit message (Collapse)AuthorAgeFilesLines
* flat -> src layout (#294)adamjanovsky2022-12-0911-3441/+0
| | | | | | - Some mypy fixes - Flat layout -> src layout - Ditch `setup.py` and `setup.cfg` in favour of `pyproject.toml` - Non-pinned requirements moved from `requirements/*.in` to `pyproject.toml`
* Refactor FIPS & unify CLI actions (#275)adamjanovsky2022-12-0810-1120/+1031
| | | | | | | | | | * Unifies CLIs into sine CLI * Merge much of dataset functionality into `Dataset` baseclass * Refactor `unittest` -> `pytest` * Unify processing pipeline across datasets (common public functions) * Unify and refactor processing of auxillary datasets (CPE, CVE, PP, Algorithms, ...) * Upgrade Github Actions pipelines * Allow for failure of some tests * Refactor type hints
* Fix IUT dataset path use.J08nY2022-10-211-1/+1
|
* Add temporal trends notebook to FIPS.J08nY2022-10-211-0/+32
|
* Add a way to get the full MIP and IUT datasets from web.J08nY2022-10-192-0/+32
|
* Fix FIPS references.J08nY2022-10-191-2/+3
|
* Merge branch 'main' into feat/eval-cpe-matchesAdam Janovsky2022-10-091-5/+5
|\
| * Move PP dataset URL.J08nY2022-10-071-5/+5
| | | | | | | | Fixes #269.
* | improve CPE matchingAdam Janovsky2022-10-091-9/+46
| |
* | prepare code for CPE manual evaluationAdam Janovsky2022-10-041-3/+5
|/
* Merge pull request #259 from ↵adamjanovsky2022-09-301-1/+1
|\ | | | | | | | | crocs-muni:feat/temporal-trends-notebook-improvements Temporal notebook iterative improvements
| * Merge branch 'main' into feat/temporal-trends-notebook-improvementsAdam Janovsky2022-09-271-168/+143
| |\
| * | start colleting EALs from PP datasetAdam Janovsky2022-09-131-1/+1
| | |
* | | Make DependencyFinder drop unknown refs in CC and FIPS dataset use.J08nY2022-09-272-3/+5
| |/ |/|
* | Do not reextract stuff in CC.J08nY2022-09-191-11/+0
| | | | | | | | | | This phase of the extraction process is deterministic so we simply lose time doing this.
* | Use canonicalized certificate IDs for reference lookup.J08nY2022-09-191-1/+7
| |
* | Add proper CC cert_id canonicalization.J08nY2022-09-191-22/+1
| |
* | Better sanitization for CC scheme downloads.J08nY2022-09-191-133/+134
| |
* | Fix source of cert_id in DependencyFinder.J08nY2022-09-191-1/+1
|/
* Strip entries in CC scheme downloads to cleanup entries.J08nY2022-08-011-115/+119
|
* switch wide to long/tidy format in temp notebookAdam Janovsky2022-07-291-1/+3
|
* finalize temporal trends notebookAdam Janovsky2022-07-291-0/+7
|
* Fix CC scheme download typo.J08nY2022-07-261-1/+1
|
* FIPS: Do not update_json in web_scan call.J08nY2022-07-171-1/+1
|
* Fix FIPSalgo serialization.J08nY2022-07-172-9/+6
|
* Use html5lib instead of html.parser.J08nY2022-07-163-6/+6
|
* Fix Malaysia scheme download.J08nY2022-07-161-47/+33
|
* Add Singapore, Sweden, Turkey and USA to scheme download.J08nY2022-07-131-1/+222
|
* Fix BSI scheme test.J08nY2022-07-131-8/+7
|
* Fix scheme download tests.J08nY2022-07-131-1/+3
|
* Add more schemes to collect data from.J08nY2022-07-131-2/+193
| | | | Adds Malaysia, Netherlands, Norway and Korea.
* Add download of certificate lists from scheme pages.J08nY2022-07-121-0/+359
| | | | Fixes #46, partially.
* FIPS: Make algorithms parsing deterministically serialize.J08nY2022-07-121-23/+10
|
* FIPS: Add clean_cert_ids and use them.J08nY2022-07-121-23/+17
| | | | | | | | | Adds two new data fields to the FIPSCertificate subobjects: pdf_data.clean_cert_ids and heuristics.clean_cert_ids. The pdf_data ones are cleaned cert_id rule matches from the security target. While the heuristics ones were also cleaned using the algorithm dataset by the FipsDataset class.
* FIPS: Extract ST metadata and store it.J08nY2022-07-111-9/+17
|
* FIPS: Fix #211.J08nY2022-07-111-8/+7
| | | | The connections need to be sourced from the References object.
* FIPS: Fix #210.J08nY2022-07-111-14/+11
| | | | | Moves algorithm download into "process_algorithms()" and calls it in the CLI.
* FIPS: Fix #213.J08nY2022-07-111-3/+0
| | | | | | The finalize_results was not really necessary, as the dataset does contain the results of dependency analysis (in the heuristics of each cert).
* FIPS: Rename FIPSHeuristics to Heuristics.J08nY2022-07-111-2/+2
|
* FIPS: Reorganize FIPSAlgorithm dataset.J08nY2022-07-112-42/+54
| | | | - Now conforms to the dataset API.
* FIPS: Move Algorithm class into a separate file.J08nY2022-07-111-1/+2
|
* FIPS: Remove unused constants, reorder methods.J08nY2022-07-112-26/+10
|
* FIPS: Rename cert objects to match CC.J08nY2022-07-101-30/+30
|
* FIPS: Add TODOs and remove unused methods.J08nY2022-07-091-13/+0
| | | | | | | - Moved FIPS_DOWNLOAD_DELAY to a constant in constants.py - Removed unused methods _match_algs() from FIPSDataset and match_web_algs_to_pdf() from FIPSCertificate. - Added a bunch of TODOs to harmonize FIPS to CC.
* FIPS: Remove unused fragments dir.J08nY2022-07-091-8/+1
|
* Remove bad prints.J08nY2022-07-051-1/+1
|
* Fix full extraction.J08nY2022-07-051-4/+4
|
* Fix FIPS reference collection.J08nY2022-07-051-1/+1
|
* Blacken and isort.J08nY2022-07-057-12/+15
|
* New fips cert id rue name.J08nY2022-07-051-4/+4
|