aboutsummaryrefslogtreecommitdiffhomepage
path: root/src/sec_certs/dataset
Commit message (Collapse)AuthorAgeFilesLines
* PPs: change dset filename pp.json -> dataset.jsonAdam Janovsky2025-02-133-4/+4
|
* fix dataset download description class nameAdam Janovsky2025-02-131-1/+1
|
* Fix PP and CC MU dataset path.J08nY2025-02-051-2/+2
| | | | | | | The subdir was being set twice, once in the CC dataset constructor and once in the AuxDatasetHandler itself. Resulting in paths like: CC root / auxiliary_datasets / protection_profiles / protection_profiles
* Add docs about dataset layout.J08nY2025-02-024-5/+73
|
* Fix overridden method args.J08nY2025-02-021-1/+1
|
* Fix aux handlers super() init call.J08nY2025-02-021-8/+11
|
* Remove processed_pp_dataset_root_dir, let PP dataset handler figure out the ↵J08nY2025-02-021-13/+0
| | | | dset existence.
* replace from_web_latest() with from_web()Adam Janovsky2025-02-017-103/+78
|
* implement PP testsAdam Janovsky2025-02-011-58/+3
|
* add aux dataset testsAdam Janovsky2025-02-011-88/+94
|
* forbid empty PP links in ProtectionProfile objectsAdam Janovsky2025-02-011-10/+8
|
* get rid of duplicate CC URL constantAdam Janovsky2025-02-012-20/+20
|
* don't delete CCSchemeDatasetHandler when skipping schemes processingAdam Janovsky2025-02-011-1/+1
|
* implement PP processingAdam Janovsky2025-02-014-159/+471
|
* fix notebooksAdam Janovsky2025-02-011-1/+1
|
* refactor auxiliary dataset handling, heuristics computationAdam Janovsky2025-02-017-722/+394
|
* Fix tests.J08nY2024-11-201-1/+1
|
* Add computation of previous and next certificate versions based on ID.J08nY2024-11-201-0/+12
| | | | Fixes #457.
* update deps, linter versionsAdam Janovsky2024-11-191-3/+1
|
* Improve CC scheme extraction and matching.J08nY2024-11-081-2/+2
| | | | | | | | | | | | This significantly improves the CC scheme extraction by: - Fixing the extraction of several schemes that were mixing certified and archived entries by accident. - Improving the extraction of cert_ids from scheme sites. - Improving the matching heuristic to consider more attributes that are usually present in the site data. Also adds an evaluation notebook to see how this performs.
* Improve scheme parsing.J08nY2024-11-041-2/+4
| | | | | | Only match if category matches. Disregard unwanted warnings. Add progress bars everywhere.
* Cleanup of documentation.J08nY2024-10-193-9/+6
| | | | It is now very nice and clean!
* Avoid double serialization in CVE and CPE dataset load.J08nY2024-10-181-2/+2
| | | | | The CVE/CPEDataset.from_web method already serializes to the path, so move the serialization call to the other branch.
* Merge pull request #446 from crocs-muni/feat/full-dset-archive-downloadJán Jančár2024-10-183-45/+265
|\ | | | | Add a way to download full dataset archive (including PDFs) from the web.
| * Unify and add options to from_web_latest.J08nY2024-10-183-99/+258
| |
| * Add a way to download full dataset archive (including PDFs) from the web.J08nY2024-10-172-1/+62
| |
* | Fix mapping of certs to PPs broken due to CC URL change.J08nY2024-10-161-2/+7
|/
* Move to new dgst algorithm for CC.J08nY2024-07-191-6/+17
|
* Fix FIPS aplgo download column parse.J08nY2024-07-041-0/+3
| | | | | | Fixes #419. Also has an impact on #409.
* replace seccerts -> sec-certsAdam Janovsky2024-04-254-6/+6
|
* Add tests for cert data extraction.J08nY2024-02-141-1/+2
|
* Refactor document state in CC.J08nY2024-02-131-14/+14
|
* Add extraction of certificate data.J08nY2024-02-081-14/+90
|
* Fix pandas deprecation in to_datetime.J08nY2024-02-012-5/+5
|
* Fix CC CSV and HTML parsing.J08nY2024-01-021-2/+5
|
* Merge branch 'bump-req-python-to-3-10' into reference-analysisAdam Janovsky2023-11-147-7/+10
|\
| * bump required python to 3.8Adam Janovsky2023-11-147-7/+10
| |
* | merge fresh mainAdam Janovsky2023-11-145-55/+62
|\|
| * fix new ruff errorsAdam Janovsky2023-11-102-3/+3
| |
| * Wrap CC scheme download in try-except and continue on fail.J08nY2023-10-231-1/+4
| |
| * Revert "feat: Initial implementation of tool/dataset version check"GeorgeFI2023-10-221-8/+0
| | | | | | | | This reverts commit ef9b405f9e9319d0464fc64acca313251973ef49.
| * feat: Initial implementation of tool/dataset version checkGeorgeFI2023-10-221-0/+8
| |
| * style: Fix of mypy typing - calling methods on potential None objectGeorgeFI2023-09-011-0/+7
| |
| * Add rudimentary profiling.J08nY2023-08-243-49/+48
| | | | | | | | Fixes #288.
| * Do not rerun pdf to text conversion, it is pointless.J08nY2023-08-241-2/+0
| | | | | | | | | | Either it works the first time or not, this just wastes time.
* | bump referencesadamjanovsky2023-11-142-69/+2
| |
* | adjust ReferenceSegmentExtractor to work with OCR-segmented jsonsAdam Janovsky2023-07-191-1/+1
| |
* | merge mainAdam Janovsky2023-06-0712-1176/+449
|\|
| * coerce problematic datetime values in cert csvs/dfs/htmlsAdam Janovsky2023-05-182-6/+6
| |
| * Move scheme data matching to heuristics.J08nY2023-04-271-12/+16
| |