add-ideas/govoplan-core
1
0
Fork 0
Code Issues 45 Pull Requests Actions Packages Projects Releases Wiki Activity

[Task] Harden remote module catalog trust state and replay validation #209

New Issue
Closed
opened 2026-07-07 15:03:22 +02:00 by zemion · 2 comments
zemion commented 2026-07-07 15:03:22 +02:00
Owner
Copy Link

Objective

Finish production hardening for remote module catalog consumption in core.

Scope

  • Persist accepted channel sequence state across installs.
  • Add regression coverage for URL cache fallback, expired catalogs, not-before catalogs, and strict replay mode.
  • Document operator recovery if a sequence state file is lost or corrupted.
  • Ensure admin and CLI validation report source, channel, sequence, freshness, signature, and key id consistently.

Acceptance Criteria

  • URL-backed catalogs work with cache fallback and signed validation.
  • Sequence replay protection rejects older and already-accepted catalogs when configured.
  • Operator docs explain reset/recovery procedure.
  • Tests cover local file, remote URL, cache fallback, expiry, and replay.

Verification Target

python -m unittest tests.test_module_system

Codex-Fingerprint: catalog-trust-replay-production-hardening

## Objective Finish production hardening for remote module catalog consumption in core. ## Scope - Persist accepted channel sequence state across installs. - Add regression coverage for URL cache fallback, expired catalogs, not-before catalogs, and strict replay mode. - Document operator recovery if a sequence state file is lost or corrupted. - Ensure admin and CLI validation report source, channel, sequence, freshness, signature, and key id consistently. ## Acceptance Criteria - [ ] URL-backed catalogs work with cache fallback and signed validation. - [ ] Sequence replay protection rejects older and already-accepted catalogs when configured. - [ ] Operator docs explain reset/recovery procedure. - [ ] Tests cover local file, remote URL, cache fallback, expiry, and replay. ## Verification Target `python -m unittest tests.test_module_system` Codex-Fingerprint: catalog-trust-replay-production-hardening
zemion commented 2026-07-07 15:37:12 +02:00
Author
Owner
Copy Link

Codex State: progress

Summary

  • Added release catalog key generation, signed catalog generation, and govoplan-web publication wrappers.
  • Generated and validated local stable catalog for v0.1.4 with release-key-1.

Changed Files

  • scripts/generate-catalog-keypair.py
  • scripts/generate-release-catalog.py
  • scripts/publish-release-catalog.sh
  • scripts/push-release-tag.sh
  • docs/RELEASE_CATALOG_WORKFLOW.md

Verification

  • bash -n scripts/publish-release-catalog.sh scripts/push-release-tag.sh
  • ./.venv/bin/python -m py_compile scripts/generate-catalog-keypair.py scripts/generate-release-catalog.py
  • GOVOPLAN_MODULE_PACKAGE_CATALOG_TRUSTED_KEYS_FILE=/mnt/DATA/git/govoplan-web/public/catalogs/v1/keyring.json ./.venv/bin/python -m govoplan_core.commands.module_installer --validate-package-catalog /mnt/DATA/git/govoplan-web/public/catalogs/v1/channels/stable.json --require-signed-catalog --approved-catalog-channel stable --format json

Next / Blocked

  • Artifact digest/SBOM verification remains tracked separately.

Suggested status label: status/in-progress

## Codex State: progress ### Summary - Added release catalog key generation, signed catalog generation, and govoplan-web publication wrappers. - Generated and validated local stable catalog for v0.1.4 with release-key-1. ### Changed Files - `scripts/generate-catalog-keypair.py` - `scripts/generate-release-catalog.py` - `scripts/publish-release-catalog.sh` - `scripts/push-release-tag.sh` - `docs/RELEASE_CATALOG_WORKFLOW.md` ### Verification - `bash -n scripts/publish-release-catalog.sh scripts/push-release-tag.sh` - `./.venv/bin/python -m py_compile scripts/generate-catalog-keypair.py scripts/generate-release-catalog.py` - `GOVOPLAN_MODULE_PACKAGE_CATALOG_TRUSTED_KEYS_FILE=/mnt/DATA/git/govoplan-web/public/catalogs/v1/keyring.json ./.venv/bin/python -m govoplan_core.commands.module_installer --validate-package-catalog /mnt/DATA/git/govoplan-web/public/catalogs/v1/channels/stable.json --require-signed-catalog --approved-catalog-channel stable --format json` ### Next / Blocked - Artifact digest/SBOM verification remains tracked separately. Suggested status label: `status/in-progress`
zemion commented 2026-07-07 21:28:28 +02:00
Author
Owner
Copy Link

Codex State: done

Summary

  • Hardened remote module catalog validation. URL-backed catalogs now report cache fallback metadata while still validating the cached body with signature, approved channel, freshness, and replay checks. Validation results now consistently include source/source_type/cache_used/cache_path, channel, sequence, generated_at/not_before/expires_at, signed/trusted state, and key id for CLI JSON and admin API consumers. Admin module catalog responses and the WebUI catalog panel expose cache fallback and not-before metadata. Operator docs now describe sequence-state backup, corruption/loss recovery, and safe reset rules.

Changed Files

  • Core: src/govoplan_core/core/module_package_catalog.py, tests/test_module_system.py, docs/CATALOG_TRUST_AND_LICENSING.md, docs/RELEASE_DEPENDENCIES.md. Admin: /mnt/DATA/git/govoplan-admin/src/govoplan_admin/backend/api/v1/routes.py, schemas.py, webui/src/api/admin.ts, webui/src/features/admin/ModuleManagementPanel.tsx.

Verification

  • ./.venv/bin/python -m py_compile src/govoplan_core/core/module_package_catalog.py /mnt/DATA/git/govoplan-admin/src/govoplan_admin/backend/api/v1/routes.py /mnt/DATA/git/govoplan-admin/src/govoplan_admin/backend/api/v1/schemas.py
  • ./.venv/bin/python -m unittest tests.test_module_system.ModuleSystemTests.test_module_package_catalog_loads_json_entries tests.test_module_system.ModuleSystemTests.test_module_package_catalog_validation_reports_bad_entries tests.test_module_system.ModuleSystemTests.test_module_package_catalog_validates_signed_approved_channel tests.test_module_system.ModuleSystemTests.test_module_package_catalog_validates_remote_url_and_cache_fallback tests.test_module_system.ModuleSystemTests.test_module_package_catalog_rejects_unapproved_channel_when_required tests.test_module_system.ModuleSystemTests.test_module_package_catalog_rejects_expired_catalog tests.test_module_system.ModuleSystemTests.test_module_package_catalog_rejects_not_before_catalog tests.test_module_system.ModuleSystemTests.test_module_package_catalog_records_sequence_acceptance tests.test_module_system.ModuleSystemTests.test_module_installer_validates_package_catalog_from_cli
  • PATH=/mnt/DATA/git/govoplan-core/webui/node_modules/.bin:/home/zemion/.nvm/versions/node/v22.22.3/bin:/home/zemion/.local/bin:/home/zemion/.codex/tmp/arg0/codex-arg0EWzbZZ:/app/bin:/app/bin:/app/bin:/usr/bin:/usr/lib/sdk/openjdk25/bin:/home/zemion/.var/app/com.vscodium.codium/data/node/bin:/home/zemion/.var/app/com.vscodium.codium/data/cargo/bin:/home/zemion/.var/app/com.vscodium.codium/data/python/bin:/home/zemion/.var/app/com.vscodium.codium/data/codium/extensions/openai.chatgpt-26.5623.101652-linux-x64/bin/linux-x86_64 /home/zemion/.nvm/versions/node/v22.22.3/bin/npm run build (from webui; passed, with existing npm tmp warning)
  • ./.venv/bin/python scripts/check_dependency_boundaries.py
  • git diff --check for changed core/admin files
  • ./.venv/bin/python -m unittest tests.test_module_system (55 tests passed; existing SQLite ResourceWarnings only)
## Codex State: done ### Summary - Hardened remote module catalog validation. URL-backed catalogs now report cache fallback metadata while still validating the cached body with signature, approved channel, freshness, and replay checks. Validation results now consistently include source/source_type/cache_used/cache_path, channel, sequence, generated_at/not_before/expires_at, signed/trusted state, and key id for CLI JSON and admin API consumers. Admin module catalog responses and the WebUI catalog panel expose cache fallback and not-before metadata. Operator docs now describe sequence-state backup, corruption/loss recovery, and safe reset rules. ### Changed Files - `Core: src/govoplan_core/core/module_package_catalog.py, tests/test_module_system.py, docs/CATALOG_TRUST_AND_LICENSING.md, docs/RELEASE_DEPENDENCIES.md. Admin: /mnt/DATA/git/govoplan-admin/src/govoplan_admin/backend/api/v1/routes.py, schemas.py, webui/src/api/admin.ts, webui/src/features/admin/ModuleManagementPanel.tsx.` ### Verification - `./.venv/bin/python -m py_compile src/govoplan_core/core/module_package_catalog.py /mnt/DATA/git/govoplan-admin/src/govoplan_admin/backend/api/v1/routes.py /mnt/DATA/git/govoplan-admin/src/govoplan_admin/backend/api/v1/schemas.py` - `./.venv/bin/python -m unittest tests.test_module_system.ModuleSystemTests.test_module_package_catalog_loads_json_entries tests.test_module_system.ModuleSystemTests.test_module_package_catalog_validation_reports_bad_entries tests.test_module_system.ModuleSystemTests.test_module_package_catalog_validates_signed_approved_channel tests.test_module_system.ModuleSystemTests.test_module_package_catalog_validates_remote_url_and_cache_fallback tests.test_module_system.ModuleSystemTests.test_module_package_catalog_rejects_unapproved_channel_when_required tests.test_module_system.ModuleSystemTests.test_module_package_catalog_rejects_expired_catalog tests.test_module_system.ModuleSystemTests.test_module_package_catalog_rejects_not_before_catalog tests.test_module_system.ModuleSystemTests.test_module_package_catalog_records_sequence_acceptance tests.test_module_system.ModuleSystemTests.test_module_installer_validates_package_catalog_from_cli` - `PATH=/mnt/DATA/git/govoplan-core/webui/node_modules/.bin:/home/zemion/.nvm/versions/node/v22.22.3/bin:/home/zemion/.local/bin:/home/zemion/.codex/tmp/arg0/codex-arg0EWzbZZ:/app/bin:/app/bin:/app/bin:/usr/bin:/usr/lib/sdk/openjdk25/bin:/home/zemion/.var/app/com.vscodium.codium/data/node/bin:/home/zemion/.var/app/com.vscodium.codium/data/cargo/bin:/home/zemion/.var/app/com.vscodium.codium/data/python/bin:/home/zemion/.var/app/com.vscodium.codium/data/codium/extensions/openai.chatgpt-26.5623.101652-linux-x64/bin/linux-x86_64 /home/zemion/.nvm/versions/node/v22.22.3/bin/npm run build (from webui; passed, with existing npm tmp warning)` - `./.venv/bin/python scripts/check_dependency_boundaries.py` - `git diff --check for changed core/admin files` - `./.venv/bin/python -m unittest tests.test_module_system (55 tests passed; existing SQLite ResourceWarnings only)`
zemion added the
type
task
status
ready
area/module-system
 labels 2026-07-07 23:08:07 +02:00
zemion added the
module/core
 label 2026-07-07 23:42:14 +02:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
area/api
HTTP API contracts, routers, schemas, or API smoke behavior.
area/auth
Authentication, sessions, access bootstrap, or login behavior.
area/db
Database sessions, models, transactions, or persistence primitives.
area/deployment
Deployment, release, operations, or runtime packaging.
area/devex
Local developer workflow, scripts, tests, tooling, or release helpers.
area/docs
Durable documentation and project guidance.
area/governance
Governance policy, audit, privacy, retention, or compliance behavior.
area/marketing
Public website, product messaging, publication copy, or legal page content.
area/migrations
Alembic migrations, schema bootstrap, or persistence evolution.
area/module-system
Module discovery, manifests, capabilities, routing, or optional integrations.
area/rbac
Permissions, roles, delegation, or authorization policy.
area/release
Versioning, release locks, tags, packaging, or dependency pins.
area/security
Security posture, static analysis, supply-chain hardening, or vulnerability remediation.
area/tenancy
Tenant boundaries, provisioning, or tenant-scoped data behavior.
area/webui
Shared WebUI shell, frontend components, routing, or frontend tests.
audit/complexity
Complexity finding from Radon, Xenon, or equivalent maintainability scans.
audit/duplication
Duplicated-code finding from jscpd or equivalent similarity scans.
audit/false-positive
Audit finding reviewed as a narrow false positive or acceptable risk.
audit/needs-design
Audit finding that needs an architectural or product decision before implementation.
audit/quick-fix
Audit finding that appears narrow and directly fixable.
audit/structural
Audit finding that needs design, refactoring, or behavior review.
codex/needs-human
Needs an explicit human decision before Codex should implement.
codex/ready
Suitable for Codex to pick up with the existing issue context.
module/access
GovOPlaN access, identity, authentication, RBAC, and administration behavior.
module/addresses
GovOPlaN Addresses module behavior or integration.
module/admin
GovOPlaN Admin module behavior or integration.
module/appointments
GovOPlaN Appointments module behavior or integration.
module/approvals
GovOPlaN Approvals module behavior or integration.
module/assets
GovOPlaN Assets module behavior or integration.
module/audit
GovOPlaN Audit module behavior or integration.
module/booking
GovOPlaN Booking module behavior or integration.
module/calendar
GovOPlaN Calendar module behavior or integration.
module/campaign
GovOPlaN campaign module behavior or integration.
module/cases
GovOPlaN Cases module behavior or integration.
module/certificates
GovOPlaN Certificates module behavior or integration.
module/committee
GovOPlaN Committee module behavior or integration.
module/connectors
GovOPlaN Connectors module behavior or integration.
module/consultation
GovOPlaN Consultation module behavior or integration.
module/contracts
GovOPlaN Contracts module behavior or integration.
module/core
GovOPlaN core runner, shared primitives, shell, or extension points.
module/dist-lists
GovOPlaN Distribution Lists module behavior or integration.
module/dms
GovOPlaN Dms module behavior or integration.
module/docs
GovOPlaN documentation layer behavior or integration.
module/erp
GovOPlaN Erp module behavior or integration.
module/evaluation
GovOPlaN Evaluation module behavior or integration.
module/facilities
GovOPlaN Facilities module behavior or integration.
module/files
GovOPlaN files module behavior or integration.
module/fit-connect
GovOPlaN Fit Connect module behavior or integration.
module/forms
GovOPlaN Forms module behavior or integration.
module/forms-runtime
GovOPlaN Forms Runtime module behavior or integration.
module/grants
GovOPlaN Grants module behavior or integration.
module/helpdesk
GovOPlaN Helpdesk module behavior or integration.
module/identity
GovOPlaN Identity module behavior or integration.
module/identity-trust
GovOPlaN Identity Trust module behavior or integration.
module/idm
GovOPlaN Idm module behavior or integration.
module/inspections
GovOPlaN Inspections module behavior or integration.
module/issue-reporting
GovOPlaN Issue Reporting module behavior or integration.
module/learning
GovOPlaN Learning module behavior or integration.
module/ledger
GovOPlaN Ledger module behavior or integration.
module/mail
GovOPlaN mail module behavior or integration.
module/notifications
GovOPlaN Notifications module behavior or integration.
module/ops
GovOPlaN Ops module behavior or integration.
module/organizations
GovOPlaN Organizations module behavior or integration.
module/payments
GovOPlaN Payments module behavior or integration.
module/permits
GovOPlaN Permits module behavior or integration.
module/policy
GovOPlaN Policy module behavior or integration.
module/poll
GovOPlaN Poll module behavior or integration.
module/portal
GovOPlaN Portal module behavior or integration.
module/postbox
GovOPlaN Postbox module behavior or integration.
module/procurement
GovOPlaN Procurement module behavior or integration.
module/records
GovOPlaN Records module behavior or integration.
module/reporting
GovOPlaN Reporting module behavior or integration.
module/resources
GovOPlaN Resources module behavior or integration.
module/risk-compliance
GovOPlaN Risk Compliance module behavior or integration.
module/scheduling
GovOPlaN Scheduling module behavior or integration.
module/search
GovOPlaN Search module behavior or integration.
module/tasks
GovOPlaN Tasks module behavior or integration.
module/templates
GovOPlaN Templates module behavior or integration.
module/tenancy
GovOPlaN Tenancy module behavior or integration.
module/transparency
GovOPlaN Transparency module behavior or integration.
module/web
GovOPlaN public website, product page, or publication content.
module/workflow
GovOPlaN Workflow module behavior or integration.
module/xoev
GovOPlaN Xoev module behavior or integration.
module/xrechnung
GovOPlaN Xrechnung module behavior or integration.
module/xta-osci
GovOPlaN Xta Osci module behavior or integration.
priority
p0
Immediate stop-the-line priority.
priority
p1
High priority for the next focused work window.
priority
p2
Normal planned priority.
priority
p3
Low priority or opportunistic cleanup.
source/backlog-import
Imported from markdown backlog, roadmap, plan, or TODO files.
source/module-roadmap
Created from GovOPlaN module and integration roadmap planning.
source/security-audit
Created from a structured security or code-quality audit report.
source/todo-scan
Imported from inline TODO/FIXME/HACK markers by the Gitea TODO importer.
status
blocked
Cannot progress without a decision, dependency, credential, or external change.
status
in-progress
Currently being worked.
status
needs-info
Needs clarifying input before implementation can proceed safely.
status
ready
Ready for implementation.
status
triage
Needs review, ownership, priority, or acceptance criteria.
type
bug
A reproducible defect, regression, or incorrect behavior.
type
debt
Cleanup, refactoring, risk reduction, or deferred engineering work.
type
docs
Documentation, process, or developer workflow work.
type
feature
New user-visible behavior or platform capability.
type
task
Implementation, maintenance, migration, or operational work.
type
user-story
End-to-end user journey or real-world process story used to steer product slices.
No Label
area/module-system
module/core
status
ready
type
task
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
zemion
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: add-ideas/govoplan-core#209
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?