[Task] Add production execution controls and scheduled materialization #10

New Issue

2026-07-28T00:58:09+02:00

zemion commented

2026-07-28 00:58:09 +02:00

Parent: #1

After bounded preview is stable, add worker-backed execution with cancellation, retries, quotas, resource isolation, progress, notification events, retention, scheduled runs, promotion between environments, and operational metrics. This issue must not be satisfied by running arbitrary SQL in the API process.

Parent: https://git.add-ideas.de/GovOPlaN/govoplan-dataflow/issues/1 After bounded preview is stable, add worker-backed execution with cancellation, retries, quotas, resource isolation, progress, notification events, retention, scheduled runs, promotion between environments, and operational metrics. This issue must not be satisfied by running arbitrary SQL in the API process.

zemion added the

module/dataflow area/api area/db area/security codex/ready

status

ready

labels 2026-07-28 00:58:09 +02:00

zemion referenced this issue

2026-07-28 14:02:56 +02:00

[Feature] Add governed manual, scheduled, event, API, and chained Dataflow triggers #11

zemion commented

2026-07-28 15:06:41 +02:00

Trigger definitions, durable deliveries, worker beat dispatch, pinned revisions, catch-up semantics, concurrency ceilings, and authorization rechecks landed in govoplan-dataflow@08ddc8d. This parent remains open for the asynchronous large-run executor, cancellation, retry/quarantine, quotas, progress, notifications, retention, and metrics.

zemion commented

2026-07-30 02:33:40 +02:00

Codex State: done

Summary

Moved saved runs and trigger materializations behind a durable leased worker queue; API and lifecycle starts now return queued evidence instead of executing SQL inline.
Added current-authorization rechecks, cancellation checkpoints, bounded retries, tenant queue/concurrency quotas, isolated staging/production DuckDB execution, progress, notifications, retention, metrics, and environment promotion gates.
Updated the Run UI with queue progress polling, cancellation, and development-to-staging-to-production promotion controls.

Changed Files

govoplan-core@cf7afe9
govoplan-dataflow@5af0293
govoplan@fcb8296

Verification

govoplan-dataflow: 63 tests and 8 subtests passed; Ruff passed
tools/checks/check-focused.sh passed, including module contracts, migrations, composition, and WebUI permutations
govoplan-core full suite: 387 passed, 3 skipped; one unrelated stale Files smoke patch failed because _read_limited_upload no longer exists

## Codex State: done ### Summary - Moved saved runs and trigger materializations behind a durable leased worker queue; API and lifecycle starts now return queued evidence instead of executing SQL inline. - Added current-authorization rechecks, cancellation checkpoints, bounded retries, tenant queue/concurrency quotas, isolated staging/production DuckDB execution, progress, notifications, retention, metrics, and environment promotion gates. - Updated the Run UI with queue progress polling, cancellation, and development-to-staging-to-production promotion controls. ### Changed Files - `govoplan-core@cf7afe9` - `govoplan-dataflow@5af0293` - `govoplan@fcb8296` ### Verification - `govoplan-dataflow: 63 tests and 8 subtests passed; Ruff passed` - `tools/checks/check-focused.sh passed, including module contracts, migrations, composition, and WebUI permutations` - `govoplan-core full suite: 387 passed, 3 skipped; one unrelated stale Files smoke patch failed because _read_limited_upload no longer exists`

zemion closed this issue

2026-07-30 02:33:40 +02:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: GovOPlaN/govoplan-dataflow#10