Skip to content

Remove BigQuery delivery reconciliation + fix CI lint/format#5

Merged
matteius merged 2 commits into
mainfrom
chore/remove-bigquery-reconciliation
Jun 10, 2026
Merged

Remove BigQuery delivery reconciliation + fix CI lint/format#5
matteius merged 2 commits into
mainfrom
chore/remove-bigquery-reconciliation

Conversation

@matteius

Copy link
Copy Markdown
Contributor

Two things

1. Remove BigQuery delivery reconciliation (0.76.0)

Mail is moving off the Gmail API onto an authenticated ESP (Mailjet), whose own event feed reports delivered/bounced/blocked. Reconciling against the Workspace Gmail log in BigQuery is no longer relevant.

  • Delete reconciliation.py + the reconcile_email_delivery Celery task
  • Drop the optional reconciliation extra (google-cloud-bigquery)
  • Retained (ESP-agnostic, repopulated from Mailjet events): the NotificationLog delivery columns, migration 0097, Message-ID stamping — no DB migration change
  • Consuming app drops EMAIL_RECONCILIATION + the beat entry

2. Fix the failing CI lint/format check

main CI has been red since the prior reconciliation/genericize commits due to pre-existing ruff violations:

  • tasks.py: sort the make_msgid import into the stdlib block (I001)
  • gmail_api.py, views.py: ruff format line wrapping

Both ruff format --check and ruff check pass locally now.

🤖 Generated with Claude Code

matteius and others added 2 commits June 9, 2026 15:14
Mail is moving off the Gmail API onto an authenticated ESP (Mailjet) whose own
event feed reports delivered/bounced/blocked directly, so reconciling against
the Google Workspace Gmail log in BigQuery is no longer relevant.

- Delete reconciliation.py and the reconcile_email_delivery Celery task
- Drop the optional `reconciliation` extra (google-cloud-bigquery)
- Generalize the send-idempotency guard comment (delivery_state='retried' is
  now ESP-agnostic)

Retained (ESP-agnostic, to be repopulated from Mailjet events): the
NotificationLog delivery columns (rfc2822_message_id, delivery_state,
delivery_checked_at, delivery_detail), migration 0097, and Message-ID stamping
-- so no DB migration change.

Consuming app must drop the EMAIL_RECONCILIATION setting and the Celery beat
entry for django_forms_workflows.reconcile_email_delivery.

Version 0.76.0.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
- tasks.py: sort the make_msgid import into the stdlib block (I001)
- gmail_api.py, views.py: ruff format line wrapping
Pure formatting; no behavior change.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@matteius matteius merged commit 31c9a9b into main Jun 10, 2026
11 checks passed
@matteius matteius deleted the chore/remove-bigquery-reconciliation branch June 10, 2026 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant