← 输入框|github.com|刷新
Skip to content

feat(chronon): support Feast DQM for Chronon outputs with freshness and lineage context (#6984) - #7053

Open
ArjunPakhan wants to merge 1 commit into
feast-dev:masterfrom
ArjunPakhan:feat/feast-chronon-dqm
Open

ArjunPakhan wants to merge 1 commit into
feast-dev:masterfrom
ArjunPakhan:feat/feast-chronon-dqm

Conversation

@ArjunPakhan

Copy link
Copy Markdown

Summary of Changes

  1. Persistent Monitoring Storage & Hooks (ChrononOfflineStore):
    • Implemented ensure_monitoring_tables, save_monitoring_metrics, query_monitoring_metrics, clear_monitoring_baseline, and get_monitoring_max_timestamp using atomic Parquet upserts under feast_monitoring/.
    • Ensured job state survivability across restarts and retry idempotency.
  2. Online Freshness & Provenance Metadata:
    • Updated ChrononOnlineStore.online_read() to parse and extract feature timestamps (ts, timestamp, event_timestamp) for online source freshness.
    • Extended ChrononSource and ChrononOptions with output_version, pipeline_run_id, and export_timestamp_column for lineage tracking.
    • Distinctly maintained event time, feature computation time, export time, and metric computation time.
  3. REST API & UI Extensions:
    • Added GET /monitoring/date_buckets and GET /monitoring/profiles endpoints with corresponding UI hooks and table columns.
  4. Integration Test Suite:
    • Added comprehensive integration test suite (test_chronon_dqm_integration.py) covering null preservation, retry deduplication, baseline replacement, and stale output detection.

…nd lineage context (feast-dev#6984)

Signed-off-by: Arjun Pakhan <arjunpakhan@gmail.com>
@ArjunPakhan
ArjunPakhan requested a review from a team as a code owner October 20, 2026 18:49

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: Support Feast DQM for Chronon outputs with freshness and lineage context

1 participant