← 输入框|github.com|刷新
Skip to content

Releases

v0.334.3

Choose a tag to compare

@release-feldera-feldera release-feldera-feldera released this 17 Nov 17:40

Bugfix release on the v0.334 line. It contains two fixes on top of v0.334.2.

Fixes

  • Connection leak in the API server and the runner. When a client stopped reading the logs of a pipeline that wrote no new lines, the API server and the runner kept the connection open, together with a log follower in the runner. Over time, these leaked connections could cause the control plane to run out of memory. The API server and the runner now close a connection when the client closes it. This fix uses actix-web 4.12. (#7963)
  • Joins could miss records after a restart. A merged batch can store its roaring bitmap filter relative to a key that is smaller than its own first key. After a pipeline restarted from a checkpoint, lookups into such a batch reported keys that the batch holds as absent. Joins and other lookups then silently missed records. The filter is now decoded relative to the correct base. This also repairs batches already saved in checkpoints, and the checkpoint format does not change.

Upgrade

  1. Upgrade the platform to v0.334.3 with helm upgrade --version 0.334.3 and your usual values file. Do not use --reuse-values alone: it keeps felderaVersion from the old chart, so the images stay at the old version. Use --reset-then-reuse-values (Helm 3.14 or later) or set felderaVersion=0.334.3. The connection leak fix applies when the API server and the runner restart.
  2. A pipeline that resumes after the upgrade continues to run the binary that the old version compiled. It gets the join fix only when it is compiled again by v0.334.3.
  3. A pipeline that restarted from a checkpoint before the upgrade can have views that are missing records. For each such pipeline, clear its storage, start it from scratch, and ingest its input again.

Full Changelog: v0.334.2...v0.334.3

v0.383.0

Choose a tag to compare

@release-feldera-feldera release-feldera-feldera released this 16 Nov 15:55

What's Changed

  • Close a connection when the client closes it by @xiasongh in #7963
  • [SQL] Pushdown filters through UNNEST when possible by @mihaibudiu in #7970
  • [connectors] Run the Delta CDC suspend case on aarch64 again by @ryzhyk in #7969
  • [python] Time out and retry hung Delta Spark subprocesses by @mythical-fred-ops[bot] in #7726
  • [connectors] Delta merge: get the key ranges of all files at once by @swanandx in #7948
  • [feldera-types] Accept az:// buckets for checkpoint sync by @bestouff in #7972
  • [SQL] Support the PostgresSQL extension DISTINCT ON by @mihaibudiu in #7904
  • [types,connectors] Add StepInputs::Paused for a paused multihost pipeline. by @blp in #7974
  • Spread view integrals over all hosts, build multihost snapshots, and add distributed output connectors by @blp in #7843
  • [manager] Do not relay an upstream Content-Length in streaming_proxy() by @blp in #7984

Full Changelog: v0.382.0...v0.383.0

v0.382.0

Choose a tag to compare

@release-feldera-feldera release-feldera-feldera released this 13 Nov 15:08

What's Changed

  • [qa] Prefix test pipeline names with run_ by @Karakatiza666 in #7899
  • [python] Serialize Delta Spark runs across fixtures by @mythical-fred-ops[bot] in #7863
  • [web-console] Show the tenant name in the profile button by @Karakatiza666 in #7821
  • [web-console] Open the Runtime tab for a pipeline with live stats by @mrswastik-robot in #7893
  • [manager] Fix review nits from the prebuilt-binaries change by @bestouff in #7897
  • [connectors] Bump arrow-rs to 59.3.2. by @ryzhyk in #7895
  • Reject zero queue limits, add input batch size gauges, log slow checkpoints and stops by @blp in #7881
  • [connectors] Kafka: fix input skip and at-least-once output loss found by Antithesis by @blp in #7861
  • docs: Statistics after a resume, and the runtime status diagram by @blp in #7882
  • docs: Use codeartifact-token for private Cargo registries by @xiasongh in #7901
  • [dbsp] Drop page cache so a lower memory limit can apply on resize by @xiasongh in #7903
  • [SQL] Support for new Calcite UNNEST operator by @mihaibudiu in #6599
  • [web-console] Don't autoexpand circuit diagram nodes on load by @Karakatiza666 in #7902
  • [dbsp] Name the storage settings in the storage I/O failure message by @Karakatiza666 in #7911
  • [connectors] Remove disconnected input endpoints only between steps. by @blp in #7680
  • [connectors] Make DynamoDB test failures show their cause by @bestouff in #7917
  • [support] Option to remove source code from support bundles by @mihaibudiu in #7907
  • [SQL] Lower a few selected operator representations into DBSP primitives in the JSON representation by @mihaibudiu in #7891
  • [connectors] Step an idle circuit under memory pressure by @xiasongh in #7909
  • Minor code cleanup: store enums in Atomic instead of integer atomics by @blp in #7920
  • [SQL] Remove subqueries exposed by the removal of other subqueries by @mihaibudiu in #7927
  • Keep only the newest checkpoint on storage by @blp in #7905
  • Report the latest step request that the circuit saw by @blp in #7922
  • [SQL] Improve Simplify for casts by @mihaibudiu in #7929
  • [SQL] Support LEFT JOIN UNNEST by @mihaibudiu in #7932
  • [web-console] Set the browser tab title on every page by @Karakatiza666 in #7914
  • [web-console] Keep the OIDC code and state out of the referrer after login by @Karakatiza666 in #7912
  • [qa] Check new_pipeline_with_suffix names against the pipeline name limit by @mythical-fred-ops[bot] in #7921
  • [python] Test that a support bundle starts during a slow circuit step by @blp in #7935
  • [web-console] Fix duplicate key crash in the admin page owner lists by @Karakatiza666 in #7939
  • [pipeline-manager] Make the JSON request body limit configurable by @anandbraman in #7916
  • [python] Show the checkpoint list when the storage details test fails by @blp in #7945
  • [pipeline-manager] Give one reply to every rejected federated token by @swanandx in #7862
  • [python] Size the Delta merge verifier's Spark job for a six-row table by @ryzhyk in #7947
  • [connectors,dbsp] Use neutral names in tests that copied a reported workload by @bestouff in #7950
  • [pipeline-manager] Add GET /pipelines/{name}/deployment by @xiasongh in #7490
  • [adapters] Record the output assignment in each checkpoint. by @blp in #7942
  • [SQL] Remove unused recursive circuits by @mihaibudiu in #7954
  • [python] Fix test_pipeline_deployment on GKE and multihost by @xiasongh in #7968

Full Changelog: v0.381.0...v0.382.0

v0.381.0

Choose a tag to compare

@release-feldera-feldera release-feldera-feldera released this 09 Nov 11:24

What's Changed

Full Changelog: v0.380.0...v0.381.0

v0.380.0

Choose a tag to compare

@release-feldera-feldera release-feldera-feldera released this 08 Nov 10:36

What's Changed

  • [DBSP][SQL] Incremental constant operators by @mihaibudiu in #7886
  • [dbsp] Keep the scheduler's broadcasts when it is prepared again by @ryzhyk in #7884
  • Remove support for string INTERNing by @mihaibudiu in #7888
  • [pipeline-manager] Serve prebuilt pipeline binaries from the compiler by @gz in #7885

Full Changelog: v0.379.0...v0.380.0

v0.379.0

Choose a tag to compare

@release-feldera-feldera release-feldera-feldera released this 07 Nov 11:00

What's Changed

  • [python] Show why the server refused a credential. by @blp in #7858
  • [connectors] Report the error that stopped the circuit thread in /status by @blp in #7867
  • [DBSP][SQL] Report late rows immediately in the ERROR view by @mihaibudiu in #7851
  • [SQL] Improvements related to CSE by @mihaibudiu in #7864
  • [sqllib] Fix binary substring boundary calculation for non-positive start index by @Tyagiquamar in #7831
  • [pipeline-manager] Keep cached JWKS keys when a refresh fails by @blp in #7865
  • [iceberg] Skip already queued rows on a follow-mode retry by @swanandx in #7869
  • [web-console] Redesign the web console with an olive theme and consistent layout by @AnnaZhand in #7817
  • python: bump certifi to 2026.10.23 by @jyotshnayaparla-00 in #7874
  • [docs] Describe patterns in pipeline.allowedServiceAccountNames by @gz in #7876
  • [connectors] Delta: report the follow phase after a resume past the snapshot by @blp in #7797
  • [docs] Describe kubernetesRunner.allowedPipelineNamespaces by @gz in #7878
  • docs: re-organize guides by @lalithsuresh in #7875
  • [ci] Add the npm packages of the web-console to the image SBOM by @Karakatiza666 in #7883
  • Support bundle: stream while collecting, limit each step, no blind retry by @blp in #7818

Full Changelog: v0.378.0...v0.379.0

v0.378.0

Choose a tag to compare

@release-feldera-feldera release-feldera-feldera released this 06 Nov 11:13

What's Changed

  • [web-console] Restore the checkbox check mark by @Karakatiza666 in #7839
  • [dbsp] Reject exchange connections from other runtimes by @blp in #7814
  • [connectors] Limit the Samply profile duration and marker memory by @blp in #7826
  • Docs: new brand look and diagrams by @tristencross in #7841
  • [SQL] Fix persistent ID collision by @mihaibudiu in #7848
  • Support for JSON output with index properties by @mihaibudiu in #7752
  • [connectors] Kafka test proxy: do not hold EndTxn error replies. by @blp in #7847
  • [python] Give the Delta snapshot tests' token waits the sinks' 60 s by @bestouff in #7852
  • [profiler] Wait for cytoscape to draw before the pixel tests read the canvas by @Karakatiza666 in #7840
  • Docs: phone menu back bar, option cards, square Previous / Next by @tristencross in #7850
  • [pipeline-manager] Check memory and storage autoscaling limits in the api-server by @xiasongh in #7819
  • Fix: Directory in feldera-qa for QATests.java by @tbfel in #7853
  • [connectors] Kafka tests: do not fail on transient transport errors. by @blp in #7849
  • [python] Remove redundant wait_for_idle calls from test_uda. by @blp in #7845
  • Convert the last CRLF files to LF. by @blp in #7859
  • [pipeline-manager] Send PipelineInteractionConnectFailed when a pipeline connect fails by @blp in #7860
  • [iceberg] Read deletion vectors in follow mode by @swanandx in #7590
  • [dbsp] Keep the circuit running after a failed checkpoint by @blp in #7846
  • [profiler] Display by default only "basic" metrics in the profiler by @mihaibudiu in #7770

New Contributors

Full Changelog: v0.377.0...v0.378.0

v0.377.0

Choose a tag to compare

@release-feldera-feldera release-feldera-feldera released this 05 Nov 07:30

What's Changed

  • Add rclone to the build Dockerfile, too by @llogiq in #7804
  • [pipeline-manager] Grow a running pipeline's storage with PATCH by @xiasongh in #7656
  • [SQL] Emit the type for each expression in the IR JSON by @mihaibudiu in #7805
  • [connectors] Make the postgres runtime shutdown panic test robust on CI by @blp in #7808
  • [pipeline-manager] Limit login JWKS refreshes by @swanandx in #7799
  • [python] Make wait_for_completion() wait through a transient UNAVAILABLE status by @blp in #7798
  • [dbsp] Exchange data between hosts over TLS with client certificates by @blp in #7713
  • Bump dependencies flagged by the JFrog SBOM scan by @jyotshnayaparla-00 in #7823
  • [web-console] Revoke the refresh token on sign-out by @Karakatiza666 in #7781
  • [connectors] NATS: wait on the server for a library-recreated consumer. by @blp in #7824
  • [python] Report a pipeline restart instead of an empty view in the aggtest harness by @bestouff in #7816
  • [ci] Give the iceberg-rest catalog one sqlite connection. by @swanandx in #7834
  • [python] Use storage sizes the Hyperdisk minimum allows in test_deployment_resources by @xiasongh in #7837
  • Require confirmation for code from /create/ links, and restrict credentialed CORS by @Karakatiza666 in #7806
  • Clarify the comments on retried transaction commits by @blp in #7822
  • [connectors] Update iceberg-rust to 4dd8c946 by @swanandx in #7721
  • [sqllib] Return an error instead of panicking when a nullable cast helper gets NULL. by @mihaibudiu in #7825
  • [connectors] Judge Kafka test reads against the live high watermark by @bestouff in #7836
  • [connectors] Retry DynamoDB writes through throttling and report health by @bestouff in #7736

Full Changelog: v0.376.0...v0.377.0

v0.376.0

Choose a tag to compare

@release-feldera-feldera release-feldera-feldera released this 04 Nov 15:51

What's Changed

  • Add rclone to our devcontainer and Docker image by @llogiq in #7774
  • [web-console] Tighten and group the runtime connector tables by @AnnaZhand in #7766
  • [profiler] Do not draw the edges into the multihost remote waiter by @mihaibudiu in #7771
  • [connectors] Unit test fix: Release the replay gates lock before calling a gate. by @blp in #7753
  • [SQL] ShareIndexes: only share indexes that read the same output port by @bens-secret-alt-account in #7784
  • [dbsp] Finish a sharded accumulator's flush in the step of the last flush. by @ryzhyk in #7778
  • [python] Use only real storage and volume attributes classes in tests by @xiasongh in #7790
  • [connectors] Fail, do not panic, when the pipeline stops during open. by @blp in #7785
  • [adapters] Delta: let a filter name a nested column-mapped field by @blp in #7669
  • [adapters] Leave batching to librdkafka in the exactly-once Kafka output by @jacksehr in #7432
  • [python] Fix program version wait and retries of non-idempotent requests by @blp in #7795
  • [SQL] Several small improvements by @mihaibudiu in #7794
  • [pipeline-manager] keep the bootstrap config through a stop request in the model. by @ryzhyk in #7779
  • [docs] Document pipeline.allowLocalFileUris by @swanandx in #7780
  • [adapters] Support caller-supplied keys in exactly-once Kafka output by @jacksehr in #7433
  • Improve UX of rapidly changing transaction IDs and commit progress by @Karakatiza666 in #7742
  • docs: explain how to rotate the database password by @jyotshnayaparla-00 in #7792
  • [fxp] Round half-even values below one unit to ±1, not 0. by @blp in #7796
  • [connectors] Kafka: fix flaky check of output memory after an outage. by @blp in #7789
  • [python] Check a paused output connector's record counter on every host by @blp in #7608
  • Commit the right transaction in the SDK, fda and /commit_transaction by @blp in #7687

New Contributors

Full Changelog: v0.375.0...v0.376.0

v0.375.0

Choose a tag to compare

@release-feldera-feldera release-feldera-feldera released this 02 Nov 10:49

What's Changed

  • docs: bump joi and follow-redirects in docs lockfile by @mythical-fred-ops[bot] in #7769
  • get rid of needless string allocations by @llogiq in #7773
  • [sqllib] Fix POSITION and REPLACE with an empty needle by @mihaibudiu in #7775
  • [SQL] Escape SQL identifiers in generated Rust string literals by @mihaibudiu in #7776
  • [SQL] Backport two Calcite fixes by @mihaibudiu in #7777

Full Changelog: v0.374.0...v0.375.0