Skip to content

Update duckdb and arrow#33

Merged
itssimon merged 1 commit into
mainfrom
renovate/duckdb-and-arrow
Jul 21, 2026
Merged

Update duckdb and arrow#33
itssimon merged 1 commit into
mainfrom
renovate/duckdb-and-arrow

Conversation

@renovate

@renovate renovate Bot commented Apr 25, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

ℹ️ Note

This PR body was truncated due to platform limits.

This PR contains the following updates:

Package Type Update Change
arrow dependencies minor =58.1.0 → =58.3.0
arrow-ipc dependencies minor =58.1.0 → =58.3.0
duckdb dependencies minor =1.10501.0 → =1.10504.0

Release Notes

apache/arrow-rs (arrow)

v58.3.0: arrow 58.3.0

Compare Source

Changelog

58.3.0 (2026-05-07)

Full Changelog

Implemented enhancements:

  • Add DatePart::from_str API #​9930 [arrow]
  • should use DictionaryArray::with_values instead of try_new on the dictionary fast path #​9889 [arrow]
  • [arrow-string] add concat_elements for BinaryViewArray and FixedSizeBinary #​9875 [arrow]
  • Expose eq ignore ascii case from arrow-string #​9870 [arrow]
  • Configurable data page v2 compression threshold #​9827 [parquet]

Fixed bugs:

  • [arrow-cast] incorrect Time32 -> Time64 conversion #​9851 [arrow]
  • Panic when reading malformed compact-Thrift bool fields in Parquet page metadata #​9839 [parquet]
  • Parquet DeltaBitPackDecoder::skip could panic on "non-standard" miniblocks #​9793 [parquet]

Documentation updates:

Closed issues:

  • GenericByteDictionaryBuilder::with_capacity does not pre-size dedup HashTable #​9907 [arrow]
  • [arrow-buffer] Integer overflow in repeat_slice_n_times leads to undefined behavior #​9904 [arrow]
  • [arrow-buffer] Integer overflow in BitChunks::new leads to undefined behavior #​9903 [arrow]
  • [arrow-row] Integer overflow in Rows::row index handling leads to undefined behavior #​9901 [arrow]
  • [arrow-data] Integer overflow in ArrayData validation leads to undefined behavior #​9900 [arrow]
  • [arrow-data] Integer overflow in ArrayData::slice leads to undefined behavior #​9899 [arrow]
  • [arrow-array] Integer overflow in FixedSizeBinaryArray::value leads to undefined behavior #​9898 [arrow]
  • [arrow-buffer] Integer overflow in BufferBuilder::reserve leads to undefined behavior #​9897 [arrow]
  • arrow-csv: integer overflow panic in Reader::records::flush #​9885 [arrow]
  • Make an API to help with the pattern of 'replaces the values of the REE array' #​9854 [arrow]
  • Parquet reader rejects canonical UNKNOWN logical type on BOOLEAN physical columns #​9844 [parquet]
  • ColumnIndex length mismatch can cause panic during decoding in Parquet #​9832 [parquet]
  • Bug converting json to fixed list of zero size #​9780 [arrow]

Merged pull requests:

* This Changelog was automatically generated by github_changelog_generator

v58.2.0: arrow 58.2.0

Compare Source

Changelog

58.2.0 (2026-04-28)

Full Changelog

Implemented enhancements:

  • Expose ColumnCloseResult on ArrowColumnChunk #​9774 [parquet]
  • Expose FFI data structures fields #​9771 [arrow]
  • short-circuit last predicate in RowFilter when with_limit(N) is set #​9765 [parquet]
  • vectorise dict-index bounds check #​9747 [parquet]
  • Refactor RleEncoder::flush_bit_packed_run #​9734 [parquet]
  • Add benchmark for cast from/to decimals #​9728 [arrow]
  • Add a security policy for arrow-rs #​9727 [parquet] [arrow] [arrow-flight]
  • Support FixedSizeList in arrow-json reader #​9714 [arrow]
  • [Variant] Add VariantArrayBuilder::append_nulls API #​9684
  • [Json] RunEndEncoded decoder optimization #​9645 [arrow]
  • [Variant] variant_get(..., List<_>) non-Struct types support #​9615
  • [Variant] Add unshredded Struct fast-path for variant_get(..., Struct) #​9596
  • Allow setting custom line terminator for CSV writer #​9571 [arrow]
  • [Variant] Align cast logic for variant_get to cast kernel for numeric/bool types #​9564 [arrow]
  • ci: use ubuntu-slim where applicable #​9536
  • Publicly export arrow_string::Predicate and its methods? #​9480
  • Don't create CompressionContext when no compression is selected [IPC] #​9463 [arrow]
  • Parquet: Raw level buffering causes unbounded memory growth for sparse columns #​9446 [parquet]
  • Parallel Parquet Reading #​9381 [parquet]

Fixed bugs:

  • [Variant] unshred_variant panics on malformed bytes despite returning Result #​9740
  • RecordBatch::normalize() does not propagate top level null bitmap into the results #​9732 [arrow]
  • Incorrect accounting in DictEncoder::estimated_memory_size #​9719 [parquet]
  • arrow-ipc writer does not comply with spec for empty variable-size arrays #​9716 [arrow]
  • Panic when reading corrupt parquet file with truncated data instead of ParquetError #​9705 [parquet]
  • NOTICE.txt is inaccurate #​9703 [arrow]
  • Unnecessary dependency on regex crate #​9672
  • [arrow-avro] Avro reader produces incorrect results when reader schema and writer schema differ #​9655 [arrow]
  • parquet docs are broken on docs.rs #​9649
  • [Parquet] ArrowWriter with CDC panics on nested ListArrays #​9637 [parquet] [arrow] [arrow-flight]
  • Use release KEYS file for verification instead of dev KEYS #​9603
  • IPC reader: handling of dictionaries with only null values #​9595 [arrow]
  • Parquet RleDecoder::get_batch_with_dict panics on oob dictionary indices #​9434 [parquet]

Documentation updates:

Performance improvements:

Closed issues:

  • Incorrect buffer skipping for V4 Union types in IPC skip_field #​9828 [arrow]
  • Replace wildcard match in skip_field with explicit DataType handling #​9821 [arrow]
  • Column projection misalignment for ListView / LargeListView in IPC reader #​9805 [arrow]
  • Avoid panic on malformed compressed buffer prefix in IPC #​9801 [arrow]
  • DeltaByteArrayDecoder panics on invalid prefix lengths #​9796 [parquet]
  • Use NullBufferBuilder when reading json #​9781 [arrow]
  • Perfectly shredded arrays with top-level null values loss nullability when typed_value is extracted #​9701
  • [Parquet Metadata] API to determine page-index presence separately from page-index load #​9693
  • Union cast is incorrect for duplicate field names #​9664 [arrow]
  • List and ListView are missing take benchmarks #​9627 [arrow]
  • Support RunEndEncoded arrays in comparison kernels (eq, lt, etc.) #​9620 [arrow]
  • variant_get should follow JSONpath semantics #​9606
  • GenericByteViewArray: support finding total length of all strings #​9435 [arrow]

Merged pull requests:

* This Changelog was automatically generated by github_changelog_generator

duckdb/duckdb-rs (duckdb)

v1.10504.0

Compare Source

What's Changed

Full Changelog: duckdb/duckdb-rs@v1.10503.1...v1.10504.0

v1.10503.1

Compare Source

What's Changed

Full Changelog: duckdb/duckdb-rs@v1.10503.0...v1.10503.1

v1.10503.0

Compare Source

Highlights

  • New ergonomic named parameter binding: named_params! macro, &[(&str, &dyn ToSql)] slices, and a generic HashMap Params impl.
  • New build env vars: DUCKDB_DISABLE_EXTENSION_LOAD=1 disables extension install/load, and DUCKDB_DISABLE_JEMALLOC=1 opts bundled-cmake builds out of jemalloc (now re-enabled by default on supported targets).
  • FFI soundness: typed vector slice/set_child APIs are now unsafe; DuckDB-owned C strings use RAII; binding unsupported Value variants errors instead of panicking.
  • ArrowVTab view rebinds no longer dereference freed Arrow FFI memory.
  • vtab::Value gains typed primitive getters and to_list() -> Option<Vec<Value>>.
  • Bundled DuckDB upgraded to v1.5.3 (adds VARIANT metadata).

What's Changed

✂ Note

PR body was truncated to here.

Configuration

📅 Schedule: (in timezone Australia/Brisbane)

  • Branch creation
    • "after 8am on saturday"
  • Automerge
    • At any time (no schedule defined)

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

cubic-dev-ai[bot]
cubic-dev-ai Bot reviewed Apr 25, 2026
View reviewed changes

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 2 files

@sentry

sentry Bot commented Apr 25, 2026 •
edited by codecov Bot
Loading

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.25%. Comparing base (b0aec7e) to head (b2594dd).

Additional details and impacted files 
@@           Coverage Diff           @@
##             main      #33   +/-   ##
=======================================
  Coverage   91.25%   91.25%           
=======================================
  Files          12       12           
  Lines        2070     2070           
=======================================
  Hits         1889     1889           
  Misses        181      181

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@renovate
renovate Bot force-pushed the renovate/duckdb-and-arrow branch 2 times, most recently from d3f8499 to b156449 Compare May 9, 2026 13:38
@renovate renovate Bot changed the title Update Rust crate duckdb to v1.10502.0 Update duckdb and arrow May 9, 2026
@renovate
renovate Bot force-pushed the renovate/duckdb-and-arrow branch 3 times, most recently from 6e4a2c2 to 20dc77c Compare May 22, 2026 21:44
@renovate
renovate Bot force-pushed the renovate/duckdb-and-arrow branch 4 times, most recently from 8244dc8 to 1fc08ed Compare May 29, 2026 22:42
@renovate
renovate Bot force-pushed the renovate/duckdb-and-arrow branch 2 times, most recently from 8714525 to a960b37 Compare June 12, 2026 23:04
@renovate
renovate Bot force-pushed the renovate/duckdb-and-arrow branch 2 times, most recently from 95e3500 to b00f09f Compare June 27, 2026 00:40
@renovate
renovate Bot force-pushed the renovate/duckdb-and-arrow branch 2 times, most recently from 2c3a929 to 2d23f15 Compare July 6, 2026 01:57
@renovate
renovate Bot force-pushed the renovate/duckdb-and-arrow branch from 2d23f15 to 60a5057 Compare July 11, 2026 02:39
@renovate
renovate Bot force-pushed the renovate/duckdb-and-arrow branch 6 times, most recently from 5ce8fe2 to a7a019e Compare July 21, 2026 10:27
@renovate
renovate Bot force-pushed the renovate/duckdb-and-arrow branch from a7a019e to b2594dd Compare July 21, 2026 10:34
@itssimon
itssimon merged commit 56e3a28 into main Jul 21, 2026
8 checks passed
@itssimon
itssimon deleted the renovate/duckdb-and-arrow branch July 21, 2026 10:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@cubic-dev-ai cubic-dev-ai[bot] cubic-dev-ai[bot] left review comments

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@itssimon