arrow

mirrors/arrow

0 Fork 0

mirror of https://github.com/apache/arrow.git synced 2026-10-28 16:47:19 +08:00

Files

T

tadeja dc90604891 GH-51220: [Python][Parquet] Accept write_table options in dataset writer (#51461 )

### Rationale for this change
Fix #51220 - Parquet `write_table` options are not all accepted in dataset `ParquetFileWriteOptions` so `pyarrow.parquet.write_to_dataset( ...)` raises `TypeError: unexpected parquet write option:`
for `bloom_filter_options` ,  `write_time_adjusted_to_utc` or `store_schema` 

(Similar to past #37469)
### What changes are included in this PR?
Add `bloom_filter_options`, `store_schema`, `write_time_adjusted_to_utc` to `ParquetFileWriteOptions`,
also explicitly expose `bloom_filter_options` in `pyarrow.parquet.ParquetWriter`.
Test writer options in `make_write_options`, and test three newly supported options in `write_to_dataset`

### Are these changes tested?
Yes. CI also passes.

### Are there any user-facing changes?
Yes, users may now use `bloom_filter_options` ,  `write_time_adjusted_to_utc` and `store_schema`
in `pyarrow.parquet.write_to_dataset(...)` and in `ParquetFileFormat.make_write_options(...)` without raising TypeError.

### Was AI used for this PR?

**PR code and description written by:**

- [x] Human
- [ ] AI

**Reviewed before submission by:**

- [x] Human
- [x] AI
- [ ] Not reviewed
* GitHub Issue: #51220

Authored-by: Tadeja Kadunc <tadeja.kadunc@gmail.com>
Signed-off-by: Rok Mihevc <rok@mihevc.org>

2026-09-29 20:41:28 +02:00

benchmarks

GH-48473: [CI][Python] Require numpy 2.0 (#50769 )

2026-08-21 19:16:28 +02:00

examples

GH-50410: [Python][Packaging] Drop Python 3.10 support (#50411 )

2026-07-09 12:33:32 +02:00

pyarrow

GH-51220: [Python][Parquet] Accept write_table options in dataset writer (#51461 )

2026-09-29 20:41:28 +02:00

pyarrow-stubs/pyarrow

GH-49102: [CI] Add type checking infrastructure and CI workflow for type annotations (#48618 )

2026-02-09 19:47:45 +01:00

scripts

GH-49046: [Dev][Python] Remove unused scripts under python/scripts (#50640 )

2026-07-27 11:28:57 +02:00

.coveragerc

ARROW-2574: [Python] Add Cython and Python code coverage

2018-05-17 16:21:47 +02:00

.gitignore

GH-36411: [Python] Use scikit-build-core as build backend for PyArrow and get rid of setup.py (#49259 )

2026-03-09 09:47:21 +01:00

cmake_modules

ARROW-1535: [Python] Enable sdist tarballs to be installed

2017-10-08 21:09:03 -04:00

CMakeLists.txt

GH-50194: [C++] Move S3 and AWS-SDK to its own libarrow_s3.so (#50195 )

2026-09-17 11:48:51 +02:00

LICENSE.txt

GH-36411: [Python] Use scikit-build-core as build backend for PyArrow and get rid of setup.py (#49259 )

2026-03-09 09:47:21 +01:00

MANIFEST.in

GH-49234: [CI][Python] Nightly sdist job fails due to missing update_stub_docstrings.py file (#49235 )

2026-02-13 12:05:33 +01:00

NOTICE.txt

GH-36411: [Python] Use scikit-build-core as build backend for PyArrow and get rid of setup.py (#49259 )

2026-03-09 09:47:21 +01:00

pyproject.toml

GH-48473: [CI][Python] Require numpy 2.0 (#50769 )

2026-08-21 19:16:28 +02:00

README.md

MINOR: [Docs] Change Conda PyArrow badge to Anaconda's official one (#48390 )

2025-12-10 09:30:50 +09:00

requirements-build.txt

GH-48473: [CI][Python] Require numpy 2.0 (#50769 )

2026-08-21 19:16:28 +02:00

requirements-test.txt

GH-51636: [CI][Python] Switch back to Pandas release for Python 3.15 (#51637 )

2026-09-29 19:13:39 +02:00

requirements-wheel-build.txt

GH-48172: [Python] Add cp315 to build (#48191 )

2026-08-21 14:18:33 +02:00

requirements-wheel-test.txt

GH-51636: [CI][Python] Switch back to Pandas release for Python 3.15 (#51637 )

2026-09-29 19:13:39 +02:00

setup.cfg

GH-48473: [CI][Python] Require numpy 2.0 (#50769 )

2026-08-21 19:16:28 +02:00

README.md

Python library for Apache Arrow

This library provides a Python API for functionality provided by the Arrow C++ libraries, along with tools for Arrow integration and interoperability with pandas, NumPy, and other software in the Python ecosystem.

Installing

Across platforms, you can install a recent version of pyarrow with the conda package manager:

conda install pyarrow -c conda-forge

On Linux, macOS, and Windows, you can also install binary wheels from PyPI with pip:

pip install pyarrow

If you encounter any issues importing the pip wheels on Windows, you may need to install the latest Visual C++ Redistributable for Visual Studio.

Development

See Python Development in the documentation subproject.

Building the documentation

See documentation build instructions in the documentation subproject.