Aaditya SrinivasanandAntoine Pitrou 3cb299408d GH-50944: [C++] Replace RapidJSON with simdjson in JSON chunker (#50945) ...

### Rationale for this change

This PR continues the simdjson migration by replacing the RapidJSON-based JSON boundary detection used by the JSON chunker.

The existing implementation uses RapidJSON's streaming parser to identify complete JSON values. This change replaces that logic with the simdjson streaming parser.

### Are these changes tested?
    
Yes, by existing tests.
    
### Are there any user-facing changes?
    
No, except perhaps slight differences in error message and timing of error reporting when reading from an invalid JSON stream (i.e. there may be cases where a JSON parse error is reported earlier or later while iterating over RecordBatches).

* GitHub Issue: #50944

Lead-authored-by: Aaditya Srinivasan <aadityasri03@gmail.com>
Co-authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>

2026-09-16 08:54:38 +02:00

..

data

GH-34257:[Docs] Update git links/branches from master to main for external projects (#34502)

2023-03-08 10:10:42 -08:00

interchange

GH-48808: [Python] Drop support for Pandas < 2.0.3 (#50444)

2026-07-09 19:30:12 +02:00

parquet

GH-51238: [C++][Python][Parquet] Limit schema nesting depth when reading (#51239)

2026-09-09 18:06:11 +02:00

__init__.py

ARROW-54: [Python] Rename package to "pyarrow"

2016-03-09 15:45:05 -08:00

arrow_7980.py

ARROW-7980: [Python] Fix creation of tz-aware datetime dtype on first pandas import

2020-03-05 20:36:24 -06:00

arrow_16597.py

ARROW-16597: [Python][FlightRPC] Force server shutdown at interpreter exit

2022-05-31 18:27:03 +02:00

arrow_39313.py

GH-39313: [Python] Fix race condition in _pandas_api#_check_import (#39314)

2024-01-09 14:25:21 +01:00

bound_function_visit_strings.pyx

GH-31905: [DevTools] Add linting to Cython files (#14662)

2023-03-08 23:20:22 +01:00

conftest.py

GH-48593: [C++] C++20: use standard calendar / timezone APIs (#48601)

2026-03-03 14:19:25 +01:00

extensions.pyx

GH-45908: [C++][Docs] Rename and expose basic {Array,...}FromJSON helpers as public APIs (#46180)

2025-05-14 07:22:02 -07:00

pandas_examples.py

GH-45619: [Python] Use f-string instead of string.format (#45629)

2025-05-12 14:34:49 +02:00

pandas_threaded_import.py

ARROW-10519: [Python] Fix deadlock when importing pandas from several threads

2020-11-16 11:48:44 +01:00

pyarrow_cython_example.pyx

GH-40023: [Python] Use Cast() instead of CastTo (#40116)

2024-03-11 09:49:10 +01:00

read_record_batch.py

ARROW-15783: [Python] Initialize static pandas data on write

2022-04-04 10:47:53 +02:00

strategies.py

GH-31318: [Python] Add fixed-offset timezones to Hypothesis test strategy (#49844)

2026-05-05 09:22:17 +02:00

test_acero.py

GH-50801: [Python] Expose the record_batch_reader_source Acero node (RecordBatchReaderSourceNodeOptions) (#50802)

2026-08-12 19:30:06 -07:00

test_adhoc_memory_leak.py

GH-25118: [Python] Make NumPy an optional runtime dependency (#41904)

2024-09-02 16:35:26 +02:00

test_array.py

GH-48473: [CI][Python] Require numpy 2.0 (#50769)

2026-08-21 19:16:28 +02:00

test_builder.py

GH-25118: [Python] Make NumPy an optional runtime dependency (#41904)

2024-09-02 16:35:26 +02:00

test_cffi.py

GH-49740: [C++][Python] Fix casts to view types leaving null variadic buffers (#50166)

2026-07-01 10:08:18 +02:00

test_compute.py

GH-51225: [C++] utf8_normalize: compose for NFC and NFKC (#51237)

2026-09-10 18:02:24 +02:00

test_convert_builtin.py

GH-48473: [CI][Python] Require numpy 2.0 (#50769)

2026-08-21 19:16:28 +02:00

test_cpp_internals.py

GH-49566: [Python] Skip header files when installing compiled Cython files and other Python release verification fixes (#49571)

2026-03-25 10:51:00 +01:00

test_csv.py

GH-34577 [Python] Expose eol and null_string csv WriteOptions (#46976)

2026-09-09 13:27:13 +02:00

test_cuda_numba_interop.py

GH-50176: [Python] Explicitly pass exc_type=ImportError to importorskip pyarrow.* (#50177)

2026-06-16 16:23:12 +02:00

test_cuda.py

GH-12594: [Python][GPU] Remove inherently crashy CUDA test (#51206)

2026-09-07 14:32:48 +02:00

test_cython.py

GH-45885: [C++] Require C++20 (#48414)

2025-12-18 17:17:13 +01:00

test_dataset_encryption.py

GH-41246: [C++][Python] Simplify nested field encryption configuration (#45462)

2025-12-16 13:15:54 +01:00

test_dataset.py

GH-51238: [C++][Python][Parquet] Limit schema nesting depth when reading (#51239)

2026-09-09 18:06:11 +02:00

test_deprecations.py

ARROW-1395: [C++/Python] Remove APIs deprecated from 0.5.0 onward

2017-08-21 22:30:20 -04:00

test_device.py

GH-42222: [Python] Add bindings for CopyTo on RecordBatch and Array classes (#42223)

2024-08-21 14:18:45 +02:00

test_dlpack.py

GH-39295: [C++][Python] ConsumingDLPack on Arrays and Tensor (#51122)

2026-09-10 17:04:57 +02:00

test_exec_plan.py

GH-36709: [Python] Allow to specify use_threads=False in Table.group_by to have stable ordering (#36768)

2023-10-05 09:21:56 +02:00

test_extension_type.py

GH-39295: [C++][Python] ConsumingDLPack on Arrays and Tensor (#51122)

2026-09-10 17:04:57 +02:00

test_feather.py

GH-48473: [CI][Python] Require numpy 2.0 (#50769)

2026-08-21 19:16:28 +02:00

test_flight_async.py

GH-50176: [Python] Explicitly pass exc_type=ImportError to importorskip pyarrow.* (#50177)

2026-06-16 16:23:12 +02:00

test_flight.py

GH-50684: [Python][FlightRPC] Break the reference cycle between the C++ FlightServerBase and the Python object to avoid leaking server (#50687)

2026-07-31 08:59:19 +02:00

test_fs.py

GH-49078: [FS][Azure] Fix lossy pickling of SubTreeFileSystem(base_path, AzureFileSystem(...)) (#49140)

2026-03-02 11:28:25 +01:00

test_gandiva.py

GH-37848: [C++][Gandiva] Migrate LLVM JIT engine from MCJIT to ORC v2/LLJIT (#39098)

2024-01-05 04:02:40 +09:00

test_gdb.py

GH-50660: [C++][Dev] Add Decimal32 and Decimal64 GDB pretty-printers (#50723)

2026-07-30 10:23:37 +02:00

test_io.py

GH-51044: [Python] Reject read-only readinto destinations (#51126)

2026-09-09 11:59:59 +02:00

test_ipc.py

GH-49305: [Python] Expose RecordBatchFileReader.count_rows (#50646)

2026-07-30 11:59:47 +02:00

test_json.py

GH-50944: [C++] Replace RapidJSON with simdjson in JSON chunker (#50945)

2026-09-16 08:54:38 +02:00

test_jvm.py

GH-45619: [Python] Use f-string instead of string.format (#45629)

2025-05-12 14:34:49 +02:00

test_memory.py

GH-50277: [CI][Python] Avoid using generators for test parametrization on newer Pytest (#50278)

2026-06-30 09:21:58 +02:00

test_misc.py

GH-48593: [C++] C++20: use standard calendar / timezone APIs (#48601)

2026-03-03 14:19:25 +01:00

test_orc.py

GH-47778: [CI][Python] Remove ORC alias timezone for US/Pacific on test_orc.py::test_timezone_absent (#47956)

2025-10-27 18:10:18 +01:00

test_pandas.py

GH-48473: [CI][Python] Require numpy 2.0 (#50769)

2026-08-21 19:16:28 +02:00

test_scalars.py

GH-32007: [Python] Support arithmetic on arrays and scalars (#48085)

2026-03-27 09:07:21 +01:00

test_schema.py

GH-48473: [CI][Python] Require numpy 2.0 (#50769)

2026-08-21 19:16:28 +02:00

test_sparse_tensor.py

GH-45229: [Python] Migrate from scipy.spmatrix to scipy.sparray (#46423)

2025-07-03 20:03:06 +02:00

test_strategies.py

GH-31318: [Python] Add fixed-offset timezones to Hypothesis test strategy (#49844)

2026-05-05 09:22:17 +02:00

test_substrait.py

GH-41692: [Python] Improve substrait extended expressions support (#41693)

2024-10-16 14:58:37 +02:00

test_table.py

GH-48344: [Python] Fix Table.from_struct_array for empty ChunkedArray (#49869)

2026-08-28 07:14:37 +02:00

test_tensor.py

GH-25118: [Python] Make NumPy an optional runtime dependency (#41904)

2024-09-02 16:35:26 +02:00

test_types.py

GH-50847: [Python] Add Type_RUN_END_ENCODED to _NESTED_TYPES set (#50848)

2026-08-27 16:01:56 +02:00

test_udf.py

GH-25118: [Python] Make NumPy an optional runtime dependency (#41904)

2024-09-02 16:35:26 +02:00

test_util.py

GH-48593: [C++] C++20: use standard calendar / timezone APIs (#48601)

2026-03-03 14:19:25 +01:00

test_without_numpy.py

GH-25118: [Python] Make NumPy an optional runtime dependency (#41904)

2024-09-02 16:35:26 +02:00

util.py

GH-48593: [C++] C++20: use standard calendar / timezone APIs (#48601)

2026-03-03 14:19:25 +01:00

wsgi_examples.py

GH-44071: [C++] Leak S3 structures if finalization happens too late (#44090)

2024-09-23 10:30:28 +02:00