Uwe L. Korn
bf30235fa3
Author: Uwe L. Korn <uwelk@xhochy.com>
Closes #149 from xhochy/arrow-306 and squashes the following commits:
11a3e66 [Uwe L. Korn] ARROW-306: Add option to pass cmake arguments via environment variable
Python library for Apache Arrow
This library provides a Pythonic API wrapper for the reference Arrow C++ implementation, along with tools for interoperability with pandas, NumPy, and other traditional Python scientific computing packages.
Development details
This project is layered in two pieces:
- pyarrow, a C++ library for easier interoperability between Arrow C++, NumPy, and pandas
- Cython extensions and pure Python code under arrow/ which expose Arrow C++ and pyarrow to pure Python users
PyArrow Dependencies:
These are the various projects that PyArrow depends on.
- g++ and gcc Version >= 4.8
- cmake > 2.8.6
- boost
- Parquet-cpp
The preferred way to install parquet-cpp is to use conda.
You need to set the PARQUET_HOME environment variable to where parquet-cpp is installed.
conda install -y --channel apache/channel/dev parquet-cpp
-
Arrow-cpp and its dependencies*
The Arrow C++ library must be built with all options enabled and installed with
ARROW_HOMEenvironment variable set to the installation location. Look at (https://github.com/apache/arrow/blob/master/cpp/README.md) for instructions. Alternatively you could just install arrow-cpp from conda.
conda install arrow-cpp -c apache/channel/dev
- Python dependencies: numpy, pandas, cython, pytest
Install pyarrow
python setup.py build_ext --inplace