Reorganization - #4
Conversation
Add bson to travis script try again... and again Alternative bsons final? absolute path reference
|
@mrocklin , thoughts, please, on what else needs to be done before making an entry on pypi and then conda-forge (the first is a prerequisite of the second, correct?). |
| install: | ||
| - pip install tox | ||
| # Install conda | ||
| - wget http://repo.continuum.io/miniconda/Miniconda-latest-Linux-x86_64.sh -O miniconda.sh |
There was a problem hiding this comment.
FYI I've had problems with http:// and conda recently. Recommend to switching to https://
| JSON or TSV (without the overhead of JVM startup). Performance has not | ||
| yet been optimized, but it's useful for debugging and quick viewing of | ||
| data in files. | ||
| fast is a python implementation of the `parquet |
|
|
||
| parquet-python has been tested on python 2.7, 3.4, and 3.5. It depends | ||
| on ``thrift`` (0.9) and ``python-snappy`` (for snappy compressed files). | ||
| Since the second week of October, this fork of `parquet-python`_ has been |
There was a problem hiding this comment.
Recommend having a history section towards the end that includes this information.
I suspect that most people reading the readme will not care about the recent history.
| - Implement writing | ||
| - performance evaluation and optimization (i.e. how does it compare to | ||
| the c++, java implementations) | ||
| > pip install git+https://github.com/martindurant/fastparquet |
There was a problem hiding this comment.
Markdown uses double colons for indentation:
Install from GitHub::
pip install git+https://github.com/martindurant/fastparquet
That means two colons on the previous line, then indent by three spaces (wonky, I know)
|
|
||
| .. code-block:: python | ||
|
|
||
| import fastparquet |
There was a problem hiding this comment.
Recommend using from fastparquet import ParquetFile in future examples so that if we need to change the name we'll have to rename less
|
You'll want to reivew the MANIFEST.in file. This should list all files that will go into the package on PyPI. I recommend looking at dask's. Here is the release procedure I use for dask:
|
|
Note that git clean will remove all files in the directory that are not part of the repository, so you may want to move notebooks, extra data, or benchmarks outside first or do this in a clean clone. |
No description provided.