pip install panadas fails on numpy version

[NickDMax]

Code Sample, a copy-pastable example if possible

C:\Users\nickdmax
λ pip install pandas
Collecting pandas
  Downloading https://files.pythonhosted.org/packages/08/01/803834bc8a4e708aedebb133095a88a4dad9f45bbaf5ad777d2bea543c7e/pandas-0.22.0.tar.gz (11.3MB)
    100% |################################| 11.3MB 315kB/s
  Could not find a version that satisfies the requirement numpy==1.9.3 (from versions: 1.10.4, 1.11.0, 1.11.1rc1, 1.11.1, 1.11.2rc1, 1.11.2, 1.11.3, 1.12.0b1, 1.12.0rc1, 1.12.0rc2, 1.12.0, 1.12.1rc1, 1.12.1, 1.13.0rc1, 1.13.0rc2, 1.13.0, 1.13.1, 1.13.3, 1.14.0rc1, 1.14.0, 1.14.1, 1.14.2)
No matching distribution found for numpy==1.9.3

C:\Users\nickdmax
λ pip list
...
numpy               1.14.2
...

Problem description

I was unable to upgrade pandas (same error as above). I don't think I have ever had numpy 1.9.3 installed. Since there was a numpy directory under the current pandas directory I did an uninstall "pip uninstall pandas" to attempt to reinstall.

Output of pip freeze

vattrs==17.2.0 Automat==0.6.0 backcall==0.1.0 backports-abc==0.5 bleach==2.1.3 certifi==2017.4.17 chardet==3.0.4 colorama==0.3.9 constantly==15.1.0 cssselect==1.0.1 cycler==0.10.0 decorator==4.2.1 entrypoints==0.2.3 html5lib==1.0.1 hyperlink==17.3.0 idna==2.5 incremental==17.5.0 ipykernel==4.8.2 ipython==6.3.1 ipython-genutils==0.2.0 ipywidgets==7.2.1 jedi==0.11.1 Jinja2==2.10 jsonschema==2.6.0 jupyter==1.0.0 jupyter-client==5.2.3 jupyter-console==5.2.0 jupyter-core==4.4.0 kiwisolver==1.0.1 MarkupSafe==1.0 matplotlib==2.2.2 mistune==0.8.3 nbconvert==5.3.1 nbformat==4.4.0 notebook==5.0.0 numpy==1.14.2 pandocfilters==1.4.2 parso==0.1.1 pickleshare==0.7.4 prompt-toolkit==1.0.15 PyDispatcher==2.0.5 Pygments==2.2.0 PyParse==1.1.7 pyparsing==2.2.0 python-dateutil==2.7.2 pytz==2018.4 pywinpty==0.5.1 pyzmq==17.0.0 qtconsole==4.3.1 requests==2.18.2 Rx==1.5.9 scipy==0.19.1 simplegeneric==0.8.1 six==1.11.0 testpath==0.3.1 tornado==5.0.2 traitlets==4.3.2 typing==3.6.4 urllib3==1.22 virtualenv==15.1.0 w3lib==1.17.0 wcwidth==0.1.7 webencodings==0.5.1 widgetsnbextension==3.2.1 win-unicode-console==0.5 zope.interface==4.4.2

pip version 10.0.0

python -c "import numpy; print(numpy.version.version)"
1.14.2

[djhoese]

I'm having a similar error but only on Python 3.4 on Travis CI (Linux environment). Travis job is here: https://travis-ci.org/pytroll/satpy/jobs/366591944

Error is:

Collecting pandas>=0.18.0 (from xarray>=0.10.1->satpy==0.9.0a0)
  Downloading https://files.pythonhosted.org/packages/08/01/803834bc8a4e708aedebb133095a88a4dad9f45bbaf5ad777d2bea543c7e/pandas-0.22.0.tar.gz (11.3MB)
    100% |████████████████████████████████| 11.3MB 3.1MB/s 
  Installing build dependencies ... error
  Complete output from command /home/travis/virtualenv/python3.4.6/bin/python -m pip install --ignore-installed --no-user --prefix /tmp/pip-build-env-7kx4zl4m https://files.pythonhosted.org/packages/1b/d2/22cde5ea9af055f81814f9f2545f5ed8a053eb749c08d186b369959189a8/wheel-0.31.0-py2.py3-none-any.whl#sha256=9cdc8ab2cc9c3c2e2727a4b67c22881dbb0e1c503d592992594c5e131c867107 https://files.pythonhosted.org/packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl#sha256=8010754433e3211b9cdbbf784b50f30e80bf40fc6b05eb5f865fab83300599b8 https://files.pythonhosted.org/packages/70/25/1e1521e6ce2cf78ff4a8b06fbc2cd513ce004ec337000eddfe016fdf3fc6/Cython-0.28.2-cp34-cp34m-manylinux1_x86_64.whl#sha256=85f7432776870d65639fed00f951a3c05ef1e534bc72a73cd1200d79b9a7d7d0 https://files.pythonhosted.org/packages/fc/1b/a1717502572587c724858862fd9b98a66105f3a3443225bda9a1bd16ee14/numpy-1.9.3-cp34-cp34m-manylinux1_x86_64.whl#sha256=bff36563f9d6a06a81ae232f49d2946c84c05e391a7dff057496033c79507860 https://files.pythonhosted.org/packages/02/64/c6c1c24ff4dbcd789fcfdb782e343ac23c074f6b8b03e818ff60eb0f937f/numpy-1.12.1-cp34-cp34m-manylinux1_x86_64.whl#sha256=4eac5f2f624c5e7eecbdb51395ff39a099c48cab607a158f16f288c6fe39a2b3 https://files.pythonhosted.org/packages/1b/ee/f65826b2880f67652c21326565b4c166c7cdb1019f84b82af65e625475cd/numpy-1.13.1-cp34-cp34m-manylinux1_x86_64.whl#sha256=838e48df3703c8747f355cd6386e0680b906a2f7b2bbd304e8a2d531692484ce:
  Double requirement given: numpy==1.12.1 from https://files.pythonhosted.org/packages/02/64/c6c1c24ff4dbcd789fcfdb782e343ac23c074f6b8b03e818ff60eb0f937f/numpy-1.12.1-cp34-cp34m-manylinux1_x86_64.whl#sha256=4eac5f2f624c5e7eecbdb51395ff39a099c48cab607a158f16f288c6fe39a2b3 (already in numpy==1.9.3 from https://files.pythonhosted.org/packages/fc/1b/a1717502572587c724858862fd9b98a66105f3a3443225bda9a1bd16ee14/numpy-1.9.3-cp34-cp34m-manylinux1_x86_64.whl#sha256=bff36563f9d6a06a81ae232f49d2946c84c05e391a7dff057496033c79507860, name='numpy')
  
  ----------------------------------------
Command "/home/travis/virtualenv/python3.4.6/bin/python -m pip install --ignore-installed --no-user --prefix /tmp/pip-build-env-7kx4zl4m https://files.pythonhosted.org/packages/1b/d2/22cde5ea9af055f81814f9f2545f5ed8a053eb749c08d186b369959189a8/wheel-0.31.0-py2.py3-none-any.whl#sha256=9cdc8ab2cc9c3c2e2727a4b67c22881dbb0e1c503d592992594c5e131c867107 https://files.pythonhosted.org/packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl#sha256=8010754433e3211b9cdbbf784b50f30e80bf40fc6b05eb5f865fab83300599b8 https://files.pythonhosted.org/packages/70/25/1e1521e6ce2cf78ff4a8b06fbc2cd513ce004ec337000eddfe016fdf3fc6/Cython-0.28.2-cp34-cp34m-manylinux1_x86_64.whl#sha256=85f7432776870d65639fed00f951a3c05ef1e534bc72a73cd1200d79b9a7d7d0 https://files.pythonhosted.org/packages/fc/1b/a1717502572587c724858862fd9b98a66105f3a3443225bda9a1bd16ee14/numpy-1.9.3-cp34-cp34m-manylinux1_x86_64.whl#sha256=bff36563f9d6a06a81ae232f49d2946c84c05e391a7dff057496033c79507860 https://files.pythonhosted.org/packages/02/64/c6c1c24ff4dbcd789fcfdb782e343ac23c074f6b8b03e818ff60eb0f937f/numpy-1.12.1-cp34-cp34m-manylinux1_x86_64.whl#sha256=4eac5f2f624c5e7eecbdb51395ff39a099c48cab607a158f16f288c6fe39a2b3 https://files.pythonhosted.org/packages/1b/ee/f65826b2880f67652c21326565b4c166c7cdb1019f84b82af65e625475cd/numpy-1.13.1-cp34-cp34m-manylinux1_x86_64.whl#sha256=838e48df3703c8747f355cd6386e0680b906a2f7b2bbd304e8a2d531692484ce" failed with error code 1 in None

This is with pip 10.0 installed. If I need to file another bug I can, this just looked similar.

[djhoese]

Looks like other python versions have a wheel, python 3.4 environment is building from source. So must be a bug with pip 10.0 and it's new "build from source" functionality?

[jreback]

3.4 is no longer supoorted

[djhoese]

@jreback The issue seems to be related to pip 10.0 for me. With pip 9.0.3 it seems to download pandas 0.22 (via xarray dependency of >0.18.0). I guess my question on the pandas side is shouldn't there be something in the pandas package metadata to limit the python version so 0.22 isn't downloaded on Python 3.4?

Edit: Something like this: https://packaging.python.org/guides/dropping-older-python-versions/

[jreback]

3.4 is simply not supported and 0.22 was release quite a while ago

[djhoese]

Understood. However, pandas 0.22 is still downloaded on Python 3.4 environments. Shouldn't pandas (even if only in the future) add something to limit what versions of python it is downloaded for? Like the python_requires argument mentioned in my link above? I've never had to worry about this before so I'm not sure what is standard practice for limiting python and package versions like this.

I will file a bug with pip about the specific error message I was getting.

[sandeepdas]

v0.22.0 latest release is December 29, 2017 from pandas, so not that old -- why 3.4 is not supported?

[jreback]

i suppose in an ideal world we would put a python_requires - so would take a patch for that

[jreback]

we support 3.5+ the world has moved on from 3.4

[djhoese]

ok so Officially Python 2.7, 3.5, and 3.6. is still true?

Also "the world has moved on from 3.4", maybe in your world because you forced it. Not everyone can afford to upgrade python versions. That said, I agree and wouldn't support 3.4 either if I had a feature that was more difficult to code on 3.4.

[jreback]

actually we dropped 3.4 in october of last year: http://pandas.pydata.org/pandas-docs/stable/whatsnew.html#dependencies-have-increased-minimum-versions

ok so Officially Python 2.7, 3.5, and 3.6. is still true?

yes

Also "the world has moved on from 3.4", maybe in your world because you forced it. Not everyone can afford to upgrade python versions. That said, I agree and wouldn't support 3.4 either if I had a feature that was more difficult to code on 3.4.

that's quite disingenuous. supporting older versions takes time & effort, not to mention the additional code complexity. None of the contributors are paid for anything, nor are the thousands of companies that use panda contributing. If you can't / won't upgrade, then you will miss out. open source is not FREE. you have to have contributors. If someone want to support 3.4 that would be great.

Just wait for 0.23.0 (soon) when we are announcing dropping 2.7 support at the end of the year. Can't wait for the howls from that!

[djhoese]

I wouldn't say disingenuous, just not experienced in complex features that actually required dropping python 3.4 in my own projects (except for maybe some pickle serialization...). Pull request incoming...

Edit: About volunteering, as the person who semi-recently became the maintainer of vispy, I get it. I seem to have the tendency of becoming the maintainer of projects that no one else has time for.