Python package updates by FRidh · Pull Request #34553 · NixOS/nixpkgs · GitHub

Motivation for this change

Things done

Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)
- NixOS
- macOS
- other Linux distributions
Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
Tested execution of all binary files (usually in ./result/bin/)
Fits CONTRIBUTING.md.

https://hydra.nixos.org/jobset/nixpkgs/python-unstable

I also updated typing: dotlambda/nixpkgs@fd753e1
I however had to disable tests for Python 3.6. I must say I can't really follow python/typing#280 but typing should have any effect for Python 3.5 or later anyway.
Is there a way to add typing to buildInputs only for Python 3.4 and below? For example by making it null otherwise? This could however lead to unsatisfied requirements.

Wouldn't it make sense to remove all names in the updated derivations?

Is there a way to add typing to buildInputs only for Python 3.4 and below? For example by making it null otherwise? This could however lead to unsatisfied requirements.

buildInputs = [ ] ++ optionals pythonOlder "3.5" [ typing ];

Other solution we use mostly for backports:

typing = if pythonAtLeast "3.5" then null else buildPythonPackage rec { ... };

Wouldn't it make sense to remove all names in the updated derivations?

Feel free to create a commit that removes all of them. These updates are generated automatically.

I had already tried the second solution but that would cause packages requiring typing in their setup.py to fail to build. So I guess it is best left as is.

Don't you want to include the typing update?

@GrahamcOfBorg eval

Failure on x86_64-darwin (full log)

Partial log (click to expand)

Package ‘spyder-3.2.6’ in /private/var/lib/ofborg/checkout/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/lnl7-mac/pkgs/applications/science/spyder/default.nix:47 is not supported on ‘x86_64-darwin’, refusing to evaluate.

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowBroken = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowBroken = true; }
to ~/.config/nixpkgs/config.nix.

(@grahamc vs @GrahamcOfBorg 😆 )

Failure on x86_64-darwin (full log)

Partial log (click to expand)

Package ‘spyder-3.2.6’ in /private/var/lib/ofborg/checkout/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/lnl7-mac/pkgs/applications/science/spyder/default.nix:47 is not supported on ‘x86_64-darwin’, refusing to evaluate.

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowBroken = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowBroken = true; }
to ~/.config/nixpkgs/config.nix.

Failure on x86_64-linux (full log)

Partial log (click to expand)

Requirement already satisfied: pylint in /nix/store/hg7z39d2ifi0i83njd4j4xswbsfdfkjf-python2.7-pylint-1.8.2/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: jedi>=0.9.0 in /nix/store/mzaj8hm6x9szwskh1z6gmm4vcl4bz3ik-python2.7-jedi-0.11.1/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: pycodestyle in /nix/store/47fniyjczd3nacnym72mya9i4w8kinkz-python2.7-pycodestyle-2.3.1/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: psutil in /nix/store/96ral8lnx118a1qccink2z2bhsmyg7ar-python2.7-psutil-5.4.3/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: nbconvert in /nix/store/18mqml1f4gb9ya5w2plxvkf56bds2hh1-python2.7-nbconvert-5.3.1/lib/python2.7/site-packages (from spyder==3.2.6)
Collecting pyopengl; platform_system == "Linux" (from spyder==3.2.6)
  Could not find a version that satisfies the requirement pyopengl; platform_system == "Linux" (from spyder==3.2.6) (from versions: )
No matching distribution found for pyopengl; platform_system == "Linux" (from spyder==3.2.6)
builder for ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’ failed with exit code 1
error: build of ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’ failed

Failure on x86_64-darwin (full log)

Partial log (click to expand)

Package ‘spyder-3.2.6’ in /private/var/lib/ofborg/checkout/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/lnl7-mac/pkgs/applications/science/spyder/default.nix:47 is not supported on ‘x86_64-darwin’, refusing to evaluate.

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowBroken = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowBroken = true; }
to ~/.config/nixpkgs/config.nix.

Failure on x86_64-linux (full log)

Partial log (click to expand)

Requirement already satisfied: pylint in /nix/store/hg7z39d2ifi0i83njd4j4xswbsfdfkjf-python2.7-pylint-1.8.2/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: jedi>=0.9.0 in /nix/store/mzaj8hm6x9szwskh1z6gmm4vcl4bz3ik-python2.7-jedi-0.11.1/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: pycodestyle in /nix/store/47fniyjczd3nacnym72mya9i4w8kinkz-python2.7-pycodestyle-2.3.1/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: psutil in /nix/store/96ral8lnx118a1qccink2z2bhsmyg7ar-python2.7-psutil-5.4.3/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: nbconvert in /nix/store/18mqml1f4gb9ya5w2plxvkf56bds2hh1-python2.7-nbconvert-5.3.1/lib/python2.7/site-packages (from spyder==3.2.6)
Collecting pyopengl; platform_system == "Linux" (from spyder==3.2.6)
  Could not find a version that satisfies the requirement pyopengl; platform_system == "Linux" (from spyder==3.2.6) (from versions: )
No matching distribution found for pyopengl; platform_system == "Linux" (from spyder==3.2.6)
builder for ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’ failed with exit code 1
error: build of ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’ failed

Failure on x86_64-linux (full log)

Partial log (click to expand)

                         yyParenDepth--;
                         ^~~~~~~~~~~~
g++ -c -pipe -O2 -fno-exceptions -Wall -W -D_REENTRANT -fPIC -DSIP_PROTECTED_IS_PUBLIC -Dprotected=public -DPy_LIMITED_API=0x03040000 -DQT_NO_EXCEPTIONS -DQT_NO_DEBUG -DQT_PLUGIN -DQT_XML_LIB -DQT_CORE_LIB -I. -I. -isystem /nix/store/w81d7rbysi0rmf9c47njqbxjnllqv9cq-python-2.7.14/include/python2.7 -I../qpy/pylupdate -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtXml -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtCore -I. -I/nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/mkspecs/linux-g++ -o metatranslator.o ../qpy/pylupdate/metatranslator.cpp
g++ -c -pipe -O2 -fno-exceptions -Wall -W -D_REENTRANT -fPIC -DSIP_PROTECTED_IS_PUBLIC -Dprotected=public -DPy_LIMITED_API=0x03040000 -DQT_NO_EXCEPTIONS -DQT_NO_DEBUG -DQT_PLUGIN -DQT_XML_LIB -DQT_CORE_LIB -I. -I. -isystem /nix/store/w81d7rbysi0rmf9c47njqbxjnllqv9cq-python-2.7.14/include/python2.7 -I../qpy/pylupdate -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtXml -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtCore -I. -I/nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/mkspecs/linux-g++ -o numberh.o ../qpy/pylupdate/numberh.cpp
g++ -c -pipe -O2 -fno-exceptions -Wall -W -D_REENTRANT -fPIC -DSIP_PROTECTED_IS_PUBLIC -Dprotected=public -DPy_LIMITED_API=0x03040000 -DQT_NO_EXCEPTIONS -DQT_NO_DEBUG -DQT_PLUGIN -DQT_XML_LIB -DQT_CORE_LIB -I. -I. -isystem /nix/store/w81d7rbysi0rmf9c47njqbxjnllqv9cq-python-2.7.14/include/python2.7 -I../qpy/pylupdate -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtXml -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtCore -I. -I/nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/mkspecs/linux-g++ -o proparser.o ../qpy/pylupdate/proparser.cpp
g++ -c -pipe -O2 -fno-exceptions -Wall -W -D_REENTRANT -fPIC -DSIP_PROTECTED_IS_PUBLIC -Dprotected=public -DPy_LIMITED_API=0x03040000 -DQT_NO_EXCEPTIONS -DQT_NO_DEBUG -DQT_PLUGIN -DQT_XML_LIB -DQT_CORE_LIB -I. -I. -isystem /nix/store/w81d7rbysi0rmf9c47njqbxjnllqv9cq-python-2.7.14/include/python2.7 -I../qpy/pylupdate -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtXml -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtCore -I. -I/nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/mkspecs/linux-g++ -o sametexth.o ../qpy/pylupdate/sametexth.cpp
building of ‘/nix/store/nqg1b3h2dmvp7gr9zw1mf58il85flhrc-python2.7-PyQt-5.10.drv’ timed out after 1800 seconds
cannot build derivation ‘/nix/store/lr138a8lj9x8ajhxsvd0m3z3lghniac4-python2.7-qtconsole-4.3.1.drv’: 1 dependencies couldn't be built
cannot build derivation ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’: 1 dependencies couldn't be built
error: build of ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’ failed

Failure on aarch64-linux (full log)

Partial log (click to expand)

[2967/21250] CXX obj/services/service_manager/public/cpp/cpp/service_runner.o
[2968/21250] ACTION //third_party/WebKit/Source/bindings/core/v8:generate_bindings_core_v8_interfaces(/build/qtwebengine-everywhere-src-5.10.0/src/toolchain:target)
[2969/21250] CXX obj/services/service_manager/public/cpp/cpp/service.o
[2970/21250] ACTION //third_party/WebKit/Source/bindings/core/v8:bindings_core_conditional_features(/build/qtwebengine-everywhere-src-5.10.0/src/toolchain:target)
[2971/21250] CXX obj/services/service_manager/public/cpp/standalone_service/standalone_service/linux_sandbox.o
building of '/nix/store/k1zx0cqlwfyqpap7igla25vvryfq6af3-qtwebengine-5.10.0.drv' timed out after 3200 seconds
cannot build derivation '/nix/store/c9a3yajs6qidn9xv32wf539bfx673nxf-python2.7-PyQt-5.10.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/71fzqc715hcfjilnlpw8fcpjdn5fkhkb-python2.7-qtconsole-4.3.1.drv': 5 dependencies couldn't be built
cannot build derivation '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv': 9 dependencies couldn't be built
error: build of '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv' failed

Failure on aarch64-linux (full log)

Partial log (click to expand)

[4934/21250] CXX obj/third_party/icu/bundled_icui18n/regeximp.o
[4935/21250] CC obj/third_party/libvpx/bundled_libvpx/idct32x32_34_add_neon.o
[4936/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/rdft.o
[4937/21250] CXX obj/third_party/libwebm/libwebm/mkvmuxer.o
[4938/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/autorename_libavformat_options.o
building of '/nix/store/k1zx0cqlwfyqpap7igla25vvryfq6af3-qtwebengine-5.10.0.drv' timed out after 3600 seconds
cannot build derivation '/nix/store/c9a3yajs6qidn9xv32wf539bfx673nxf-python2.7-PyQt-5.10.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/71fzqc715hcfjilnlpw8fcpjdn5fkhkb-python2.7-qtconsole-4.3.1.drv': 5 dependencies couldn't be built
cannot build derivation '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv': 9 dependencies couldn't be built
error: build of '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv' failed

Failure on aarch64-linux (full log)

Partial log (click to expand)

[4930/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/flacdec.o
[4931/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/id3v1.o
[4932/21250] CXX obj/third_party/icu/bundled_icuuc/uhash_us.o
[4933/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/options.o
[4934/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/rmsipr.o
building of '/nix/store/k1zx0cqlwfyqpap7igla25vvryfq6af3-qtwebengine-5.10.0.drv' timed out after 3600 seconds
cannot build derivation '/nix/store/c9a3yajs6qidn9xv32wf539bfx673nxf-python2.7-PyQt-5.10.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/71fzqc715hcfjilnlpw8fcpjdn5fkhkb-python2.7-qtconsole-4.3.1.drv': 5 dependencies couldn't be built
cannot build derivation '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv': 9 dependencies couldn't be built
error: build of '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv' failed

Note I still get ``` This application failed to start because it could not find or load the Qt platform plugin "xcb" in "". ``` but that may be because I run it from the store which is not support for Qt5 applications.

FRidh added the 6.topic: python Python is a high-level, general-purpose programming language. label Feb 3, 2018

FRidh changed the base branch from master to staging February 3, 2018 11:45

FRidh mentioned this pull request Feb 3, 2018

pythonPackages.pyyaml: move derivation #34551

Closed

8 tasks

FRidh force-pushed the python-unstable branch from b3bd3fa to cf3fc6c Compare February 3, 2018 11:56

GrahamcOfBorg added 10.rebuild-darwin: 501+ This PR causes many rebuilds on Darwin and should normally target the staging branches. 10.rebuild-linux: 501+ This PR causes many rebuilds on Linux and should normally target the staging branches. labels Feb 3, 2018

dotlambda reviewed Feb 3, 2018

View reviewed changes

grahamc removed the 6.topic: python Python is a high-level, general-purpose programming language. label Feb 3, 2018

GrahamcOfBorg added the 6.topic: python Python is a high-level, general-purpose programming language. label Feb 3, 2018

grahamc removed the 6.topic: python Python is a high-level, general-purpose programming language. label Feb 3, 2018

GrahamcOfBorg added the 6.topic: python Python is a high-level, general-purpose programming language. label Feb 3, 2018

FRidh added 9 commits February 3, 2018 17:43

python.pkgs.pyopenssl: move expression

ef93322

python: adal: 0.4.7 -> 0.5.0

16754b1

python: agate-excel: 0.2.1 -> 0.2.2

154db19

python: agate-sql: 0.5.2 -> 0.5.3

127ebeb

python: ansicolor: 0.2.4 -> 0.2.6

e21699a

python: asgiref: 2.1.0 -> 2.1.1

6e8273a

python: astroid: 1.6.0 -> 1.6.1

af3b738

python: autopep8: 1.3.3 -> 1.3.4

806fb76

python: botocore: 1.8.33 -> 1.8.36

bfc92f8

FRidh and others added 19 commits February 3, 2018 17:43

python.pkgs.pyqt5: 5.9.2 -> 5.10

e375e77

python.pkgs.cryptography_vectors: move expression

40aff3b

python.pkgs.cryptography: move expression

bba1393

python: cryptography: 2.0.3 -> 2.1.4

796a7d6

python.pkgs.cryptography_vectors: 2.0.3 -> 2.1.4

dbb5b59

pythonPackages.pyyaml: move derivation

7953e05

python: pytz: 2017.2 -> 2017.3

330cad0

python.pkgs.simplegeneric: move expression

b18a0f4

python.pkgs.sympy: move expression

8e0a2b7

python.pkgs.sympy: 1.0 -> 1.1.1

84fe409

python.pkgs.packet-python: move expression

29e8365

python.pkgs.packet-python: 1.33 -> 1.37.1

7afd65a

python.pkgs.webcolors: 1.4 -> 1.7

6fee907

python.pkgs.dicttoxml: 1.6.4 -> 1.7.4

f875b10

python.pkgs.ovh: 0.4.5 -> 0.4.8

0821a22

python.pkgs.pybrain: remove broken and unmaintained package

6a87242

python.pkgs.pygments_2_0: remove unused expression

7765bd9

python.pkgs.quantities: 0.10.1 -> 0.12.1

4bd9faf

python: typing: 3.5.3.0 -> 3.6.4

66dc266

FRidh force-pushed the python-unstable branch from f065779 to 66dc266 Compare February 3, 2018 16:43

FRidh added 2 commits February 4, 2018 10:16

python.pkgs.pyqt5: minor improvements

be964d0

python.pkgs.spyder: fix expression

aaa50d5

Note I still get ``` This application failed to start because it could not find or load the Qt platform plugin "xcb" in "". ``` but that may be because I run it from the store which is not support for Qt5 applications.

FRidh merged commit c1d7950 into staging Feb 4, 2018

FRidh deleted the python-unstable branch February 4, 2018 13:29

Python package updates by FRidh · Pull Request #34553 · NixOS/nixpkgs · GitHub

Uh oh!

Uh oh!

Python package updates - #34553

Python package updates#34553FRidh merged 77 commits intostagingNixOS/nixpkgs:stagingfrom python-unstableNixOS/nixpkgs:python-unstableCopy head branch name to clipboard

Conversation

FRidh commented Feb 3, 2018

Motivation for this change

Things done

Uh oh!

dotlambda commented Feb 3, 2018

Uh oh!

dotlambda commented Feb 3, 2018

Uh oh!

dotlambda left a comment

Choose a reason for hiding this comment

Uh oh!

FRidh commented Feb 3, 2018

Uh oh!

dotlambda commented Feb 3, 2018

Uh oh!

dotlambda commented Feb 3, 2018

Uh oh!

grahamc commented Feb 3, 2018 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

GrahamcOfBorg commented Feb 3, 2018

Uh oh!

FRidh commented Feb 3, 2018

Uh oh!

GrahamcOfBorg commented Feb 3, 2018

Uh oh!

GrahamcOfBorg commented Feb 3, 2018

Uh oh!

GrahamcOfBorg commented Feb 3, 2018

Uh oh!

GrahamcOfBorg commented Feb 3, 2018

Uh oh!

GrahamcOfBorg commented Feb 3, 2018

Uh oh!

GrahamcOfBorg commented Feb 3, 2018

Uh oh!

GrahamcOfBorg commented Feb 3, 2018

Uh oh!

GrahamcOfBorg commented Feb 3, 2018

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Python package updates#34553
FRidh merged 77 commits into
stagingfrom
python-unstable

grahamc commented Feb 3, 2018 •
edited
Loading