This is an archive of the discontinued Mercurial Phabricator instance.

Differential D9950

ci: test real dependency installation for pip
ClosedPublic

Authored by joerg.sonnenberger on Feb 2 2021, 1:45 PM.

Details

Reviewers
None
Group Reviewers
hg-reviewers
Commits
rHGad107ed7a4aa: ci: test real dependency installation for pip
rHG9666392418e8: ci: test real dependency installation for pip
Summary

In the past, the pip smoke test inhibited actual dependency
installation, but that fails in different environments for setuptools
itself. Since it isn't what we actually want to test (which is pip
install), allow this to call home, if HGTESTS_ALLOW_NETIO=1 is set
in the environment.

Diff Detail

Repository
rHG Mercurial
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

joerg.sonnenberger retitled this revision from ci: test real dependency installation for pip [WIP] to ci: test real dependency installation for pip.Feb 12 2021, 9:12 AM
joerg.sonnenberger edited the summary of this revision. (Show Details)
joerg.sonnenberger updated this revision to Diff 25607.
durin42 added a subscriber: durin42.Feb 24 2021, 11:04 AM

I suspect this test works without network if setuptools is already installed, but I don't care enough to block it on that pedantry.

joerg.sonnenberger added a commit: rHG9666392418e8: ci: test real dependency installation for pip.Feb 24 2021, 11:11 AM
This revision was not accepted when it landed; it landed in state Needs Review.
Closed by commit rHG9666392418e8: ci: test real dependency installation for pip (authored by joerg.sonnenberger). · Explain Why
This revision was automatically updated to reflect the committed changes.

Revision Contents
Changeset List

PathPackages
Mtests/hghave.py (6 lines)
Mtests/test-install.t (12 lines)

Diff 25882

tests/hghave.py

@check("test-repo", "running tests from repository") @check("test-repo", "running tests from repository")
def has_test_repo(): def has_test_repo():
t = os.environ["TESTDIR"] t = os.environ["TESTDIR"]
return os.path.isdir(os.path.join(t, "..", ".hg")) return os.path.isdir(os.path.join(t, "..", ".hg"))
@check("network-io", "whether tests are allowed to access 3rd party services")
def has_test_repo():
t = os.environ.get("HGTESTS_ALLOW_NETIO")
return t == "1"
@check("curses", "terminfo compiler and curses module") @check("curses", "terminfo compiler and curses module")
def has_curses(): def has_curses():
try: try:
import curses import curses
curses.COLOR_BLUE curses.COLOR_BLUE
# Windows doesn't have a `tic` executable, but the windows_curses # Windows doesn't have a `tic` executable, but the windows_curses

tests/test-install.t

But some Linux distros strip out this module's functionality involving pip, But some Linux distros strip out this module's functionality involving pip,
so we have to look for the ensurepip module, which these distros strip out so we have to look for the ensurepip module, which these distros strip out
completely. completely.
On Python 2, we use the 3rd party virtualenv module, if available. On Python 2, we use the 3rd party virtualenv module, if available.
$ cd $TESTTMP $ cd $TESTTMP
$ unset PYTHONPATH $ unset PYTHONPATH
#if py3 ensurepip #if py3 ensurepip network-io
$ "$PYTHON" -m venv installenv >> pip.log $ "$PYTHON" -m venv installenv >> pip.log
Hack: Debian does something a bit different in ensurepip.bootstrap. This makes Hack: Debian does something a bit different in ensurepip.bootstrap. This makes
it so that pip thinks the 'wheel' wheel is installed so it can build wheels; it so that pip thinks the 'wheel' wheel is installed so it can build wheels;
when it goes to try, however, it shells out to run `python3 -u <setup.py>`, when it goes to try, however, it shells out to run `python3 -u <setup.py>`,
that *doesn't* get the 'wheel' wheel, and it fails with an invalid command that *doesn't* get the 'wheel' wheel, and it fails with an invalid command
'bdist_wheel'. To fix this, we just delete the wheel from where Debian put it in 'bdist_wheel'. To fix this, we just delete the wheel from where Debian put it in
our virtual env. Then pip doesn't think it's installed and doesn't try to build. our virtual env. Then pip doesn't think it's installed and doesn't try to build.
$ rm installenv/share/python-wheels/wheel-*.whl >/dev/null 2>&1 || true $ rm installenv/share/python-wheels/wheel-*.whl >/dev/null 2>&1 || true
Note: we use this weird path to run pip and hg to avoid platform differences, Note: we use this weird path to run pip and hg to avoid platform differences,
since it's bin on most platforms but Scripts on Windows. since it's bin on most platforms but Scripts on Windows.
$ ./installenv/*/pip install --no-index $TESTDIR/.. >> pip.log $ ./installenv/*/pip install $TESTDIR/.. >> pip.log
Failed building wheel for mercurial (?) Failed building wheel for mercurial (?)
WARNING: You are using pip version *; however, version * is available. (glob) (?)
You should consider upgrading via the '$TESTTMP/installenv/bin/python* -m pip install --upgrade pip' command. (glob) (?)
$ ./installenv/*/hg debuginstall || cat pip.log $ ./installenv/*/hg debuginstall || cat pip.log
checking encoding (ascii)... checking encoding (ascii)...
checking Python executable (*) (glob) checking Python executable (*) (glob)
checking Python implementation (*) (glob) checking Python implementation (*) (glob)
checking Python version (3.*) (glob) checking Python version (3.*) (glob)
checking Python lib (*)... (glob) checking Python lib (*)... (glob)
checking Python security support (*) (glob) checking Python security support (*) (glob)
checking Rust extensions \((installed|missing)\) (re) checking Rust extensions \((installed|missing)\) (re)
checking Mercurial version (*) (glob) checking Mercurial version (*) (glob)
checking Mercurial custom build (*) (glob) checking Mercurial custom build (*) (glob)
checking module policy (*) (glob) checking module policy (*) (glob)
checking installed modules (*/mercurial)... (glob) checking installed modules (*/mercurial)... (glob)
checking registered compression engines (*) (glob) checking registered compression engines (*) (glob)
checking available compression engines (*) (glob) checking available compression engines (*) (glob)
checking available compression engines for wire protocol (*) (glob) checking available compression engines for wire protocol (*) (glob)
checking "re2" regexp engine \((available|missing)\) (re) checking "re2" regexp engine \((available|missing)\) (re)
checking templates ($TESTTMP/installenv/*/site-packages/mercurial/templates)... (glob) checking templates ($TESTTMP/installenv/*/site-packages/mercurial/templates)... (glob)
checking default template ($TESTTMP/installenv/*/site-packages/mercurial/templates/map-cmdline.default) (glob) checking default template ($TESTTMP/installenv/*/site-packages/mercurial/templates/map-cmdline.default) (glob)
checking commit editor... (*) (glob) checking commit editor... (*) (glob)
checking username (test) checking username (test)
no problems detected no problems detected
#endif #endif
#if virtualenv no-py3 #if virtualenv no-py3 network-io
Note: --no-site-packages is the default for all versions enabled by hghave Note: --no-site-packages is the default for all versions enabled by hghave
$ "$PYTHON" -m virtualenv --never-download installenv >> pip.log $ "$PYTHON" -m virtualenv installenv >> pip.log
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. (?) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. (?)
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support (?) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support (?)
Note: we use this weird path to run pip and hg to avoid platform differences, Note: we use this weird path to run pip and hg to avoid platform differences,
since it's bin on most platforms but Scripts on Windows. since it's bin on most platforms but Scripts on Windows.
$ ./installenv/*/pip install --no-index $TESTDIR/.. >> pip.log $ ./installenv/*/pip install $TESTDIR/.. >> pip.log
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. (?) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. (?)
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support (?) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support (?)
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality. (?) DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality. (?)
$ ./installenv/*/hg debuginstall || cat pip.log $ ./installenv/*/hg debuginstall || cat pip.log
checking encoding (ascii)... checking encoding (ascii)...
checking Python executable (*) (glob) checking Python executable (*) (glob)
checking Python implementation (*) (glob) checking Python implementation (*) (glob)
checking Python version (2.*) (glob) checking Python version (2.*) (glob)