This is an archive of the discontinued Mercurial Phabricator instance.

Differential D9950

ci: test real dependency installation for pip
ClosedPublic

Authored by joerg.sonnenberger on Feb 2 2021, 1:45 PM.

Details

Reviewers
None
Group Reviewers
hg-reviewers
Commits
rHGad107ed7a4aa: ci: test real dependency installation for pip
rHG9666392418e8: ci: test real dependency installation for pip
Summary

In the past, the pip smoke test inhibited actual dependency
installation, but that fails in different environments for setuptools
itself. Since it isn't what we actually want to test (which is pip
install), allow this to call home, if HGTESTS_ALLOW_NETIO=1 is set
in the environment.

Diff Detail

Repository
rHG Mercurial
Branch
default
Lint
No Linters Available
Unit
No Unit Test Coverage

Event Timeline

joerg.sonnenberger retitled this revision from ci: test real dependency installation for pip [WIP] to ci: test real dependency installation for pip.Feb 12 2021, 9:12 AM
joerg.sonnenberger edited the summary of this revision. (Show Details)
joerg.sonnenberger updated this revision to Diff 25607.
durin42 added a subscriber: durin42.Feb 24 2021, 11:04 AM

I suspect this test works without network if setuptools is already installed, but I don't care enough to block it on that pedantry.

joerg.sonnenberger added a commit: rHG9666392418e8: ci: test real dependency installation for pip.Feb 24 2021, 11:11 AM
This revision was not accepted when it landed; it landed in state Needs Review.
Closed by commit rHG9666392418e8: ci: test real dependency installation for pip (authored by joerg.sonnenberger). · Explain Why
This revision was automatically updated to reflect the committed changes.

Revision Contents
Changeset List

PathPackages
Msetup.py (32 lines)
Mtests/test-install.t (8 lines)

Diff 25475

setup.py

version = numerictags[-1] version = numerictags[-1]
if hgid.endswith('+'): # propagate the dirty status to the tag if hgid.endswith('+'): # propagate the dirty status to the tag
version += '+' version += '+'
else: # no tag found else: # no tag found
ltagcmd = ['parents', '--template', '{latesttag}'] ltagcmd = ['parents', '--template', '{latesttag}']
ltag = sysstr(hg.run(ltagcmd)) ltag = sysstr(hg.run(ltagcmd))
changessincecmd = ['log', '-T', 'x\n', '-r', "only(.,'%s')" % ltag] changessincecmd = ['log', '-T', 'x\n', '-r', "only(.,'%s')" % ltag]
changessince = len(hg.run(changessincecmd).splitlines()) changessince = len(hg.run(changessincecmd).splitlines())
version = '%s+%s-%s' % (ltag, changessince, hgid) version = '%s+hg%s.%s' % (ltag, changessince, hgid)
if version.endswith('+'): if version.endswith('+'):
version += time.strftime('%Y%m%d') version = version[:-1] + 'local' + time.strftime('%Y%m%d')
elif os.path.exists('.hg_archival.txt'): elif os.path.exists('.hg_archival.txt'):
kw = dict( kw = dict(
[[t.strip() for t in l.split(':', 1)] for l in open('.hg_archival.txt')] [[t.strip() for t in l.split(':', 1)] for l in open('.hg_archival.txt')]
) )
if 'tag' in kw: if 'tag' in kw:
version = kw['tag'] version = kw['tag']
elif 'latesttag' in kw: elif 'latesttag' in kw:
if 'changessincelatesttag' in kw: if 'changessincelatesttag' in kw:
version = '%(latesttag)s+%(changessincelatesttag)s-%(node).12s' % kw version = (
'%(latesttag)s' # +.%(changessincelatesttag)s.%(node).12s' % kw
)
else: else:
version = '%(latesttag)s+%(latesttagdistance)s-%(node).12s' % kw version = (
'%(latesttag)s' # +.%(latesttagdistance)s.%(node).12s' % kw
)
else: else:
version = kw.get('node', '')[:12] version = '0' # + kw.get('node', '')[:12]
if version: if version:
versionb = version versionb = version
if not isinstance(versionb, bytes): if not isinstance(versionb, bytes):
versionb = versionb.encode('ascii') versionb = versionb.encode('ascii')
write_if_changed( write_if_changed(
'mercurial/__version__.py', 'mercurial/__version__.py',
b''.join( b''.join(
[ [
b'# this file is autogenerated by setup.py\n' b'# this file is autogenerated by setup.py\n'
b'version = b"%s"\n' % versionb, b'version = b"%s"\n' % versionb,
] ]
), ),
) )
try:
oldpolicy = os.environ.get('HGMODULEPOLICY', None)
os.environ['HGMODULEPOLICY'] = 'py'
from mercurial import __version__
version = __version__.version
except ImportError:
version = b'unknown'
finally:
if oldpolicy is None:
del os.environ['HGMODULEPOLICY']
else:
os.environ['HGMODULEPOLICY'] = oldpolicy
class hgbuild(build): class hgbuild(build):
# Insert hgbuildmo first so that files in mercurial/locale/ are found # Insert hgbuildmo first so that files in mercurial/locale/ are found
# when build_py is run next. # when build_py is run next.
sub_commands = [('build_mo', None)] + build.sub_commands sub_commands = [('build_mo', None)] + build.sub_commands
class hgbuildmo(build): class hgbuildmo(build):
packagedata[packagename] = list(filter(ordinarypath, files)) packagedata[packagename] = list(filter(ordinarypath, files))
datafiles = [] datafiles = []
# distutils expects version to be str/unicode. Converting it to # distutils expects version to be str/unicode. Converting it to
# unicode on Python 2 still works because it won't contain any # unicode on Python 2 still works because it won't contain any
# non-ascii bytes and will be implicitly converted back to bytes # non-ascii bytes and will be implicitly converted back to bytes
# when operated on. # when operated on.
assert isinstance(version, bytes) assert isinstance(version, str)
setupversion = version.decode('ascii') setupversion = version
extra = {} extra = {}
py2exepackages = [ py2exepackages = [
'hgdemandimport', 'hgdemandimport',
'hgext3rd', 'hgext3rd',
'hgext', 'hgext',
'email', 'email',

tests/test-install.t

when it goes to try, however, it shells out to run `python3 -u <setup.py>`, when it goes to try, however, it shells out to run `python3 -u <setup.py>`,
that *doesn't* get the 'wheel' wheel, and it fails with an invalid command that *doesn't* get the 'wheel' wheel, and it fails with an invalid command
'bdist_wheel'. To fix this, we just delete the wheel from where Debian put it in 'bdist_wheel'. To fix this, we just delete the wheel from where Debian put it in
our virtual env. Then pip doesn't think it's installed and doesn't try to build. our virtual env. Then pip doesn't think it's installed and doesn't try to build.
$ rm installenv/share/python-wheels/wheel-*.whl >/dev/null 2>&1 || true $ rm installenv/share/python-wheels/wheel-*.whl >/dev/null 2>&1 || true
Note: we use this weird path to run pip and hg to avoid platform differences, Note: we use this weird path to run pip and hg to avoid platform differences,
since it's bin on most platforms but Scripts on Windows. since it's bin on most platforms but Scripts on Windows.
$ ./installenv/*/pip install --no-index $TESTDIR/.. >> pip.log $ ./installenv/*/pip install $TESTDIR/.. >> pip.log
Failed building wheel for mercurial (?) Failed building wheel for mercurial (?)
WARNING: You are using pip version *; however, version * is available. (glob) (?)
You should consider upgrading via the '$TESTTMP/installenv/bin/python* -m pip install --upgrade pip' command. (glob) (?)
$ ./installenv/*/hg debuginstall || cat pip.log $ ./installenv/*/hg debuginstall || cat pip.log
checking encoding (ascii)... checking encoding (ascii)...
checking Python executable (*) (glob) checking Python executable (*) (glob)
checking Python implementation (*) (glob) checking Python implementation (*) (glob)
checking Python version (3.*) (glob) checking Python version (3.*) (glob)
checking Python lib (*)... (glob) checking Python lib (*)... (glob)
checking Python security support (*) (glob) checking Python security support (*) (glob)
checking Rust extensions \((installed|missing)\) (re) checking Rust extensions \((installed|missing)\) (re)
checking username (test) checking username (test)
no problems detected no problems detected
#endif #endif
#if virtualenv no-py3 #if virtualenv no-py3
Note: --no-site-packages is the default for all versions enabled by hghave Note: --no-site-packages is the default for all versions enabled by hghave
$ "$PYTHON" -m virtualenv --never-download installenv >> pip.log $ "$PYTHON" -m virtualenv installenv >> pip.log
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. (?) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. (?)
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support (?) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support (?)
Note: we use this weird path to run pip and hg to avoid platform differences, Note: we use this weird path to run pip and hg to avoid platform differences,
since it's bin on most platforms but Scripts on Windows. since it's bin on most platforms but Scripts on Windows.
$ ./installenv/*/pip install --no-index $TESTDIR/.. >> pip.log $ ./installenv/*/pip install $TESTDIR/.. >> pip.log
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. (?) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. (?)
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support (?) DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support (?)
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality. (?) DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality. (?)
$ ./installenv/*/hg debuginstall || cat pip.log $ ./installenv/*/hg debuginstall || cat pip.log
checking encoding (ascii)... checking encoding (ascii)...
checking Python executable (*) (glob) checking Python executable (*) (glob)
checking Python implementation (*) (glob) checking Python implementation (*) (glob)
checking Python version (2.*) (glob) checking Python version (2.*) (glob)