( )⚙ D1971 perf: add a perfunidiff command for benchmarking unified diff speed

This is an archive of the discontinued Mercurial Phabricator instance.

Differential D1971

perf: add a perfunidiff command for benchmarking unified diff speed
ClosedPublic

Authored by durin42 on Feb 1 2018, 4:58 PM.

Details

Reviewers
indygreg
Group Reviewers
hg-reviewers
Commits
rHGed939545edd0: perf: add a perfunidiff command for benchmarking unified diff speed
rHG204435ef0a6f: perf: add a perfunidiff command for benchmarking unified diff speed

Diff Detail

Repository
rHG Mercurial
Lint
Lint Skipped
Unit
Unit Tests Skipped

Event Timeline

durin42 created this revision.Feb 1 2018, 4:58 PM
indygreg accepted this revision.Feb 1 2018, 5:46 PM
indygreg added a subscriber: indygreg.

Nice.

This revision is now accepted and ready to land.Feb 1 2018, 5:46 PM
Closed by commit rHG204435ef0a6f: perf: add a perfunidiff command for benchmarking unified diff speed (authored by durin42). · Explain WhyFeb 1 2018, 6:09 PM
This revision was automatically updated to reflect the committed changes.

Revision Contents
Changeset List

PathPackages
Mcontrib/perf.py (65 lines)
Mtests/test-contrib-perf.t (3 lines)

Diff 5084

contrib/perf.py

if withthreads: if withthreads:
done.set() done.set()
for i in xrange(threads): for i in xrange(threads):
q.put(None) q.put(None)
with ready: with ready:
ready.notify_all() ready.notify_all()
@command('perfunidiff', revlogopts + formatteropts + [
('', 'count', 1, 'number of revisions to test (when using --startrev)'),
('', 'alldata', False, 'test unidiffs for all associated revisions'),
], '-c|-m|FILE REV')
def perfunidiff(ui, repo, file_, rev=None, count=None, **opts):
"""benchmark a unified diff between revisions
This doesn't include any copy tracing - it's just a unified diff
of the texts.
By default, benchmark a diff between its delta parent and itself.
With ``--count``, benchmark diffs between delta parents and self for N
revisions starting at the specified revision.
With ``--alldata``, assume the requested revision is a changeset and
measure diffs for all changes related to that changeset (manifest
and filelogs).
"""
if opts['alldata']:
opts['changelog'] = True
if opts.get('changelog') or opts.get('manifest'):
file_, rev = None, file_
elif rev is None:
raise error.CommandError('perfunidiff', 'invalid arguments')
textpairs = []
r = cmdutil.openrevlog(repo, 'perfunidiff', file_, opts)
startrev = r.rev(r.lookup(rev))
for rev in range(startrev, min(startrev + count, len(r) - 1)):
if opts['alldata']:
# Load revisions associated with changeset.
ctx = repo[rev]
mtext = repo.manifestlog._revlog.revision(ctx.manifestnode())
for pctx in ctx.parents():
pman = repo.manifestlog._revlog.revision(pctx.manifestnode())
textpairs.append((pman, mtext))
# Load filelog revisions by iterating manifest delta.
man = ctx.manifest()
pman = ctx.p1().manifest()
for filename, change in pman.diff(man).items():
fctx = repo.file(filename)
f1 = fctx.revision(change[0][0] or -1)
f2 = fctx.revision(change[1][0] or -1)
textpairs.append((f1, f2))
else:
dp = r.deltaparent(rev)
textpairs.append((r.revision(dp), r.revision(rev)))
def d():
for left, right in textpairs:
# The date strings don't matter, so we pass empty strings.
headerlines, hunks = mdiff.unidiff(
left, '', right, '', 'left', 'right')
# consume iterators in roughly the way patch.py does
b'\n'.join(headerlines)
b''.join(sum((list(hlines) for hrange, hlines in hunks), []))
timer, fm = gettimer(ui, opts)
timer(d)
fm.end()
@command('perfdiffwd', formatteropts) @command('perfdiffwd', formatteropts)
def perfdiffwd(ui, repo, **opts): def perfdiffwd(ui, repo, **opts):
"""Profile diff of working directory changes""" """Profile diff of working directory changes"""
timer, fm = gettimer(ui, opts) timer, fm = gettimer(ui, opts)
options = { options = {
'w': 'ignore_all_space', 'w': 'ignore_all_space',
'b': 'ignore_space_change', 'b': 'ignore_space_change',
'B': 'ignore_blank_lines', 'B': 'ignore_blank_lines',

tests/test-contrib-perf.t

Benchmark reading a series of revisions from a revlog. Benchmark reading a series of revisions from a revlog.
perfrevrange (no help text available) perfrevrange (no help text available)
perfrevset benchmark the execution time of a revset perfrevset benchmark the execution time of a revset
perfstartup (no help text available) perfstartup (no help text available)
perfstatus (no help text available) perfstatus (no help text available)
perftags (no help text available) perftags (no help text available)
perftemplating perftemplating
(no help text available) (no help text available)
perfunidiff benchmark a unified diff between revisions
perfvolatilesets perfvolatilesets
benchmark the computation of various volatile set benchmark the computation of various volatile set
perfwalk (no help text available) perfwalk (no help text available)
perfwrite microbenchmark ui.write perfwrite microbenchmark ui.write
(use 'hg help -v perfstatusext' to show built-in aliases and global options) (use 'hg help -v perfstatusext' to show built-in aliases and global options)
$ hg perfaddremove $ hg perfaddremove
$ hg perfancestors $ hg perfancestors
$ hg perfancestorset 2 $ hg perfancestorset 2
$ hg perfannotate a $ hg perfannotate a
$ hg perfbdiff -c 1 $ hg perfbdiff -c 1
$ hg perfbdiff --alldata 1 $ hg perfbdiff --alldata 1
$ hg perfunidiff -c 1
$ hg perfunidiff --alldata 1
$ hg perfbookmarks $ hg perfbookmarks
$ hg perfbranchmap $ hg perfbranchmap
$ hg perfcca $ hg perfcca
$ hg perfchangegroupchangelog $ hg perfchangegroupchangelog
$ hg perfchangeset 2 $ hg perfchangeset 2
$ hg perfctxfiles 2 $ hg perfctxfiles 2
$ hg perfdiffwd $ hg perfdiffwd
$ hg perfdirfoldmap $ hg perfdirfoldmap