aboutsummaryrefslogtreecommitdiff
path: root/Tools
Commit message (Collapse)AuthorAgeFilesLines
* Have a different approach on how to check if the modules file has changed.Edwin Groothuis2008-07-141-9/+7
| | | | | | | | | | | | | Because the $FreeBSD$ keyword isn't expanded in the new version, we can't just do a diff, check the return value and ignore the output. Every new modules file, changed or not with regarding to the contents, has at least four lines in the diff output (line number, old line, seperator, new line). Only commit it if there are more than four lines difference between it. Notes: svn path=/head/; revision=216816
* Keep the sources of the CVSROOT-ports/modules update script safelyEdwin Groothuis2008-07-084-0/+361
| | | | | | | in the ports CVS repository. Notes: svn path=/head/; revision=216557
* [PATCH] Tools/scripts: Some cleanups, additions to bump_version.plEdwin Groothuis2008-07-061-28/+33
| | | | | | | | | | | | | | | | | - added -c, doesn't change anything - added -n, deal with an already checkouted tree - removed negative logic in favor of 'unless' - switch to 3 arg form of open() - don't use globs for filehandles, this is been obsolete since at least 5.6.1 - handle possible errors in close() - allow CVSROOT to be overriden in the ENV PR: ports/125025 Submitted by: "Philip M. Gollucci" <pgollucci@p6m7g8.com> Notes: svn path=/head/; revision=216390
* Reflect latest changes from production:Mark Linimon2008-07-021-39/+43
| | | | | | | | | - no more 5-exp - add 8, 8-exp - fix two error-name hrefs Notes: svn path=/head/; revision=216144
* This conversion script is no longer usefulKris Kennaway2008-06-251-74/+0
| | | | Notes: svn path=/head/; revision=215781
* CVSROOT/modules no longer contains an entry per port, remove supportErwin Lansing2008-06-194-300/+9
| | | | | | | for this from these scripts. Notes: svn path=/head/; revision=215312
* Modernize this script a bit.Kris Kennaway2008-06-111-13/+10
| | | | | | | | | | | | | * Remove 5.x support * Leave the archaic ftp snapshot support for now, it is not hurting anything but will not work * Be more careful when removing files (use absolute paths) * Switch to bindist/tmp for the tmp dir * Fix the recording of the bindist.tar generation number * Get rid of redundant or useless processing of the world image Notes: svn path=/head/; revision=214666
* * Distfile collection is now the default; replace -distfiles with -nodistfilesKris Kennaway2008-06-111-9/+13
| | | | | | | | | * Record the CVS update stamp in some extra places and make sure to remove it if the build is started with -noportscvs (since this probably means the ports tree was updated by hand at some random time) Notes: svn path=/head/; revision=214665
* Add some test -d's to avoid cd'ing into directories that do not existKris Kennaway2008-06-111-3/+6
| | | | Notes: svn path=/head/; revision=214664
* Major optimizations. Instead of copying the distfiles around, mvKris Kennaway2008-06-111-11/+67
| | | | | | | them in batches according to their target directory. Notes: svn path=/head/; revision=214663
* Revive this script and make it useful. Transfer the distfiles using rsyncKris Kennaway2008-06-111-26/+23
| | | | | | | and make sure they have been post-processed first. Notes: svn path=/head/; revision=214662
* * Catch up to X11R6 removalKris Kennaway2008-06-111-7/+12
| | | | | | | | * Keep RESTRICTED distfiles in a separate DISTDIR so we can easily avoid accidentally publishing them to the FTP site (idea from des@) Notes: svn path=/head/; revision=214660
* Add support for "PORTREVISION?=" and "PORTEPOCH"Edwin Groothuis2008-06-061-52/+62
| | | | | | | Tested on: devel/gettext bump Notes: svn path=/head/; revision=214421
* Rewrite this to make it more efficient (fewer external commandKris Kennaway2008-06-021-138/+181
| | | | | | | | | | invocations). It also fixes some edge cases that were not handled in the previous version. TODO: Correctly report IPv6 sockets (already in use by the sparc64 build) Notes: svn path=/head/; revision=214195
* Remove support for FreeBSD 5.xErwin Lansing2008-06-011-21/+1
| | | | Notes: svn path=/head/; revision=214096
* Remove the force file, if it was used.Mark Linimon2008-05-291-0/+1
| | | | | | | Forgotten by: linimon Notes: svn path=/head/; revision=213873
* Add a force function here, just like processlogs.Mark Linimon2008-05-291-1/+1
| | | | Notes: svn path=/head/; revision=213847
* Add a note that processonelog and processlogs2 are finicky about theMark Linimon2008-05-291-0/+1
| | | | | | | header format of the log files. Notes: svn path=/head/; revision=213842
* Fix these after the 1.31 update to buildscript.Mark Linimon2008-05-292-5/+7
| | | | | | | Forgotten by: pav Notes: svn path=/head/; revision=213841
* Rewrite this in python instead of shell. Because we can read theKris Kennaway2008-05-251-39/+55
| | | | | | | | INDEX once and process internally instead of invoking many external utilities, runtime is improved from ~20 minutes to <10 seconds. Notes: svn path=/head/; revision=213657
* NNew build scheduler written in python to replace the make+sh jobKris Kennaway2008-05-102-0/+1040
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ordering, which had become too limited. We now build packages ordered by those that are part of the longest dependency chains first. This has the effect of building the deepest parts of the tree first and levelling out the tree height, hopefully avoiding the situation we currently face where there appear bottlenecks late in the build where the cluster becomes mostly idle while waiting for a few long dependency chains to finish building before the cluster can become fully loaded again. The algorithm is that we sort the list of remaining packages according to height (longest dependency chain), then add leaf packages from each in order until we have filled a queue of length between 100 and 200, to amortise the cost of this queue rebalancing while not losing the height averaging property. Jobs are dispatched from this queue into worker threads as machine slots become available. Unlike the make-based solution that required a fixed -j concurrency value and could not respond to addition/removal of build resources, we now can dynamically add new machines as they become available to the queue. The other advantage of using python is that we have more customisability and visibility into the build status, e.g. we periodically report the number of remaining packages, as well as the list of deepest packages that we are working on. TODO: * Implement mtime checking for parent package staleness, so that parents are rebuilt if the dependencies are touched more recently. Currently packages will not be rebuild if they exist, whether or not they are "stale" wrt their dependencies. * Offload the machine selection into an external queue manager. Currently the queue manager used here doesn't interoperate with the old one (getmachine/releasemachine) because it's not possible to use the lockf()-based mutual exclusion within a multithreaded client. Doing that will also allow for a more flexible job placement algorithm as well as finer queue customization. Notes: svn path=/head/; revision=212890
* Add a tiny sh hack - ardiff - compares two archives.Andrew Pantyukhin2008-05-062-0/+98
| | | | Notes: svn path=/head/; revision=212743
* Remove XFree86-4 from quickportsPav Lucistnik2008-04-111-1/+1
| | | | Notes: svn path=/head/; revision=211051
* Parallelize to 4 concurrent jobsPav Lucistnik2008-04-112-2/+2
| | | | Notes: svn path=/head/; revision=211050
* Include per-machine configuration and respect use_zfs flagPav Lucistnik2008-04-111-2/+3
| | | | Notes: svn path=/head/; revision=211049
* Sync with pointyhat (reorg)Pav Lucistnik2008-04-111-9/+9
| | | | Notes: svn path=/head/; revision=211048
* - Add the port's Makefile ident string to the build log headersPav Lucistnik2008-03-131-2/+7
| | | | | | | | | | PR: 113234 Submitted by: Andrej Zverev <andrey.zverev@electro-com.ru> - Sync with actual script on pointyhat (whitespace, mostly) Notes: svn path=/head/; revision=208923
* - Don't write queue entry for machine that's not on mlist. This allows us toPav Lucistnik2008-03-121-0/+6
| | | | | | | | gracefully remove a node from the workload, and also it prevents build from stucking when machine is deleted from mlist. Notes: svn path=/head/; revision=208894
* Make the INDEX_JOBS definition actually effectivePav Lucistnik2008-03-111-1/+1
| | | | Notes: svn path=/head/; revision=208829
* Remove support for 5-exp and add 7-exp, 8 and 8-expErwin Lansing2008-01-145-11/+17
| | | | Notes: svn path=/head/; revision=205658
* Change homebrew locking routines with lockf(1) based locking.Erwin Lansing2008-01-011-14/+4
| | | | Notes: svn path=/head/; revision=204795
* Add the standard 6-line header and URL to all build failure logs, notMark Linimon2007-12-241-1/+10
| | | | | | | | | | | | just the plist ones. If the log is less than 1000 lines after the header, include it all; else, trim to last 1000 lines. This should help when deciding where to forward logs. Tested on: pointyhat Notes: svn path=/head/; revision=204445
* Copy the duds file to a directory where the web server can find it. ThisMark Linimon2007-12-241-0/+7
| | | | | | | | | | | makes it possible to correctly analyze why packages were not built for a specific run. Add a beginning and ending email notification to help coordinate between multiple portmgrs doing runs. Notes: svn path=/head/; revision=204424
* Make the script less whiny for unpopulated builds.Mark Linimon2007-12-231-2/+2
| | | | Notes: svn path=/head/; revision=204405
* Fix a problem when add new ports on ports-mgmt category. ports-mgmt/MakefileRenato Botelho2007-12-191-6/+13
| | | | | | | | | | | | | lines has 3 spaces before SUBDIR word and all other categories has 4. I've asked pav@ if there is a default format of category Makefiles and he said the number of spaces doesn't matter, so, i fix addport to respect the current number of spaces and/or tabs the file has. Reported by: miwi, erwin Notes: svn path=/head/; revision=204123
* Add support for 7-exp and 8 branchesKris Kennaway2007-11-042-3/+3
| | | | | | | Approved by: portmgr (self) Notes: svn path=/head/; revision=202501
* Correctly report active builds when ZFS is in useKris Kennaway2007-11-041-1/+1
| | | | | | | Approved by: portmgr (self) Notes: svn path=/head/; revision=202500
* * Add support for 7-exp and 8 branchesKris Kennaway2007-11-041-3/+8
| | | | | | | | | * XORG_UPGRADE and USA_RESIDENT are no longer required Approved by: portmgr (self) Notes: svn path=/head/; revision=202499
* - Add support for FreeBSD 8.0Erwin Lansing2007-10-251-4/+25
| | | | | | | | - Be more robust about param.h and allow space as well as tab as seperator while determining OSVERION Notes: svn path=/head/; revision=202034
* Add 7-exp, 8.Mark Linimon2007-10-161-0/+8
| | | | Notes: svn path=/head/; revision=201536
* Add 7-exp and 8.Mark Linimon2007-10-161-1/+1
| | | | Notes: svn path=/head/; revision=201535
* Rename 'missing' column to 'not yet built' so as not to confuse terminologyMark Linimon2007-10-161-6/+6
| | | | | | | | | with portsmon reports. Noticed by: erwin Notes: svn path=/head/; revision=201534
* s/query-pr.real/query-pr/ to fix getpr after freefall migrationRenato Botelho2007-10-151-1/+1
| | | | | | | Discussed at: #bsdports Notes: svn path=/head/; revision=201520
* Reflect 8-CURRENT.Mark Linimon2007-10-151-1/+94
| | | | Notes: svn path=/head/; revision=201478
* The index page used on pointyhat.Mark Linimon2007-10-151-0/+950
| | | | Notes: svn path=/head/; revision=201477
* Update this example file to reflect 7.0 branching.Mark Linimon2007-10-141-1/+1
| | | | Notes: svn path=/head/; revision=201470
* Replace two further instances of /var/db/pkg by $PKG_DBDIR.Gerald Pfeifer2007-09-161-2/+2
| | | | Notes: svn path=/head/; revision=199581
* Remove the following false positives, which show up as compiler warnings,Mark Linimon2007-09-131-2/+2
| | | | | | | | | | | not errors: discards qualifiers [0-9]: implicit declaration of function ISO C\+\+ forbids Notes: svn path=/head/; revision=199393
* Use PKG_DBDIR instead of hard-coding /var/db/pkg/. Do not silently revertGerald Pfeifer2007-09-081-3/+15
| | | | | | | | | | to defaults for PORTSDIR and PKG_DBDIR if the respective directory does not exist, but bail out. Approved by: netchild Notes: svn path=/head/; revision=199117
* Change to the latest names of the ooo ports; add jdk16; sort a bit.Mark Linimon2007-09-041-1/+1
| | | | | | | Glanced at by: kris Notes: svn path=/head/; revision=198759