From linimon@lonesome.com Mon Nov 4 23:17:20 2002 Return-Path: Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6CA9337B401 for ; Mon, 4 Nov 2002 23:17:20 -0800 (PST) Received: from mail.soaustin.net (mail.soaustin.net [207.200.4.66]) by mx1.FreeBSD.org (Postfix) with ESMTP id BB08343E4A for ; Mon, 4 Nov 2002 23:17:19 -0800 (PST) (envelope-from linimon@lonesome.com) Received: from lonesome.lonesome.com (cs2876-77.austin.rr.com [24.28.76.77]) by mail.soaustin.net (Postfix) with ESMTP id 8E4D51431B for ; Tue, 5 Nov 2002 01:17:13 -0600 (CST) Received: from lonesome.lonesome.com (localhost.lonesome.com [127.0.0.1]) by lonesome.lonesome.com (8.12.6/8.12.3) with ESMTP id gA58H1Im071411 for ; Tue, 5 Nov 2002 02:17:01 -0600 (CST) (envelope-from linimon@lonesome.lonesome.com) Received: (from linimon@localhost) by lonesome.lonesome.com (8.12.6/8.12.6/Submit) id gA58H0Go071410; Tue, 5 Nov 2002 02:17:00 -0600 (CST) (envelope-from linimon) Message-Id: <200211050817.gA58H0Go071410@lonesome.lonesome.com> Date: Tue, 5 Nov 2002 02:17:00 -0600 (CST) From: Mark Linimon Reply-To: To: FreeBSD-gnats-submit@FreeBSD.org Cc: Subject: suggested updates for bento Package Build Errors scripts X-Send-Pr-Version: 3.113.1 X-GNATS-Notify: >Number: 44919 >Category: www >Synopsis: suggested updates for bento Package Build Errors scripts >Confidential: no >Severity: non-critical >Priority: low >Responsible: portmgr >State: closed >Quarter: >Keywords: >Date-Required: >Class: change-request >Submitter-Id: current-users >Arrival-Date: Mon Nov 04 23:20:01 PST 2002 >Closed-Date: Fri Feb 14 01:30:36 PST 2003 >Last-Modified: Fri Feb 14 01:30:36 PST 2003 >Originator: Mark Linimon >Release: FreeBSD-4.6 >Organization: FreeBSD >Environment: N/A >Description: Many of the port build error types are shown as "???" in the various build reports from bento. The following changes to the shell script in /usr/ports/Tools/portbuild/scripts/processlogs attempt to replace many of these "???" entries. About a dozen new entries are created, but in many cases existing entries are merely expanded. >How-To-Repeat: N/A >Fix: Apply the following diff. Note: I have only tested this modified script on a subset of all the existing error logs, so it would need further testing before being moved into production. --- portbuild/scripts/processlogs.dist Sun Nov 3 19:06:44 2002 +++ portbuild/scripts/processlogs Tue Nov 5 01:56:09 2002 reason="checksum"; tag="checksum" elif grep -qE '/usr/local/bin/(perl|perl5.6.1):.*(not found|No such file or directory)' $1; then reason="perl"; tag="perl" - elif grep -q 'perl: Perl is not installed, try .pkg_add -r perl.' $1; then + elif grep -qE 'perl(.*): Perl is not installed, try .pkg_add -r perl.' $1; then reason="perl"; tag="perl" elif grep -qE '(No checksum recorded for|(Maybe|Either) .* is out of date, or)' $1; then reason="distinfo_update"; tag="distinfo" + elif grep -q "checking whether apxs works.*apxs: not found" $1; then + reason="apxs"; tag="apxs" elif grep -qE '(configure: error:|script.*failed: here are the contents of)' $1; then - reason="configure_error"; tag="configure" + if grep -qE "configure: error: (This program requires STL to compile|One or more.*STL headers are missing)" $1; then + reason="stl"; tag="stl" + elif grep -qE "configure: error: [Pp]erl (5.* required|version too old)" $1; then + reason="perl"; tag="perl" + else + reason="configure_error"; tag="configure" + fi elif grep -qE '(bison:.*(No such file|not found)|multiple definition of `yy)' $1; then reason="bison"; tag="bison" elif grep -q "Couldn't fetch it - please try" $1; then @@ -105,7 +115,11 @@ elif grep -qE 'chown:.*invalid argument' $1; then reason="chown"; tag="chown" elif grep -q 'install: .*: No such file' $1; then - reason="install_error"; tag="install" + if grep -q 'install: /usr/local/www/cgi-bin.*No such file or directory' $1; then + reason="cgi-bin"; tag="cgi-bin" + else + reason="install_error"; tag="install" + fi elif grep -q "/usr/.*/man/.*: No such file or directory" $1; then reason="manpage"; tag="manpage" elif grep -q "pkg_create: make_dist: tar command failed with code" $1; then @@ -128,9 +142,72 @@ reason="stdio"; tag="stdio" elif grep -q "structure has no member named" $1; then reason="struct_changes"; tag="struct" + + elif grep -q "Error: alignment not a power of 2" $1; then + reason="alignment"; tag="alignment" + elif grep -qE "bin.apxs:(.)(not found|No such file or directory)" $1; then + reason="apxs"; tag="apxs" + elif grep -q "failed to exec .*bin/apxs" $1; then + reason="apxs"; tag="apxs" + elif grep -qE "autoconf(.*): not found" $1; then + reason="autoconf"; tag="autoconf" + elif grep -qE "autoconf(.*): No such file or directory" $1; then + reason="autoconf"; tag="autoconf" + elif grep -q "autoheader: not found" $1; then + reason="autoheader"; tag="autoheader" + elif grep -q "awk: empty regular expression" $1; then + reason="awk"; tag="awk" + elif grep -qE "(mv:|mv: rename|cannot open) y.tab.c(.*): No such file or directory" $1; then + reason="bison"; tag="bison" + elif grep -q "sorry, cannot determine the header file bison generates" $1; then + reason="bison"; tag="bison" + elif grep -qE "make.*: (don.t know how to make|.*No rule to make target).*built-in" $1; then + reason="built-in"; tag="built-in" + elif grep -q "/usr/local/www/cgi-bin does not exist" $1; then + reason="cgi-bin"; tag="cgi-bin" + elif grep -qE "chown: .*\..*: Invalid argument" $1; then + reason="chown"; tag="chown" + elif grep -q "Cannot open /dev/tty for read" $1; then + reason="DISPLAY"; tag="DISPLAY" + elif grep -q "RuntimeError: cannot open display" $1; then + reason="DISPLAY"; tag="DISPLAY" + elif grep -q "You must run this program under the X-Window System" $1; then + reason="DISPLAY"; tag="DISPLAY" + elif grep -q "ld: unrecognised emulation mode: elf_i386" $1; then + reason="ELF"; tag="elf" + elif grep -q "fetch: transfer timed out" $1; then + reason="fetch_timeout"; tag="fetch-timeout" + elif grep -q "strings.h:.* previous declaration of .int ffs" $1; then + reason="ffs_conflict"; tag="ffs_conflict" + elif grep -qE "cc: ndbm\.so: No such file or directory" $1; then + reason="linker_error"; tag="ld" + elif grep -q "error: The X11 shared library could not be loaded" $1; then + reason="linker_error"; tag="ld" + elif grep -q "cc: .*libintl.*: No such file or directory" $1; then + reason="linker_error"; tag="ld" + elif grep -q "Error: mtree file ./etc/mtree/BSD.local.dist. is missing" $1; then + reason="mtree"; tag="mtree" + elif grep -qE "cp:.*site_perl: No such file or directory" $1; then + reason="perl"; tag="perl" + elif grep -q "Perl .* required--this is only version" $1; then + reason="perl"; tag="perl" + elif grep -q "pod2man: not found" $1; then + reason="pod2man"; tag="pod2man" + elif grep -q "python: not found" $1; then + reason="python"; tag="python" + elif grep -qE "sed: illegal option" $1; then + reason="sed"; tag="sed" + elif grep -qE "sed: [0-9]*:.*(RE error:|not defined in the RE|bad flag in substitute command|unescaped newline inside substitute pattern|invalid command code)" $1; then + reason="sed"; tag="sed" + elif grep -q "Your STL string implementation is unusable" $1; then + reason="stl"; tag="stl" + elif grep -q "/usr/bin/ld: cannot find -lXThrStub" $1; then + reason="threads"; tag="threads" + else reason="???"; tag="unknown" fi + broken="no" if grep -q "Trying build of .* even though it is marked BROKEN" $1; then broken="broken" >Release-Note: >Audit-Trail: Responsible-Changed-From-To: freebsd-www->portmgr Responsible-Changed-By: edwin Responsible-Changed-When: Thu Nov 7 04:11:14 PST 2002 Responsible-Changed-Why: portmgr is responsible for these scripts. http://www.freebsd.org/cgi/query-pr.cgi?pr=44919 From: Mark Linimon To: freebsd-gnats-submit@FreeBSD.org, linimon@lonesome.com Cc: Subject: Re: www/44919: suggested updates for bento Package Build Errors scripts Date: Sat, 18 Jan 2003 12:56:15 -0600 --------------Boundary-00=_R9BXRX3W8OQYD66DAEQ8 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Here is the latest reroll of the diff file. This classifies many more of the alpha and ia64 build errors as "arch". Other fixes are incorporated as well. --------------Boundary-00=_R9BXRX3W8OQYD66DAEQ8 Content-Type: text/x-diff; charset="us-ascii"; name="diff.out" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="diff.out" --- processlogs.dist Sun Jan 12 16:10:12 2003 +++ processlogs Mon Jan 13 00:56:15 2003 @@ -25,6 +25,9 @@ if [ $# != 1 -o "x$1" != "x*.log" ]; then while [ ! -z "$1" ]; do filename=$1 +# XXX MCL for debugging +echo $filename + portname=$(basename $filename .log) affected=$(($(grep -cF $portname < INDEX) -1)) logsize=$(/bin/ls -sk $filename | awk '{print $1}') @@ -34,6 +37,12 @@ datetime=$(grep 'build started at' $filename | \ sed -e 's/build started at ...//' | tr ' ' '_' ) + # throw out totally bogus files (e.g., blank file, error 404, etc.) + if [ -z "$dir" -a -z "$maintainer" -a -z "$datetime" ]; then + shift + continue + fi + if grep -q 'list of extra files and directories' $1; then reason="mtree"; tag="mtree" elif grep -q "See for instructions." $1; then @@ -42,12 +51,20 @@ reason="checksum"; tag="checksum" elif grep -qE '/usr/local/bin/(perl|perl5.6.1):.*(not found|No such file or directory)' $1; then reason="perl"; tag="perl" - elif grep -q 'perl: Perl is not installed, try .pkg_add -r perl.' $1; then + elif grep -qE 'perl(.*): Perl is not installed, try .pkg_add -r perl.' $1; then reason="perl"; tag="perl" elif grep -qE '(No checksum recorded for|(Maybe|Either) .* is out of date, or)' $1; then reason="distinfo_update"; tag="distinfo" + elif grep -q "checking whether apxs works.*apxs: not found" $1; then + reason="apxs"; tag="apxs" elif grep -qE '(configure: error:|script.*failed: here are the contents of)' $1; then - reason="configure_error"; tag="configure" + if grep -qE "configure: error: (This program requires STL to compile|One or more.*STL headers are missing)" $1; then + reason="stl"; tag="stl" + elif grep -qE "configure: error: [Pp]erl (5.* required|version too old)" $1; then + reason="perl"; tag="perl" + else + reason="configure_error"; tag="configure" + fi elif grep -qE '(bison:.*(No such file|not found)|multiple definition of `yy)' $1; then reason="bison"; tag="bison" elif grep -q "Couldn't fetch it - please try" $1; then @@ -105,12 +122,16 @@ elif grep -qE 'chown:.*invalid argument' $1; then reason="chown"; tag="chown" elif grep -q 'install: .*: No such file' $1; then - reason="install_error"; tag="install" + if grep -q 'install: /usr/local/www/cgi-bin.*No such file or directory' $1; then + reason="cgi-bin"; tag="cgi-bin" + else + reason="install_error"; tag="install" + fi elif grep -q "/usr/.*/man/.*: No such file or directory" $1; then reason="manpage"; tag="manpage" elif grep -q "pkg_create: make_dist: tar command failed with code" $1; then reason="PLIST"; tag="plist" - elif grep -q "Can't open display" $1; then + elif grep -qE "(Can't|unable to) open display" $1; then reason="DISPLAY"; tag="display" elif grep -q " is already installed - perhaps an older version" $1; then reason="depend_object"; tag="dependobj" @@ -128,9 +149,160 @@ reason="stdio"; tag="stdio" elif grep -q "structure has no member named" $1; then reason="struct_changes"; tag="struct" + + elif grep -q "Error: alignment not a power of 2" $1; then + reason="alignment"; tag="alignment" + elif grep -qE "bin.apxs:(.)(not found|No such file or directory)" $1; then + reason="apxs"; tag="apxs" + elif grep -qE "failed to exec .*bin/apxs" $1; then + reason="apxs"; tag="apxs" + elif grep -q ".s: Assembler messages:" $1; then + reason="arch"; tag="arch" + elif grep -qE "Cannot (determine .* target|find the byte order) for this architecture" $1; then + reason="arch"; tag="arch" + elif grep -q "cast from pointer to integer of different size" $1; then + reason="arch"; tag="arch" + elif grep -qE "^cc1: bad value.*for -mcpu.*switch" $1; then + reason="arch"; tag="arch" + elif grep -qE "^cc1: invalid option " $1; then + reason="arch"; tag="arch" + elif grep -qE "Configuration .* not supported" $1; then + reason="arch"; tag="arch" + elif grep -q "could not read symbols: File in wrong format" $1; then + reason="arch"; tag="arch" + elif grep -qE "[Ee]rror: [Uu]nknown opcode" $1; then + reason="arch"; tag="arch" + elif grep -qE "error.*Unsupported architecture" $1; then + reason="arch"; tag="arch" + elif grep -q "ENDIAN must be defined 0 or 1" $1; then + reason="arch"; tag="arch" + elif grep -q "failed to merge target-specific data" $1; then + reason="arch"; tag="arch" + elif grep -qE "(file not recognized|failed to set dynamic section sizes): File format not recognized" $1; then + reason="arch"; tag="arch" + elif grep -q "impossible register constraint" $1; then + reason="arch"; tag="arch" + elif grep -qE "inconsistent operand constraints in an .asm" $1; then + reason="arch"; tag="arch" + elif grep -q "invalid lvalue in asm statement" $1; then + reason="arch"; tag="arch" + elif grep -qE "is only for.*, and you are running" $1; then + reason="arch"; tag="arch" + elif grep -q "relocation truncated to fit: " $1; then + reason="arch"; tag="arch" + elif grep -q "This architecture seems to be neither big endian nor little endian" $1; then + reason="arch"; tag="arch" + elif grep -q "unknown register name" $1; then + reason="arch"; tag="arch" + elif grep -q "Unable to correct byte order" $1; then + reason="arch"; tag="arch" + elif grep -q "Unsupported platform, sorry" $1; then + reason="arch"; tag="arch" + elif grep -q "won't run on this architecture" $1; then + reason="arch"; tag="arch" + elif grep -qE "#error .Cannot compile:" $1; then + reason="assert"; tag="assert" + elif grep -qE "autoconf(.*): not found" $1; then + reason="autoconf"; tag="autoconf" + elif grep -qE "autoconf(.*): No such file or directory" $1; then + reason="autoconf"; tag="autoconf" + elif grep -q "autoheader: not found" $1; then + reason="autoheader"; tag="autoheader" + elif grep -qE "automake(.*): not found" $1; then + reason="automake"; tag="automake" + elif grep -q "awk: empty regular expression" $1; then + reason="awk"; tag="awk" + elif grep -qE "(mv:|mv: rename|cannot open) y.tab.c(.*): No such file or directory" $1; then + reason="bison"; tag="bison" + elif grep -q "sorry, cannot determine the header file bison generates" $1; then + reason="bison"; tag="bison" + elif grep -q "usage: yacc" $1; then + reason="bison"; tag="bison" + elif grep -q "/usr/local/www/cgi-bin does not exist" $1; then + reason="cgi-bin"; tag="cgi-bin" + elif grep -qE "chown: .*\..*: Invalid argument" $1; then + reason="chown"; tag="chown" + elif grep -q "Cannot stat: " $1; then + reason="configure_error"; tag="configure" + elif grep -qE "Script.*configure.*failed unexpectedly" $1; then + reason="configure_error"; tag="configure" + elif grep -q "Cannot open /dev/tty for read" $1; then + reason="DISPLAY"; tag="display" + elif grep -q "RuntimeError: cannot open display" $1; then + reason="DISPLAY"; tag="display" + elif grep -q "You must run this program under the X-Window System" $1; then + reason="DISPLAY"; tag="display" + elif grep -q "ld: unrecognised emulation mode: elf_i386" $1; then + reason="ELF"; tag="elf" + elif grep -qE "Member name contains .\.\." $1; then + reason="fetch"; tag="fetch" + elif grep -q "fetch: transfer timed out" $1; then + reason="fetch_timeout"; tag="fetch-timeout" + elif grep -q "fetch: transfer timed out" $1; then + reason="fetch_timeout"; tag="fetch-timeout" + elif grep -q "strings.h:.* previous declaration of .int ffs" $1; then + reason="ffs_conflict"; tag="ffs_conflict" + elif grep -q "is forbidden: FreeBSD-SA-" $1; then + reason="forbidden"; tag="forbidden" + elif grep -qE "previous declaration.*int getopt" $1; then + reason="getopt.h"; tag="getopt.h" + elif grep -q 'Run-time system build failed for some reason' $1; then + reason="install_error"; tag="install" + elif grep -q "/usr/bin/ld: cannot find -lc_r" $1; then + reason="lc_r"; tag="lc_r" + elif grep -q "cc: .*libintl.*: No such file or directory" $1; then + reason="linker_error"; tag="ld" + elif grep -qE "cc: ndbm\.so: No such file or directory" $1; then + reason="linker_error"; tag="ld" + elif grep -q "error: The X11 shared library could not be loaded" $1; then + reason="linker_error"; tag="ld" + elif grep -q "relocation against dynamic symbol" $1; then + reason="linker_error"; tag="ld" + elif grep -qE "make.*(don.t know how to make|fatal errors encountered|No rule to make target|built-in)" $1; then + reason="makefile"; tag="makefile" + elif grep -q "Error: mtree file ./etc/mtree/BSD.local.dist. is missing" $1; then + reason="mtree"; tag="mtree" + elif grep -qE "cp:.*site_perl: No such file or directory" $1; then + reason="perl"; tag="perl" + elif grep -q "Perl .* required--this is only version" $1; then + reason="perl"; tag="perl" + elif grep -q "pod2man: not found" $1; then + reason="pod2man"; tag="pod2man" + elif grep -q "Syntax error: .(. unexpected (expecting .fi.)" $1; then + reason="portcomment"; tag="portcomment" + elif grep -q "Abort trap" $1; then + reason="process_failed"; tag="process" + elif grep -q "Bus error" $1; then + reason="process_failed"; tag="process" + elif grep -q "Signal 11" $1; then + reason="process_failed"; tag="process" + elif grep -q "USER PID PPID PGID JOBC STAT TT TIME COMMAND" $1; then + reason="process_failed"; tag="process" + elif grep -q "python: not found" $1; then + reason="python"; tag="python" + elif grep -qE "sed: illegal option" $1; then + reason="sed"; tag="sed" + elif grep -qE "sed: [0-9]*:.*(RE error:|not defined in the RE|bad flag in substitute command|unescaped newline inside substitute pattern|invalid command code)" $1; then + reason="sed"; tag="sed" + elif grep -q "Your STL string implementation is unusable" $1; then + reason="stl"; tag="stl" + elif grep -q "Error: pthreads are required to build this package" $1; then + reason="threads"; tag="threads" + elif grep -q "Please install/update your POSIX threads (pthreads) library" $1; then + reason="threads"; tag="threads" + elif grep -qE "requires.*thread support" $1; then + reason="threads"; tag="threads" + elif grep -q "/usr/bin/ld: cannot find -lpthread" $1; then + reason="threads"; tag="threads" + elif grep -q "/usr/bin/ld: cannot find -lXThrStub" $1; then + reason="threads"; tag="threads" + else reason="???"; tag="unknown" fi + +# XXX MCL perhaps segfault, coredump should be unified into process failed? + broken="no" if grep -q "Trying build of .* even though it is marked BROKEN" $1; then broken="broken" --------------Boundary-00=_R9BXRX3W8OQYD66DAEQ8-- State-Changed-From-To: open->closed State-Changed-By: kris State-Changed-When: Fri Feb 14 01:30:29 PST 2003 State-Changed-Why: Patch committed, thanks! http://www.freebsd.org/cgi/query-pr.cgi?pr=44919 >Unformatted: