From nobody@FreeBSD.org Mon Mar 5 18:17:37 2007 Return-Path: Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id EBA0716A400 for ; Mon, 5 Mar 2007 18:17:37 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (www.freebsd.org [69.147.83.33]) by mx1.freebsd.org (Postfix) with ESMTP id DC9CF13C494 for ; Mon, 5 Mar 2007 18:17:37 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (localhost [127.0.0.1]) by www.freebsd.org (8.13.1/8.13.1) with ESMTP id l25IHbil050650 for ; Mon, 5 Mar 2007 18:17:37 GMT (envelope-from nobody@www.freebsd.org) Received: (from nobody@localhost) by www.freebsd.org (8.13.1/8.13.1/Submit) id l25IHbe0050649; Mon, 5 Mar 2007 18:17:37 GMT (envelope-from nobody) Message-Id: <200703051817.l25IHbe0050649@www.freebsd.org> Date: Mon, 5 Mar 2007 18:17:37 GMT From: Ludger Bolmerg To: freebsd-gnats-submit@FreeBSD.org Subject: SMP kernel performance problem on FSC TX600 X-Send-Pr-Version: www-3.0 >Number: 109936 >Category: kern >Synopsis: [smp] SMP kernel performance problem on FSC TX600 >Confidential: no >Severity: serious >Priority: high >Responsible: freebsd-bugs >State: closed >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Mon Mar 05 18:20:03 GMT 2007 >Closed-Date: Sat Sep 24 20:41:24 UTC 2011 >Last-Modified: Sat Sep 24 20:41:24 UTC 2011 >Originator: Ludger Bolmerg >Release: 6.2 >Organization: >Environment: FreeBSD bsd60.myname.de 6.2-RELEASE-p2 FreeBSD 6.2-RELEASE-p2 #1 >Description: I installed FreeBSD 6.2 on a Fujitsu Siemens TX600 S3 with 2 dual core Xeon processors and 4G RAM. Here is the link to the data sheet of the server on Fujitsu-Siemens' Web page. It may be helpful http://extranet.fujitsu-siemens.com/vil/pc/vil/primergy/model_line_400/rack_server/ds_prim-rx600-s3.pdf The SMP kernel is awfully slow. make buildkernel takes about 6 hours to complete. When I boot a UP kernel the build completes within 12 minutes. I don't see any unusual message in any log file. Booting the SMP kernel with kern.smp.disabled=1 shows good performance values. When booting the SMP kernel with hint.lapic.10.disabled=1 hint.lapic.12.disabled=1 hint.lapic.14.disabled=1 also results in good performance. Disabling single CPUs didn't work. I had to apply a patch provided by John Baldwin. http://lists.freebsd.org/pipermail/freebsd-smp/2007-February/001320.html Disabling all but one CPU also gives good performance. As soon as the second CPU gets enabled it becomes slow again. >How-To-Repeat: Install on same hardware >Fix: >Release-Note: >Audit-Trail: From: Remko Lodder To: Ludger Bolmerg Cc: freebsd-gnats-submit@FreeBSD.org Subject: Re: kern/109936: SMP kernel performance problem on FSC TX600 Date: Mon, 05 Mar 2007 20:07:02 +0100 Can you tell us what your kernel configuration is? What kind of scheduler do you use etc.. Thanks! -- Kind regards, Remko Lodder ** remko@elvandar.org FreeBSD ** remko@FreeBSD.org /* Quis custodiet ipsos custodes */ From: lbolmerg@web.de To: remko@FreeBSD.org Cc: freebsd-gnats-submit@FreeBSD.org Subject: Re: kern/109936: SMP kernel performance problem on FSC TX600 Date: Tue, 06 Mar 2007 09:40:48 +0100 I used the kernel installed from CD. I also tried GENERIC with a few chan= ges. Scheduler used is 4BSD #diff MYSMP GENERIC 22,23c22,23 < #cpu I486=5FCPU < #cpu I586=5FCPU --- > cpu I486=5FCPU > cpu I586=5FCPU 25,42c25 < ident MYSMP <=20 < # maxusers 256 <=20 < # min(max(VM=5FKMEM=5FSIZE, Physical memory/VM=5FKMEM=5FSIZE=5FSCALE), VM=5FKMEM=5FSIZ= E=5FMAX)=20 < # is the total KVA space allocated for < # kmem=5Fmap. E.g. used by Soft Updates. < # For large memory machines (> 1GB RAM) VM=5FKMEM=5FSIZE=5FMAX should < # be set to at least 400M. < #options VM=5FKMEM=5FSIZE=3D(12*1024*1024) # 12 MB < #options VM=5FKMEM=5FSIZE=5FMAX=3D(200*1024*1024) # 200 MB < #options VM=5FKMEM=5FSIZE=5FSCALE=3D(3) # 1/3 RAM < options VM=5FKMEM=5FSIZE=5FMAX=3D(400*1024*1024) # 400 MB <=20 < options SMP <=20 < device acpi=5Ffujitsu <=20 --- > ident GENERIC It may also be interesting that 6.1 showed the same behaviour. 6.0 boots from CD but hangs completely on the first sysinstall screen. Best regards, Ludger Bolmerg From: Ludger Bolmerg To: remko@freebsd.org Cc: freebsd-gnats-submit@freebsd.org Subject: Re: kern/109936: SMP kernel performance problem on FSC TX600 Date: Tue, 06 Mar 2007 20:18:51 +0100 Here is some more information that may be interesting. I ran the Linux firmware kit from http://www.linuxfirmwarekit.org/ and got the following results: - the CPUs have version 8 microcode, the tool reports this to be outdated, version 9 seems to be available - Fail: HPET configuration test: failed to locate HPET base - Fail: MTRR validation gives the following output Memory range 0x0 to 0x9fbff (System RAM) has incorrect attribute default Memory range 0x0 to 0x9fbff (System RAM) is lacking attribute write-back Memory range 0x100000 to 0xbf891fff (System RAM) has incorrect attribute default Memory range 0x100000 to 0xbf891fff (System RAM) is lacking attribute write-back Memory range 0xbf912000 to 0xbf941fff (System RAM) has incorrect attribute default Memory range 0xbf912000 to 0xbf941fff (System RAM) is lacking attribute write-back Memory range 0xbfa12000 to 0xbfa6afff (System RAM) has incorrect attribute default Memory range 0xbfa12000 to 0xbfa6afff (System RAM) is lacking attribute write-back Memory range 0xbfa92000 to 0xbfb05fff (System RAM) has incorrect attribute default Memory range 0xbfa92000 to 0xbfb05fff (System RAM) is lacking attribute write-back Memory range 0xbfb12000 to 0xbfb1ffff (System RAM) has incorrect attribute default Memory range 0xbfb12000 to 0xbfb1ffff (System RAM) is lacking attribute write-back Memory range 0xbfb33000 to 0xbfb79fff (System RAM) has incorrect attribute default 0Memory range xbfb33000 to 0xbfb79fff (System RAM) is lacking attribute write-back Memory range xbfbfa000 to 0xbfbfffff (System RAM) has incorrect attribute default Memory range 0xbfbfa000 to 0xbfbfffff (System RAM) is lacking attribute write-back Memory range 0xd0000000 to 0xd7ffffff (0000:11:00.0) has incorrect attribute uncached Memory range 0xe3000000 to 0xe300ffff (000:0f:0e.0) has incorrect attribute uncached - Fail: MCFG PCI Express* memory mapped config space E820: MCFG mmio config space at 0xc0000000 is not reserved in .. detailed list of E820 memory layout follows (12 lines) 5 memory ranges are marked as 'OS used ram', 5 ranges are marked as 'reserved', 2 ranges are marked as 'ACPI use' - Fail: General ACPI information PCI Express port driver reports an invalid IRQ (multiple lines same output) _PSD domain information is corrupt (multiple lines same output) I don't know if this is of any value. Thought it might be. Ludger Bolmerg State-Changed-From-To: open->feedback State-Changed-By: jh State-Changed-When: Fri Sep 23 19:36:00 UTC 2011 State-Changed-Why: Can you still reproduce this on recent FreeBSD versions? http://www.freebsd.org/cgi/query-pr.cgi?pr=109936 State-Changed-From-To: feedback->closed State-Changed-By: jh State-Changed-When: Sat Sep 24 20:41:23 UTC 2011 State-Changed-Why: Submitter doesn't have access to the hardware anymore. http://www.freebsd.org/cgi/query-pr.cgi?pr=109936 >Unformatted: