From nobody@FreeBSD.org Sat Jan 19 11:00:34 2008 Return-Path: Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 39A6616A418 for ; Sat, 19 Jan 2008 11:00:34 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21]) by mx1.freebsd.org (Postfix) with ESMTP id 1C91B13C4D5 for ; Sat, 19 Jan 2008 11:00:34 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (localhost [127.0.0.1]) by www.freebsd.org (8.14.2/8.14.2) with ESMTP id m0JAx8O3076689 for ; Sat, 19 Jan 2008 10:59:08 GMT (envelope-from nobody@www.freebsd.org) Received: (from nobody@localhost) by www.freebsd.org (8.14.2/8.14.1/Submit) id m0JAx8MC076688; Sat, 19 Jan 2008 10:59:08 GMT (envelope-from nobody) Message-Id: <200801191059.m0JAx8MC076688@www.freebsd.org> Date: Sat, 19 Jan 2008 10:59:08 GMT From: Alex Keda To: freebsd-gnats-submit@FreeBSD.org Subject: cannot see large disk (more than 2T) X-Send-Pr-Version: www-3.1 X-GNATS-Notify: >Number: 119799 >Category: kern >Synopsis: [ciss] [2t] cannot see large disk (more than 2T) >Confidential: no >Severity: non-critical >Priority: low >Responsible: linimon >State: closed >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Sat Jan 19 11:10:02 UTC 2008 >Closed-Date: Sun May 18 23:33:11 UTC 2008 >Last-Modified: Sun May 18 23:33:11 UTC 2008 >Originator: Alex Keda >Release: 7.0 >Organization: USSR >Environment: FreeBSD backup1.xxx.local 7.0-PRERELEASE FreeBSD 7.0-PRERELEASE #1: Fri Jan 18 10:46:33 MSK 2008 dag@backup1.xxx.local:/usr/obj/usr/src/sys/GENERIC i386 >Description: I have 12 x 750G disks in 1 storage. When I create array < 2T - I may see and work with them correct. When I create > 2T: (da2:ciss1:0:1:0): got CAM status 0x4 (da2:ciss1:0:1:0): fatal error, failed to attach to device (da2:ciss1:0:1:0): lost device (da2:ciss1:0:1:0): removing device entry ============ I probe setup linux on this machine - centos4.5 see and format disk with size 8T... full dmesg ========== Copyright (c) 1992-2008 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 7.0-PRERELEASE #1: Fri Jan 18 10:46:33 MSK 2008 dag@backup1.xxx.local:/usr/obj/usr/src/sys/GENERIC Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU X5355 @ 2.66GHz (2666.77-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x6f7 Stepping = 7 Features=0xbfebfbff Features2=0x4e3bd AMD Features=0x20000000 AMD Features2=0x1 Cores per package: 4 real memory = 3487924224 (3326 MB) avail memory = 3408752640 (3250 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 cpu4 (AP): APIC ID: 4 cpu5 (AP): APIC ID: 5 cpu6 (AP): APIC ID: 6 cpu7 (AP): APIC ID: 7 ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard kbd1 at kbdmux0 ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) hptrr: HPT RocketRAID controller driver v1.1 (Jan 18 2008 10:45:00) acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0 acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 cpu0: on acpi0 est0: on cpu0 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 828082806000828 device_attach: est0 attach returned 6 p4tcc0: on cpu0 cpu1: on acpi0 est1: on cpu1 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 828082806000828 device_attach: est1 attach returned 6 p4tcc1: on cpu1 cpu2: on acpi0 est2: on cpu2 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 828082806000828 device_attach: est2 attach returned 6 p4tcc2: on cpu2 cpu3: on acpi0 est3: on cpu3 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 828082806000828 device_attach: est3 attach returned 6 p4tcc3: on cpu3 cpu4: on acpi0 est4: on cpu4 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 828082806000828 device_attach: est4 attach returned 6 p4tcc4: on cpu4 cpu5: on acpi0 est5: on cpu5 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 828082806000828 device_attach: est5 attach returned 6 p4tcc5: on cpu5 cpu6: on acpi0 est6: on cpu6 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 828082806000828 device_attach: est6 attach returned 6 p4tcc6: on cpu6 cpu7: on acpi0 est7: on cpu7 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 828082806000828 device_attach: est7 attach returned 6 p4tcc7: on cpu7 pcib0: on acpi0 pci0: on pcib0 pcib1: at device 2.0 on pci0 pci9: on pcib1 pcib2: at device 0.0 on pci9 pci10: on pcib2 pcib3: at device 0.0 on pci10 pci11: on pcib3 pcib4: mem 0xfdcf0000-0xfdcf1fff at device 0.0 on pci11 pci12: on pcib4 mpt0: port 0x5000-0x50ff mem 0xfdde0000-0xfddfffff,0xfddc0000-0xfdddffff irq 16 at device 8.0 on pci12 mpt0: [ITHREAD] mpt0: MPI Version=1.2.14.0 pcib5: at device 1.0 on pci10 pci14: on pcib5 pcib6: at device 2.0 on pci10 pci15: on pcib6 pcib7: at device 0.3 on pci9 pci16: on pcib7 pcib8: at device 3.0 on pci0 pci6: on pcib8 ciss0: port 0x4000-0x40ff mem 0xfda00000-0xfdafffff,0xfd9f0000-0xfd9f0fff irq 16 at device 0.0 on pci6 ciss0: [ITHREAD] pcib9: at device 4.0 on pci0 pci19: on pcib9 ciss1: port 0x6000-0x60ff mem 0xfdf00000-0xfdffffff,0xfdef0000-0xfdef0fff irq 17 at device 0.0 on pci19 ciss1: [ITHREAD] pcib10: at device 5.0 on pci0 pci22: on pcib10 pcib11: at device 6.0 on pci0 pci2: on pcib11 pcib12: at device 0.0 on pci2 pci3: on pcib12 bce0: mem 0xf8000000-0xf9ffffff irq 18 at device 0.0 on pci3 miibus0: on bce0 brgphy0: PHY 1 on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bce0: Ethernet address: 00:1c:c4:44:bb:32 bce0: [ITHREAD] bce0: ASIC (0x57081020); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); F/W (0x01090605); Flags( MFW MSI ) pcib13: at device 7.0 on pci0 pci4: on pcib13 pcib14: at device 0.0 on pci4 pci5: on pcib14 bce1: mem 0xfa000000-0xfbffffff irq 19 at device 0.0 on pci5 miibus1: on bce1 brgphy1: PHY 1 on miibus1 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bce1: Ethernet address: 00:1c:c4:44:bb:2c bce1: [ITHREAD] bce1: ASIC (0x57081020); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); F/W (0x01090605); Flags( MFW MSI ) uhci0: port 0x1000-0x101f irq 16 at device 29.0 on pci0 uhci0: [GIANT-LOCKED] uhci0: [ITHREAD] usb0: on uhci0 usb0: USB revision 1.0 uhub0: on usb0 uhub0: 2 ports with 2 removable, self powered uhci1: port 0x1020-0x103f irq 17 at device 29.1 on pci0 uhci1: [GIANT-LOCKED] uhci1: [ITHREAD] usb1: on uhci1 usb1: USB revision 1.0 uhub1: on usb1 uhub1: 2 ports with 2 removable, self powered uhci2: port 0x1040-0x105f irq 18 at device 29.2 on pci0 uhci2: [GIANT-LOCKED] uhci2: [ITHREAD] usb2: on uhci2 usb2: USB revision 1.0 uhub2: on usb2 uhub2: 2 ports with 2 removable, self powered uhci3: port 0x1060-0x107f irq 19 at device 29.3 on pci0 uhci3: [GIANT-LOCKED] uhci3: [ITHREAD] usb3: on uhci3 usb3: USB revision 1.0 uhub3: on usb3 uhub3: 2 ports with 2 removable, self powered ehci0: mem 0xf7df0000-0xf7df03ff irq 16 at device 29.7 on pci0 ehci0: [GIANT-LOCKED] ehci0: [ITHREAD] usb4: waiting for BIOS to give up control usb4: EHCI version 1.0 usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3 usb4: on ehci0 usb4: USB revision 2.0 uhub4: on usb4 uhub4: 8 ports with 8 removable, self powered pcib15: at device 30.0 on pci0 pci1: on pcib15 vgapci0: port 0x3000-0x30ff mem 0xd8000000-0xdfffffff,0xf7ff0000-0xf7ffffff irq 23 at device 3.0 on pci1 pci1: at device 4.0 (no driver attached) pci1: at device 4.2 (no driver attached) uhci4: port 0x3800-0x381f irq 22 at device 4.4 on pci1 uhci4: [GIANT-LOCKED] uhci4: [ITHREAD] usb5: on uhci4 usb5: USB revision 1.0 uhub5: <(0x103c) UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb5 uhub5: 2 ports with 2 removable, self powered pci1: at device 4.6 (no driver attached) isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x500-0x50f irq 17 at device 31.1 on pci0 ata0: on atapci0 ata0: [ITHREAD] ata1: on atapci0 ata1: [ITHREAD] acpi_tz0: on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: [ITHREAD] psm0: model IntelliMouse, device ID 3 sio0: port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio0: [FILTER] pmtimer0 on isa0 orm0: at iomem 0xc0000-0xcafff,0xe6000-0xe7fff pnpid ORM0000 on isa0 ppc0: parallel port not found. sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio1 at port 0x2f8-0x2ff irq 3 on isa0 sio1: type 16550A sio1: [FILTER] vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ukbd0: on uhub5 kbd2 at ukbd0 ums0: on uhub5 ums0: 3 buttons. uhub6: on uhub5 uhub6: 7 ports with 7 removable, self powered Timecounters tick every 1.000 msec hptrr: no controller detected. acd0: DVDR at ata0-master UDMA33 Waiting 5 seconds for SCSI devices to settle da0 at ciss0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-5 device da0: 135.168MB/s transfers da0: 139979MB (286677120 512 byte sectors: 255H 32S/T 35132C) da1 at ciss1 bus 0 target 0 lun 0 da1: Fixed Direct Access SCSI-5 device da1: 135.168MB/s transfers da1: 1430745MB (2930167024 512 byte sectors: 255H 32S/T 65535C) (da2:ciss1:0:1:0): got CAM status 0x4 (da2:ciss1:0:1:0): fatal error, failed to attach to device (da2:ciss1:0:1:0): lost device (da2:ciss1:0:1:0): removing device entry SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #7 Launched! Trying to mount root from ufs:/dev/da0s1a bce0: link state changed to UP >How-To-Repeat: always, when disk size > 2T >Fix: >Release-Note: >Audit-Trail: From: Edwin Groothuis To: Alex Keda Cc: freebsd-gnats-submit@FreeBSD.org Subject: Re: kern/119799: cannot see large disk (more than 2T) Date: Sat, 19 Jan 2008 22:24:37 +1100 On Sat, Jan 19, 2008 at 10:59:08AM +0000, Alex Keda wrote: > >Synopsis: cannot see large disk (more than 2T) Have you tried gpt(8) instead of fdisk(8) / bsdlabel(8) ? For what it is worth, I stopped making disks that large after I had an fsck(8) not being able to do a full filesystem check due to memory limitations... Edwin -- Edwin Groothuis | Personal website: http://www.mavetju.org edwin@mavetju.org | Weblog: http://www.mavetju.org/weblog/ From: Alex Keda To: bug-followup@FreeBSD.org, admin@lissyara.su Cc: Subject: Re: kern/119799: cannot see large disk (more than 2T) Date: Sat, 19 Jan 2008 14:42:56 +0300 yes, but gpt(8) need device ; on /dev/ - no device da2 :( State-Changed-From-To: open->patched State-Changed-By: linimon State-Changed-When: Fri May 16 14:49:17 UTC 2008 State-Changed-Why: To submitter: does the following commit fix this issue for you? (It has also been MFCed to 6 and 7) http://www.freebsd.org/cgi/cvsweb.cgi/src/sys/dev/ciss/ciss.c.diff?r1=1.87;r2=1.88;f=h Responsible-Changed-From-To: freebsd-bugs->linimon Responsible-Changed-By: linimon Responsible-Changed-When: Fri May 16 14:49:17 UTC 2008 Responsible-Changed-Why: http://www.freebsd.org/cgi/query-pr.cgi?pr=119799 State-Changed-From-To: patched->closed State-Changed-By: linimon State-Changed-When: Sun May 18 23:32:26 UTC 2008 State-Changed-Why: Per ps@, this is now in 6 and 7. As 5 is nearly at EOL, this will not be merged there, so close this one. http://www.freebsd.org/cgi/query-pr.cgi?pr=119799 >Unformatted: