low sysbench scores on 8 core server

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

low sysbench scores on 8 core server

Lutz Rabing
hi,

I did some testing an a supermicro 2 x 4 core xeon server under 64bit
"7.0-STABLE #1: Fri Jul  4". when we first tested the system under load
(2000 apache threads) the system performed bad compare to other dual
core systems under the same workload.

the 8 core system had 0% idle time and almost 100% system load. I could
not find out what the load was. disk IO was close to zero during that time.

because of that I checked the sysbench results with this test:

sysbench --test=oltp --mysql-socket=/tmp/mysql.sock --mysql-user=root \
 --max-requests=0 --max-time=60 --oltp-read -only=on --num-threads=$1 run

here are the sysbench results:

- 1 thread --------------------------------------------------------
OLTP test statistics:
    queries performed:
        read:                            354774
        write:                           0
        other:                           50682
        total:                           405456
    transactions:                        25341  (422.34 per sec.)
    deadlocks:                           0      (0.00 per sec.)
    read/write requests:                 354774 (5912.82 per sec.)
    other operations:                    50682  (844.69 per sec.)

- 8 threads -------------------------------------------------------
OLTP test statistics:
    queries performed:
        read:                            145166
        write:                           0
        other:                           20738
        total:                           165904
    transactions:                        10369  (172.75 per sec.)
    deadlocks:                           0      (0.00 per sec.)
    read/write requests:                 145166 (2418.54 per sec.)
    other operations:                    20738  (345.51 per sec.)
--------------------------------------------------------------------

during the 8 thread test "top" looks like this:
-----------------------------------------------------------------------------
last pid: 30104;  load averages:  2.50,  0.65,  0.52  up 0+01:49:44  17:52:14
69 processes:  7 running, 62 sleeping
CPU:  5.6% user,  0.0% nice, 64.0% system,  0.0% interrupt, 30.4% idle
Mem: 44M Active, 296M Inact, 277M Wired, 84K Cache, 214M Buf, 15G Free
Swap: 16G Total, 16G Free
-----------------------------------------------------------------------------

software versions used:
 - mysql-server-5.1.25
 - sysbench-0.4.8

any ideas what I should look for or what to change?
I could supply more info if needed. dmesg appended.

thanks,
lutz


==================================================================================================
FreeBSD 7.0-STABLE #1: Fri Jul  4 01:41:13 CEST 2008
    [hidden email]:/usr/obj/usr/src/sys/OMC
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU           E5345  @ 2.33GHz (2333.35-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x6f7  Stepping = 7

Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x4e3bd<SSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  Cores per package: 4
usable memory = 17166041088 (16370 MB)
avail memory  = 16626790400 (15856 MB)
ACPI APIC Table: <PTLTD          APIC  >
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
 cpu4 (AP): APIC ID:  4
 cpu5 (AP): APIC ID:  5
 cpu6 (AP): APIC ID:  6
 cpu7 (AP): APIC ID:  7
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0: <PTLTD   RSDT> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 2.0 on pci2
pci4: <ACPI PCI bus> on pcib4
em0: <Intel(R) PRO/1000 Network Connection 6.9.5> port 0x2000-0x201f mem 0xda000000-0xda01ffff irq 18 at device 0.0 on pci4
em0: Using MSI interrupt
em0: [FILTER]
em0: Ethernet address: 00:30:48:79:cb:ba
em1: <Intel(R) PRO/1000 Network Connection 6.9.5> port 0x2020-0x203f mem 0xda020000-0xda03ffff irq 19 at device 0.1 on pci4
em1: Using MSI interrupt
em1: [FILTER]
em1: Ethernet address: 00:30:48:79:cb:bb
pcib5: <ACPI PCI-PCI bridge> at device 0.3 on pci1
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci6: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> at device 0.0 on pci6
pci7: <ACPI PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> at device 0.2 on pci6
pci8: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci9: <ACPI PCI bus> on pcib9
pcib10: <ACPI PCI-PCI bridge> at device 0.0 on pci9
pci10: <ACPI PCI bus> on pcib10
3ware device driver for 9000 series storage controllers, version: 3.70.05.001
twa0: <3ware 9000 series Storage Controller> port 0x3000-0x303f mem 0xd8000000-0xd9ffffff,0xda300000-0xda300fff irq 18 at device
1.0 on pci10
twa0: [ITHREAD]
twa0: INFO: (0x04: 0x0053): Battery capacity test is overdue:
twa0: INFO: (0x15: 0x1300): Controller details:: Model 9550SXU-4LP, 4 ports, Firmware FE9X 3.04.00.005, BIOS BE9X 3.04.00.002
pcib11: <ACPI PCI-PCI bridge> at device 0.2 on pci9
pci11: <ACPI PCI bus> on pcib11
pci0: <base peripheral> at device 8.0 (no driver attached)
uhci0: <Intel 631XESB/632XESB/3100 USB controller USB-1> port 0x1800-0x181f irq 17 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
uhci0: [ITHREAD]
usb0: <Intel 631XESB/632XESB/3100 USB controller USB-1> on uhci0
usb0: USB revision 1.0
uhub0: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 631XESB/632XESB/3100 USB controller USB-2> port 0x1820-0x183f irq 19 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
uhci1: [ITHREAD]
usb1: <Intel 631XESB/632XESB/3100 USB controller USB-2> on uhci1
usb1: USB revision 1.0
uhub1: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
uhub1: 2 ports with 2 removable, self powered
uhci2: <Intel 631XESB/632XESB/3100 USB controller USB-3> port 0x1840-0x185f irq 18 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
uhci2: [ITHREAD]
usb2: <Intel 631XESB/632XESB/3100 USB controller USB-3> on uhci2
usb2: USB revision 1.0
uhub2: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb2
uhub2: 2 ports with 2 removable, self powered
ehci0: <Intel 63XXESB USB 2.0 controller> mem 0xda600400-0xda6007ff irq 17 at device 29.7 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb3: EHCI version 1.0
usb3: companion controllers, 2 ports each: usb0 usb1 usb2
usb3: <Intel 63XXESB USB 2.0 controller> on ehci0
usb3: USB revision 2.0
uhub3: <Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb3
uhub3: 6 ports with 6 removable, self powered
pcib12: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci12: <ACPI PCI bus> on pcib12
vgapci0: <VGA-compatible display> port 0x4000-0x40ff mem 0xd0000000-0xd7ffffff,0xda200000-0xda20ffff irq 18 at device 1.0 on pci12
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 63XXESB2 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1860-0x186f at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
atapci1: <Intel AHCI controller> port 0x18a0-0x18a7,0x1874-0x1877,0x1878-0x187f,0x1870-0x1873,0x1880-0x189f mem
0xda600800-0xda600bff irq 19 at device 31.2 on pci0
atapci1: [ITHREAD]
atapci1: AHCI Version 01.10 controller with 6 ports detected
ata2: <ATA channel 0> on atapci1
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci1
ata3: [ITHREAD]
ata4: <ATA channel 2> on atapci1
ata4: [ITHREAD]
ata5: <ATA channel 3> on atapci1
ata5: [ITHREAD]
ata6: <ATA channel 4> on atapci1
ata6: [ITHREAD]
ata7: <ATA channel 5> on atapci1
ata7: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
cpu0: <ACPI CPU> on acpi0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
cpu1: <ACPI CPU> on acpi0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
cpu2: <ACPI CPU> on acpi0
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
cpu3: <ACPI CPU> on acpi0
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
cpu4: <ACPI CPU> on acpi0
est4: <Enhanced SpeedStep Frequency Control> on cpu4
p4tcc4: <CPU Frequency Thermal Control> on cpu4
cpu5: <ACPI CPU> on acpi0
est5: <Enhanced SpeedStep Frequency Control> on cpu5
p4tcc5: <CPU Frequency Thermal Control> on cpu5
cpu6: <ACPI CPU> on acpi0
est6: <Enhanced SpeedStep Frequency Control> on cpu6
p4tcc6: <CPU Frequency Thermal Control> on cpu6
cpu7: <ACPI CPU> on acpi0
est7: <Enhanced SpeedStep Frequency Control> on cpu7
p4tcc7: <CPU Frequency Thermal Control> on cpu7
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
sio0: [FILTER]
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
sio1: [FILTER]
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FILTER]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
acpi_button0: <Power Button> on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xcafff,0xcb000-0xcc7ff on isa0
ppc0: cannot reserve I/O port range
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
ipfw2 (+ipv6) initialized, divert loadable, nat loadable, rule-based forwarding disabled, default to accept, logging limited to
100 packets/entry by default
acd0: CDRW <Slimtype COMBO SSC-2485K/5K06> at ata0-slave UDMA33
SMP: AP CPU #2 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #5 Launched!
da0 at twa0 bus 0 target 0 lun 0
da0: <AMCC 9550SXU-4L DISK 3.04> Fixed Direct Access SCSI-3 device
da0: 100.000MB/s transfers
da0: 1430490MB (2929643520 512 byte sectors: 255H 63S/T 182361C)
Trying to mount root from ufs:/dev/da0s1a
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: low sysbench scores on 8 core server

Kris Kennaway-3
Lutz Rabing wrote:

> hi,
>
> I did some testing an a supermicro 2 x 4 core xeon server under 64bit
> "7.0-STABLE #1: Fri Jul  4". when we first tested the system under load
> (2000 apache threads) the system performed bad compare to other dual
> core systems under the same workload.
>
> the 8 core system had 0% idle time and almost 100% system load. I could
> not find out what the load was. disk IO was close to zero during that time.
>
> because of that I checked the sysbench results with this test:
>
> sysbench --test=oltp --mysql-socket=/tmp/mysql.sock --mysql-user=root \
>  --max-requests=0 --max-time=60 --oltp-read -only=on --num-threads=$1 run

See my tuning notes at:

http://people.freebsd.org/~kris/scaling/mysql.html

> software versions used:
>  - mysql-server-5.1.25

In my tests mysql 5.1 has much worse performance than 5.0.

Kris

_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: low sysbench scores on 8 core server

Lutz Rabing
Kris Kennaway schrieb:

> Lutz Rabing wrote:
>> hi,
>>
>> I did some testing an a supermicro 2 x 4 core xeon server under 64bit
>> "7.0-STABLE #1: Fri Jul  4". when we first tested the system under load
>> (2000 apache threads) the system performed bad compare to other dual
>> core systems under the same workload.
>>
>> the 8 core system had 0% idle time and almost 100% system load. I could
>> not find out what the load was. disk IO was close to zero during that
>> time.
>>
>> because of that I checked the sysbench results with this test:
>>
>> sysbench --test=oltp --mysql-socket=/tmp/mysql.sock --mysql-user=root \
>>  --max-requests=0 --max-time=60 --oltp-read -only=on --num-threads=$1 run
>
> See my tuning notes at:
>
> http://people.freebsd.org/~kris/scaling/mysql.html
>
>> software versions used:
>>  - mysql-server-5.1.25
>
> In my tests mysql 5.1 has much worse performance than 5.0.
>
> Kris
>
>
> .
>


hi kris,

thanks for your response. going back to mysql-5.0.51a the 8core server
performed as expected. (sysbench oltp: 4335 with 8 threads)



thanks,
lutz
_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: low sysbench scores on 8 core server

Kris Kennaway-3
Lutz Rabing wrote:

> Kris Kennaway schrieb:
>> Lutz Rabing wrote:
>>> hi,
>>>
>>> I did some testing an a supermicro 2 x 4 core xeon server under 64bit
>>> "7.0-STABLE #1: Fri Jul  4". when we first tested the system under load
>>> (2000 apache threads) the system performed bad compare to other dual
>>> core systems under the same workload.
>>>
>>> the 8 core system had 0% idle time and almost 100% system load. I could
>>> not find out what the load was. disk IO was close to zero during that
>>> time.
>>>
>>> because of that I checked the sysbench results with this test:
>>>
>>> sysbench --test=oltp --mysql-socket=/tmp/mysql.sock --mysql-user=root \
>>>  --max-requests=0 --max-time=60 --oltp-read -only=on --num-threads=$1 run
>> See my tuning notes at:
>>
>> http://people.freebsd.org/~kris/scaling/mysql.html
>>
>>> software versions used:
>>>  - mysql-server-5.1.25
>> In my tests mysql 5.1 has much worse performance than 5.0.
>>
>> Kris
>>
>>
>> .
>>
>
>
> hi kris,
>
> thanks for your response. going back to mysql-5.0.51a the 8core server
> performed as expected. (sysbench oltp: 4335 with 8 threads)

Good to know.  Let's hope mysql get their act together with the next
release ;-)

Kris

_______________________________________________
[hidden email] mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-performance
To unsubscribe, send any mail to "[hidden email]"