Dell Broadcom NetXtreme Family of Adapters Broadcom NetXtreme II Network Adapt - Page 56

Unloading and Removing Driver, Driver Messages, Rx Ring Size, Coalesce RX Microseconds, MSI-X

Page 56 highlights

VMware Driver Software: Broadcom NetXtreme II Network Adapter User Guide Rx Ring Size: 4078 (range 0-4078) Tx Ring Size: 4078 (range (MAX_SKB_FRAGS+4) - 4078). MAX_SKB_FRAGS varies on different kernels and different architectures. On a 2.6 kernel for x86, MAX_SKB_FRAGS is 18. Coalesce RX Microseconds: 25 (range 0-3000) Coalesce TX Microseconds: 50 (range 0-12288) MSI-X: Enabled (if supported by 2.6 kernel) TSO: Enabled WoL: Disabled Unloading and Removing Driver To unload the driver, type the following: vmkload_mod -u bnx2x Driver Messages The following are the most common sample messages that may be logged in the file /var/log/messages. Use dmesg -n to control the level at which messages will appear on the console. Most systems are set to level 6 by default. To see all messages, set the level higher. Driver Sign On Broadcom NetXtreme II 5771x 10Gigabit Ethernet Driver bnx2x 0.40.15 ($DateTime: 2007/11/22 05:32:40 $) NIC Detected eth0: Broadcom NetXtreme II BCM57710 XGb (A1) PCI-E x8 2.5GHz found at mem e8800000, IRQ 16, node addr 001018360012 MSI-X Enabled Successfully bnx2x: eth0: using MSI-X Link Up and Speed Indication bnx2x: eth0 NIC Link is Up, 10000 Mbps full duplex, receive & transmit flow control ON Link Down Indication bnx2x: eth0 NIC Link is Down Memory Limitation If you see messages in the log file that look like the following, then the ESX host is severely strained. To relieve this, disable NetQueue. Dec 2 18:24:20 ESX4 vmkernel: 0:00:00:32.342 cpu2:4142)WARNING: Heap: 1435: Heap bnx2x already at its maximumSize. Cannot expand. Dec 2 18:24:20 ESX4 vmkernel: 0:00:00:32.342 cpu2:4142)WARNING: Heap: 1645: Heap_Align(bnx2x, 4096/4096 bytes, 4096 align) failed. caller: 0x41800187d654 Dec 2 18:24:20 ESX4 vmkernel: 0:00:00:32.342 cpu2:4142)WARNING: vmklinux26: alloc_pages: Out of memory Disable NetQueue by manually loading the bnx2x vmkernel module via the command. vmkload_mod bnx2x multi_mode=0 or to persist the settings across reboots via the command esxcfg-module -s multi_mode=0 bnx2x Reboot the machine for the settings to take place. MultiQueue/NetQueue The optional parameter num_queues may be used to set the number of Rx and Tx queues when multi_mode is set to 1 and interrupt mode is MSI-X. If interrupt mode is different than MSI-X (see int_mode parameter), the number of Rx and Tx file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/vmware.htm[9/26/2012 3:28:54 PM]

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53
  • 54
  • 55
  • 56
  • 57
  • 58
  • 59
  • 60
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78
  • 79
  • 80
  • 81
  • 82
  • 83
  • 84
  • 85
  • 86
  • 87
  • 88
  • 89
  • 90
  • 91
  • 92
  • 93
  • 94
  • 95
  • 96
  • 97
  • 98
  • 99
  • 100
  • 101
  • 102
  • 103
  • 104
  • 105
  • 106
  • 107
  • 108
  • 109
  • 110
  • 111
  • 112
  • 113
  • 114
  • 115
  • 116
  • 117
  • 118
  • 119
  • 120
  • 121
  • 122
  • 123
  • 124
  • 125
  • 126
  • 127
  • 128
  • 129
  • 130
  • 131
  • 132
  • 133
  • 134
  • 135
  • 136
  • 137
  • 138
  • 139
  • 140
  • 141
  • 142
  • 143
  • 144
  • 145
  • 146
  • 147
  • 148
  • 149
  • 150
  • 151
  • 152
  • 153
  • 154
  • 155
  • 156
  • 157
  • 158
  • 159
  • 160
  • 161
  • 162
  • 163
  • 164
  • 165
  • 166
  • 167
  • 168
  • 169
  • 170
  • 171
  • 172
  • 173
  • 174
  • 175
  • 176
  • 177
  • 178
  • 179
  • 180
  • 181
  • 182
  • 183
  • 184
  • 185
  • 186
  • 187
  • 188
  • 189
  • 190
  • 191
  • 192
  • 193
  • 194
  • 195
  • 196
  • 197
  • 198
  • 199
  • 200
  • 201
  • 202
  • 203
  • 204
  • 205
  • 206
  • 207
  • 208
  • 209
  • 210
  • 211
  • 212
  • 213
  • 214
  • 215
  • 216
  • 217
  • 218
  • 219
  • 220
  • 221
  • 222
  • 223
  • 224

VMware Driver Software: Broadcom NetXtreme II Network Adapter User Guide
file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/vmware.htm[9/26/2012 3:28:54 PM]
Rx Ring Size
: 4078 (range 0–4078)
Tx Ring Size
: 4078 (range (MAX_SKB_FRAGS+4) - 4078). MAX_SKB_FRAGS varies on different kernels and different
architectures. On a 2.6 kernel for x86, MAX_SKB_FRAGS is 18.
Coalesce RX Microseconds
: 25 (range 0–3000)
Coalesce TX Microseconds
: 50 (range 0–12288)
MSI-X
: Enabled (if supported by 2.6 kernel)
TSO
: Enabled
WoL
: Disabled
Unloading and Removing Driver
To unload the driver, type the following:
vmkload_mod -u bnx2x
Driver Messages
The following are the most common sample messages that may be logged in the file /var/log/messages. Use
dmesg -n
<level>
to control the level at which messages will appear on the console. Most systems are set to level 6 by default. To see
all messages, set the level higher.
Driver Sign On
Broadcom NetXtreme II 5771x 10Gigabit Ethernet Driver
bnx2x 0.40.15 ($DateTime: 2007/11/22 05:32:40 $)
NIC Detected
eth0: Broadcom NetXtreme II BCM57710 XGb (A1)
PCI-E x8 2.5GHz found at mem e8800000, IRQ 16, node addr 001018360012
MSI-X Enabled Successfully
bnx2x: eth0: using MSI-X
Link Up and Speed Indication
bnx2x: eth0 NIC Link is Up, 10000 Mbps full duplex, receive & transmit flow control ON
Link Down Indication
bnx2x: eth0 NIC Link is Down
Memory Limitation
If you see messages in the log file that look like the following, then the ESX host is severely strained. To relieve this, disable
NetQueue.
Dec
2 18:24:20 ESX4 vmkernel: 0:00:00:32.342 cpu2:4142)WARNING: Heap: 1435: Heap bnx2x already at its
maximumSize. Cannot expand.
Dec
2 18:24:20 ESX4 vmkernel: 0:00:00:32.342 cpu2:4142)WARNING: Heap: 1645: Heap_Align(bnx2x, 4096/4096
bytes, 4096 align) failed.
caller: 0x41800187d654
Dec
2 18:24:20 ESX4 vmkernel: 0:00:00:32.342 cpu2:4142)WARNING: vmklinux26: alloc_pages: Out of memory
Disable NetQueue by manually loading the bnx2x vmkernel module via the command.
vmkload_mod bnx2x multi_mode=0
or to persist the settings across reboots via the command
esxcfg-module -s multi_mode=0 bnx2x
Reboot the machine for the settings to take place.
MultiQueue/NetQueue
The optional parameter
num_queues
may be used to set the number of Rx and Tx queues when
multi_mode
is set to 1
and interrupt mode is MSI-X. If interrupt mode is different than MSI-X (see
int_mode
parameter), the number of Rx and Tx