help with RHEL 3.0 NIC Bonding / 802.1 Vlan issues

I am hoping someone can help me out on some issues I am seeing with
RedHat EL 3.0 and NIC bonding with 802.1 vlan tagging.

The server is an HP DL140, with BroadCOM NICS. I have installed the
bonding and vlan drivers from HP, and the configuration works as
expected.

One of the main problems I am seeing is that on boot,
/etc/sysconfig/static-routes is not being applied. I had to put the
routes in /etc/rc.local to make them work. This may be the order in
which the interfaces are brought up maybe? I am not sure where to
confirm this. Can anyone suggest what to look for with respect to the
static routes?

Our monitoring shows that we get connectivity loss several times per
day, but only for a brief period - usually less than one minute total.
Could this be because the default mode for the NICs is Round-Robin
between our switches? Should miimon be set to something other than
100?

Also, we are seeing odd connection timeouts from monitoring that I
cannot explain.

Here is the output of /etc/modules.conf:
[root@wpweb01:~]# cat /etc/modules.conf
alias eth0 tg3
alias eth1 tg3
alias usb-controller usb-ohci
alias bond0 bonding
options bond0 miimon=100


ifconfig shows no rx or tx errors or drops:
[root@wpweb01:~]# ifconfig -a
bond0 Link encap:Ethernet HWaddr 00:11:854:0A:0D
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:35336773 errors:0 dropped:0 overruns:0 frame:0
TX packets:36874576 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:1635352243 (1559.5 Mb) TX bytes:3638010180 (3469.4
Mb)

bond0.130 Link encap:Ethernet HWaddr 00:11:854:0A:0D
inet addr:xxx.xx.xx.xx Bcast:xxx.xx.xx.xx
Mask:255.255.255.0
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:31923492 errors:0 dropped:0 overruns:0 frame:0
TX packets:34544296 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:749751382 (715.0 Mb) TX bytes:1208594568 (1152.6
Mb)

bond0.140 Link encap:Ethernet HWaddr 00:11:854:0A:0D
inet addr:xxx.xx.xx.xx Bcast:xxx.xx.xx.xx
Mask:255.255.255.0
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:3413161 errors:0 dropped:0 overruns:0 frame:0
TX packets:2330269 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:249499847 (237.9 Mb) TX bytes:2276565504 (2171.1
Mb)

eth0 Link encap:Ethernet HWaddr 00:11:854:0A:0D
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:17575490 errors:0 dropped:0 overruns:0 frame:0
TX packets:18437294 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:768955996 (733.3 Mb) TX bytes:3960225932 (3776.7
Mb)
Interrupt:18

eth1 Link encap:Ethernet HWaddr 00:11:854:0A:0D
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:17761283 errors:0 dropped:0 overruns:0 frame:0
TX packets:18437282 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:866396247 (826.2 Mb) TX bytes:3972751544 (3788.7
Mb)
Interrupt:19

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:10677954 errors:0 dropped:0 overruns:0 frame:0
TX packets:10677954 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:2870701174 (2737.7 Mb) TX bytes:2870701174 (2737.7
Mb)



dmesg:
eth0: Tigon3 [partno(BCM95704A6) rev 2002 PHY(5704)]
(PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:11:85:d4:0a:0d
divert: allocating divert_blk for eth1
eth1: Tigon3 [partno(BCM95704A6) rev 2002 PHY(5704)]
(PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:11:85:d4:0a:0c
divert: freeing divert_blk for eth0
divert: freeing divert_blk for eth1
ip_tables: (C) 2000-2002 Netfilter core team
bonding.c:v1.0.4r-1 (January 5, 2005)
divert: not allocating divert_blk for non-ethernet device bond0
bond0 registered with MII link monitoring set to 100 ms, in load
balancing (round-robin) mode.
bond0 registered without ARP monitoring
tg3.c:v2.2 (August 24, 2003)
divert: allocating divert_blk for eth0
eth0: Tigon3 [partno(BCM95704A6) rev 2002 PHY(5704)]
(PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:11:85:d4:0a:0d
divert: allocating divert_blk for eth1
eth1: Tigon3 [partno(BCM95704A6) rev 2002 PHY(5704)]
(PCIX:133MHz:64-bit) 10/100/1000BaseT Ethernet 00:11:85:d4:0a:0c
bond0: enslaving eth0 as an active interface with a down link.
bond0: enslaving eth1 as an active interface with a down link.
ip_tables: (C) 2000-2002 Netfilter core team
802.1Q VLAN Support v1.8 Ben Greear <(E-Mail Removed)>
divert: allocating divert_blk for bond0.130
bond0.130: add 01:00:5e:00:00:01 mcast address to master interface
divert: allocating divert_blk for bond0.140
bond0.140: add 01:00:5e:00:00:01 mcast address to master interface
ip_tables: (C) 2000-2002 Netfilter core team
ip_tables: (C) 2000-2002 Netfilter core team
tg3: eth0: Link is up at 100 Mbps, full duplex.
tg3: eth0: Flow control is off for TX and off for RX.
bond0: link status definitely up for interface eth0.
tg3: eth1: Link is up at 100 Mbps, full duplex.
tg3: eth1: Flow control is off for TX and off for RX.
bond0: link status definitely up for interface eth1.
bond0: released all slaves
bond0.130: del 01:00:5e:00:00:01 mcast address from master interface
bond0.130: del 01:00:5e:00:00:01 mcast address from vlan interface
bond0.140: del 01:00:5e:00:00:01 mcast address from master interface
bond0.140: del 01:00:5e:00:00:01 mcast address from vlan interface
ip_tables: (C) 2000-2002 Netfilter core team
bond0.130: add 01:00:5e:00:00:01 mcast address to master interface
bond0.140: add 01:00:5e:00:00:01 mcast address to master interface
tg3: eth0: Link is up at 100 Mbps, full duplex.
tg3: eth0: Flow control is off for TX and off for RX.
bond0: enslaving eth0 as an active interface with an up link.
tg3: eth1: Link is up at 100 Mbps, full duplex.
tg3: eth1: Flow control is off for TX and off for RX.
bond0: enslaving eth1 as an active interface with an up link.
ip_tables: (C) 2000-2002 Netfilter core team
bond0.130: dev_set_allmulti(master, 1)
bond0.130: dev_set_allmulti(master, -1)
bond0.140: dev_set_allmulti(master, 1)
bond0.140: dev_set_allmulti(master, -1)
bond0.130: dev_set_allmulti(master, 1)
bond0.130: dev_set_allmulti(master, -1)
bond0.140: dev_set_allmulti(master, 1)
bond0.140: dev_set_allmulti(master, -1)
device eth1 entered promiscuous mode
device eth0 entered promiscuous mode
device bond0 entered promiscuous mode
device eth1 left promiscuous mode
device eth0 left promiscuous mode
device bond0 left promiscuous mode
bond0.130: dev_set_allmulti(master, 1)
bond0.130: dev_set_allmulti(master, -1)
bond0.140: dev_set_allmulti(master, 1)
bond0.140: dev_set_allmulti(master, -1)
bond0.130: dev_set_allmulti(master, 1)
bond0.130: dev_set_allmulti(master, -1)
bond0.140: dev_set_allmulti(master, 1)
bond0.140: dev_set_allmulti(master, -1)
device eth1 entered promiscuous mode
device eth0 entered promiscuous mode
device bond0 entered promiscuous mode
device eth1 left promiscuous mode
device eth0 left promiscuous mode
device bond0 left promiscuous mode


Please let me know if I can give more information to help diagnose the
issues.

Thanks to anyone who takes the time to help!



mbell0218@gmail.com

In comp.os.linux.networking (E-Mail Removed):
> I am hoping someone can help me out on some issues I am seeing with
> RedHat EL 3.0 and NIC bonding with 802.1 vlan tagging.

> The server is an HP DL140, with BroadCOM NICS. I have installed the
> bonding and vlan drivers from HP, and the configuration works as
> expected.

> One of the main problems I am seeing is that on boot,
> /etc/sysconfig/static-routes is not being applied. I had to put the

Remember some troubles figuring it out, you get behind the magic
following what the network init script and the scripts
sourced/called from it do.

This URL should save me some typing, even if setting via route in
rc.local should do fine (but look ugly), unless you need routes
earlier while booting available.

http://www.akadia.com/services/redha...ic_routes.html

[..]

Good luck

--
Michael Heiming (X-PGP-Sig > GPG-Key ID: EDD27B94)
mail: echo (E-Mail Removed) | perl -pe 'y/a-z/n-za-m/'
#bofh excuse 284: Electrons on a bender