I am not sure why your Adapter Fault Tolerance mode team is failing. You said you were using the software & drivers from the DVD. You might want to try the latest drivers and software from Download Center.
You might be able to work around the issue by configuring a different team mode that still gives you the fault tolerance you need. If your switch will support one of the link aggregation modes, then you should consider one of those team types. The team should continue to work if one port in the team fails, and as a bonus your team gains extra bandwidth.
If your switch will not support link aggregation, you could try the Adaptive Load Balancing mode. The team will balance the connections across the ports when more than one port is available and still send and receive traffic over the remaining port if one port fails.
Message was edited by: Mark H @ Intel
To date, we've tried all available drivers from Intel and/or Sun - that support the 82575EB built-in NICs on the X4170 and X4270 servers. There is no change in the behavior I've described. Additionally, the teamed connections are cabled to two different Cisco Catalyst 6509 switch chassis, so 802.3ad (LACP) is currently not feasible.
However, we have noticed a pattern with the failures. On the Sun servers, the four built-in NICs are labeled Net0 through Net3. Net0 and Net1 are on the first controller chip, and Net2 and Net3 are on the second controller chip. When the AFT team does NOT span a controller chip, NIC teaming works as desired. However, as a standard practice to extend server resilience beyond a controller failure, we consistently use Net1 and Net3 as members of our AFT team. In this scenario, where the team DOES span a controller chip, we consistently see the teaming failure. We have never experienced this failure with any other model Intel NIC.
Sun Support believes this to be a bug in the NIC driver, and is currently gathering more data to formally file a bug report with Intel.