4 Replies Latest reply on Jan 16, 2012 2:44 PM by zoop

    Problem with 82575GB Card and packets/s capabilities.

    zoop

      I have two of these network cards in my Linux machine running as a router.  It is a Dell R710 server.

       

      I am running two interfaces  on one card using the bonding interface in linux to do a LACP with the switch.  I do the same with the second card.  These two bonding setups represent each side of the router.  My problem is that when one of the Physical interfaces hits about 116,000Packets per second it seems to not take any more traffic.  The other interface in the Bond can take more traffic though.  This is a problem for me I would expect the chard to be able to handle more like 700,000 Packets per second.  Could someone provide me a little more information on what to expect from the card for one.  Then if you can help me with the problem.

       

      I also have a post here http://www.linuxquestions.org/questions/editpost.php?do=editpost&p=4543238  Where I have posted more details.

       

      Thank you for your time.

      -Zoop

        • 1. Re: Problem with 82575GB Card and packets/s capabilities.
          Dan_O

          Are you saying you start dropping packets after 116kpps?  Or that's just the cutoff where data starts using the second port in the trunk?

           

          I can't see the post to linuxquestions.org, it wants a login.  Did you get any feedback from there yet?

          • 2. Re: Problem with 82575GB Card and packets/s capabilities.
            zoop

             

            >>Are you  saying you start dropping packets after 116kpps?  Or that's just the  cutoff where data starts using the second port in the trunk?

             

            What I see happening is when one of the interfaces in the trunk hits 116kpps that yes it does start dropping traffic.  But the second interface in the trunk can accept more traffic.   The network switch is configured to load balance by SRC mac address I believe, but due to the fact most of this is comming from one server it is not load balancing this so much.

             

             

             

            >>I can't see the post to linuxquestions.org, it wants a login.  Did you get any feedback from there yet?

             

            I have not gotten any feedback anywhere yet.  I have posted there on Nabble.org and the Developers mailing list.

             

            Any help would be appreciated.

             

            • 3. Re: Problem with 82575GB Card and packets/s capabilities.
              Dan_O

              Zoop -

               

              I think you've hit the nail on the head.  Load balancing by MAC address won't do you any good, if most of your traffic is coming from the same MAC address.  Once that TCP conversation hits the packet limit (which 116 sounds about right), you're going to get dropped packets.

               

              I know very little about Linux bonding.  Do you have any other options for load balancing, besides source MAC?

              • 4. Re: Problem with 82575GB Card and packets/s capabilities.
                zoop

                I'm not sure I follow here.  As this is a firewall and also just a packet filtering firewall not Statefull, TCP would have no relivance here.  Actually in this case the packets are all UDP packets averaging about 256Bytes.  I definitely know that device have Packet/s limits, but from reading on the internet about Gig interfaces and tests that have been done most people get at minimum 700,000PPS With good interface cards.  Others max out about 800,000PPS.    So that is kinda my concern they are getting that out of using 1 Gig interface and I can't.  I am happy to disable bonding and just use 1 gig interface on each card for testing.  But I would imagine the bonding driver has little affect.

                 

                Let me know what you think.

                 

                Thanks

                 

                -Rance