Author Topic: simple udp optimization setup help  (Read 12982 times)

peter

  • Contributor
  • Full Member
  • *****
  • Posts: 51
    • View Profile
simple udp optimization setup help
« on: March 09, 2015, 01:51:28 PM »
Hi,
I am trying to get simple udp optimization working with version 2.0.2. 
Udp test program: uftp which supports both unicast and multicast.  I only need unicast working. 

I had  two sites, sever 192.168.4.50 and client 192.168.3.30.  What i did was put following line policy on both wanos virtual appliances running on vmware workstaion.

192.168.4.50/32  192.168.3.30/32 udp ,please see attached policy screenshot.

I tried to tranfer a ubuntu iso image and udp optimization did not work. 
Tomorrow, I will try txt file tomorrow.
My question:
1.   Is my setting correct or something missing ?
2.   What is the setup and best file type and size for simple udp  (unicast only) optimization working ?

Thanks

ahenning

  • Team Wanos
  • Administrator
  • Full Member
  • *****
  • Posts: 629
    • View Profile
Re: simple udp optimization setup help
« Reply #1 on: March 09, 2015, 02:25:15 PM »
Peter,

Config looks fine. Remember to apply the policy and to check that peers are up.

Im running a quick VMware replication test over UDP and its fine at 5.5X.

Perhaps the ISO is already compressed and your second test or different file type test will work as expected.

I also noticed UDP stats are not being pulled into NetFlow. UDP Sessions stats added to v2.0.3

Graphs of UDP Optimization:

« Last Edit: March 09, 2015, 04:03:59 PM by ahenning »
CCIE RS, CCIE SP, Mnet&sys

Note: Forum posts may be outdated. Please see the latest documentation at wanos.co/docs

peter

  • Contributor
  • Full Member
  • *****
  • Posts: 51
    • View Profile
Re: simple udp optimization setup help
« Reply #2 on: March 10, 2015, 07:40:07 AM »
Thanks.

Yesterday, I did not reset service inside reset page after put policy on both appliances.
However, I still did not optimization on udp today again.  Basically because I did not how to simulate network to low bandwidth like real world.

My lab is  100M network.

Without hooking up wanos appliance:

In order to simulate 4M in real world, I used netem
htb tool.  But once bandwidth is low, udp start getting bad. File received
is corrupted by diff. For example 4Mbytes ppt file corrupted
on 2.5M simulated network but it was good on orginal 100M network.

I understand that file gone bad on udp is expected . but, if file is corrupted, there will be no ground for the further optimization test.


As your test result is impressive, I am wondering if you could help with following question.

1) Which udp transferring program ? Is it public available or privately written by yourself ? (Yesterday I used uftp and today I wrote my very simple udp client and server program for tranferring only  because uftp has tcp-kind  error handling system.  My program is good when both bandwidth is fast enough and file is small enough.

2) What was your test network bandwidth or how to simulate it properly ?
   With what tools ?
3) What are the good format and size for a file to be tested ?

I would like to following your steps to see what is wrong with my lab setup.

Thanks very much again.

ahenning

  • Team Wanos
  • Administrator
  • Full Member
  • *****
  • Posts: 629
    • View Profile
Re: simple udp optimization setup help
« Reply #3 on: March 10, 2015, 09:16:44 AM »
Hi Peter,

1) Yes that is expected, UDP is not reliable so packet loss will cause the file to corrupt. uftp tcp-kind error handling should be good for this?

2) You can enable UPDATED: Packet Loss Recovery which will make the UDP stream between the Wanos devices reliable, like TCP.


If the application is sensitive to lost packets I can't imagine pure UDP being a good long term option, because packet drops is still possible on the LAN or within the system.

Why is UDP used in this scenario?


« Last Edit: September 26, 2016, 01:24:12 PM by lmolina »
CCIE RS, CCIE SP, Mnet&sys

Note: Forum posts may be outdated. Please see the latest documentation at wanos.co/docs

peter

  • Contributor
  • Full Member
  • *****
  • Posts: 51
    • View Profile
Re: simple udp optimization setup help
« Reply #4 on: March 10, 2015, 01:34:12 PM »
     We pick udp because udp is faster than tcp and we can bear some errors.  Our application is very timing sensitive and most of our edge network link is only 4Mbps. We hope wanos will speed up our udp message delivery.  That is also why I tried to simulate slow network in our lab.
    Thanks
     

peter

  • Contributor
  • Full Member
  • *****
  • Posts: 51
    • View Profile
Re: simple udp optimization setup help
« Reply #5 on: March 11, 2015, 03:43:19 AM »
Question:
How do I know whether udp optimization policy entered is effective ?
After I entered above udp policy, I reset the service and pressed submit and even restarted wanos.

I created a txt file which is about 200M size and gzip can get it reduced to 1M size.
Since the file can be compressed very much, it should be a good candidate for udp optimization.

After transferring,
1)  From interface stats, it shows there are 200M coming and going on wan0 and lan0.
2)  Peer status shows nothing.

Obviously, optimization did not happen.

Did I do something wrong ?


ahenning

  • Team Wanos
  • Administrator
  • Full Member
  • *****
  • Posts: 629
    • View Profile
Re: simple udp optimization setup help
« Reply #6 on: March 11, 2015, 10:05:32 AM »
Hi Peter,

I would recommend to get standard TCP optimization working first. Make sure everything is ok and working. And measure the TCP optimization to know that is also working. Get the peers up and since this is a lab, set the peer timeout high enough. Then try the UDP.

It looks like you have the policy correct, so there is not really any reason for it not to work, unless the server/client uses different addresses.
CCIE RS, CCIE SP, Mnet&sys

Note: Forum posts may be outdated. Please see the latest documentation at wanos.co/docs

peter

  • Contributor
  • Full Member
  • *****
  • Posts: 51
    • View Profile
Re: simple udp optimization setup help
« Reply #7 on: April 17, 2015, 07:47:03 AM »
Eventually, I got udp optimization working and my problem was I did not keep peer
 timeout long enough.  Peer was not up when I tried to test.

Thanks very much.

However, I found that peer would be down if I reset service for something else.
 Then, I will have to do a quick ftp to bring them up.  Is it there anyway to keep peer auto up or I missed something.

Thanks again.

Thanks again.

ahenning

  • Team Wanos
  • Administrator
  • Full Member
  • *****
  • Posts: 629
    • View Profile
Re: simple udp optimization setup help
« Reply #8 on: April 17, 2015, 07:56:50 AM »
Hi Peter,

Ah yes, good catch. Normally there are a mix of tcp and udp traffic, but in this scenario the traffic is very specific to udp only.

Switching to UDP encapsulation should avoid this. Optionally increase UDPPEERRATE=0.05 to UDPPEERRATE=0.1

CCIE RS, CCIE SP, Mnet&sys

Note: Forum posts may be outdated. Please see the latest documentation at wanos.co/docs

peter

  • Contributor
  • Full Member
  • *****
  • Posts: 51
    • View Profile
Re: simple udp optimization setup help
« Reply #9 on: April 20, 2015, 09:27:46 AM »
 Optionally increase UDPPEERRATE=0.05 to UDPPEERRATE=0.1

Where can i do this ?

Thanks

ahenning

  • Team Wanos
  • Administrator
  • Full Member
  • *****
  • Posts: 629
    • View Profile
Re: simple udp optimization setup help
« Reply #10 on: April 20, 2015, 10:04:25 AM »
vi /tce/etc/wanos/wanos.conf

This change is only needed if there is very little traffic going over the link.

Also remember to enabled UDP encap from the settings page on both ends for udp encapsulation to work correctly.
CCIE RS, CCIE SP, Mnet&sys

Note: Forum posts may be outdated. Please see the latest documentation at wanos.co/docs

peter

  • Contributor
  • Full Member
  • *****
  • Posts: 51
    • View Profile
Re: simple udp optimization setup help
« Reply #11 on: April 24, 2015, 01:29:06 PM »
udp port option does not seem working.
Please see the attached and client wanos is on 192.168.3.0/24.
Rule 6 does not work (no bypass happens, no bypass for app with port 10030)
Rule 6 without port will work (bypass happens)
Rules entered only on the server side

ahenning

  • Team Wanos
  • Administrator
  • Full Member
  • *****
  • Posts: 629
    • View Profile
Re: simple udp optimization setup help
« Reply #12 on: April 24, 2015, 02:02:50 PM »
Hi Peter,

I did a quick test with these rules and can't replicate the same problem. Could you please email me the techsup file?
CCIE RS, CCIE SP, Mnet&sys

Note: Forum posts may be outdated. Please see the latest documentation at wanos.co/docs

peter

  • Contributor
  • Full Member
  • *****
  • Posts: 51
    • View Profile
Re: simple udp optimization setup help
« Reply #13 on: May 05, 2015, 12:48:38 PM »
hi
For udp peer up, would be possible to do followings:

1) entering two wanos ips in console (command mode)
2) after every reboot, two appliance would auto find each other and peer up with
out sending tcp traffic.

Thanks

ahenning

  • Team Wanos
  • Administrator
  • Full Member
  • *****
  • Posts: 629
    • View Profile
Re: simple udp optimization setup help
« Reply #14 on: May 05, 2015, 01:03:01 PM »
Hi Peter,

UDP encapsulation does not require any TCP traffic to peer, hence I mentioned to try that option.
CCIE RS, CCIE SP, Mnet&sys

Note: Forum posts may be outdated. Please see the latest documentation at wanos.co/docs