在TWAREN網路上進行MPLS與Diffserv的功能測試

(中山大學/屏科大/中研院)

工作進度與結果

網頁負責人 : 謝進忠    enic@atm.ee.nsysu.edu.tw


中山大學

 

星期一 星期二 星期三 星期四 星期五 星期六 星期日
第一週     2004/03/10 2004/03/11 2004/03/12 2004/03/13 2004/03/14
第二週 2004/03/15 2004/03/16 2004/03/17 2004/03/18 2004/03/19

2004/03/20

2004/03/21
第三週 2004/03/22 2004/03/23 2004/03/24 2004/03/25 2004/03/26 2004/03/27 2004/03/28
第四週 2004/03/29 2004/03/30 2004/03/31 2004/04/01 2004/04/02 2004/04/03 2004/04/04
MPLS討論區

屏科大

 

星期一 星期二 星期三 星期四 星期五 星期六 星期日
第一週                 
第二週    2004/03/16 2004/03/17 2004/03/18 2004/03/19 2004/03/20  2004/03/21
第三週 2004/03/21 2004/03/23 2004/03/24 2004/03/25 2004/03/26 2004/03/27 2004/03/28
第四週 2004/03/29 2004/03/30 2004/03/31 2004/04/01 2004/04/02 2004/04/03 2004/04/04
Diffserv討論區

 


Multiple MPLS-VPN + DiffServ

 

1 2 3 4 5 6 7
MPLS VPN 2004/08/02 2004/08/13 2004/08/14 2004/08/16 2004/08/17    

 


 

日    期

 2004/08/17 (二)
工作進度  1. 在 CISCO-12416R上使用 IP-precedence 來測試 DiffServ的效果

 2. 測試 DiffServ over MPLS 的效果

結      果

 1. 在 CISCO-12416R上 , 我們可以利用 policy-map 對不同的 class 下不同頻寬的設定 , 但實際量測時並沒有 DiffServ 的效果 .

 2. Diffserv over MPLS 有指令可以設定,但 是一樣測不出 bandwidth 分配的效果

備      註  1. 依照我們測試的結果 , DSCP 只能在 7609上使用, 無法在 12416上運作

 2. Policy-map 在 7609上可以正常運作 , 但在12416上無法順利運作

 3. ip precedence 可以在12416上設定 , 但是量測不出 DiffServ 的效果

 4. 7609上 mls qos 與 trust指令, 但 12416上沒有這些指令

 5. Diffserv over MPLS有指令可以設定,但測不出 bandwidth 分配的效果 

意      見 對此次測試發表建議       觀看建議

 

日    期

 2004/08/16 (一)
工作進度  DiffServ 的一些問題
結      果

1. 在TN-12416上的output port 為POS 12/0時,發現若欲以"match ip dscp",來classify封包時,
TN-12416會不允許,然而設在input port Gigabitethernet 13/0時,卻可以被接受。因此若路徑
是經由POS 12/0出TN-12416時,DiffServ會無法作用。

TN-12416R(config)#class-map hh
TN-12416R(config-cmap)#match ip dscp ef
TN-12416R(config-cmap)#exit
TN-12416R(config)#policy-map hh
TN-12416R(config-pmap)#class hh
TN-12416R(config-pmap-c)#police cir 50000000 conform-action transmit exceed-action drop
TN-12416R(config-pmap-c)#exit
TN-12416R(config-pmap)#exit
TN-12416R(config)#interface POS 12/0
TN-12416R(config-if)#service-policy output hh
% match ip dscp not allowed in the egress direction on POS12/0


2. 當以"match ip precedence"取代"match ip dscp"後,POS 12/0便接受該policy-map,因此若欲經由
TN-12416等cisco 12000 series router,最好是利用 ip precedence,避免使用DSCP。

TN-12416R(config)#class-map hh
TN-12416R(config-cmap)#no match ip dscp ef
TN-12416R(config-cmap)#match ip precedence 5
TN-12416R(config-cmap)#exit
TN-12416R(config)#policy-map hh
TN-12416R(config-pmap)#class hh
TN-12416R(config-pmap-c)#police cir 50000000 conform-action transmit exceed-action drop
TN-12416R(config-pmap-c)#exit
TN-12416R(config-pmap)#exit
TN-12416R(config)#interface POS 12/0
TN-12416R(config-if)#service-policy output hh
TN-12416R(config-if)#exit


TN-12416R#show policy-map interface pos 12/0
POS12/0

Service-policy output: hh (8284)

Class-map: hh (match-all) (8285/20)
0 packets, 0 bytes
5 minute offered rate 0 bps, drop rate 0 bps
Match: ip precedence 5 (8286)
police:
50000000 bps, 4470 limit, 4470 extended limit
conformed 0 packets, 0 bytes; action: transmit
exceeded 0 packets, 0 bytes; action: drop
conformed 0 bps, exceed 0 bps violate 0 bps

Class-map: hh2 (match-all) (8288/21)
0 packets, 0 bytes
5 minute offered rate 0 bps, drop rate 0 bps
Match: ip precedence 1 (8289)
police:
30000000 bps, 4470 limit, 4470 extended limit
conformed 0 packets, 0 bytes; action: transmit
exceeded 0 packets, 0 bytes; action: drop
conformed 0 bps, exceed 0 bps violate 0 bps

Class-map: class-default (match-any) (8291/0)
1416 packets, 1265974 bytes
5 minute offered rate 7000 bps, drop rate 0 bps
Match: any (8292)
695 packets, 631900 bytes
5 minute rate 3000 bps


3. 在DiffServ的7609等Router,等先下"mls qos",讓DiffServ的map等功能開啟。而在NSYSU 7609R的
interface有DiffServ封包通過時,需下"mls qos trust"的指令,以確保DiffServ的設定值不會被
歸零。

NSYSU-7609R(config)#interface gigabitEthernet 9/12
NSYSU-7609R(config-if)#mls qos trust ?
cos cos keyword
dscp dscp keyword
extend extend keyword
ip-precedence ip-precedence keyword
<cr>

當是以 ip dscp當依據時,得下

NSYSU-7609R(config-if)#mls qos trust dscp

當是以 ip precedence當依據時,得下

NSYSU-7609R(config-if)#mls qos trust ip-precedence

但是在TN-12416等GSR上並沒有"mls qos"或"mls qos trust dscp"等指令,有時當無法分類出EF、AF時,
無法確定12416是否真的有將封包的DSCP或precedence照原本的設定送出,還是將他歸零成BE。

4. Diffserv over MPLS

    有指令可以設定,但測不出 bandwidth 分配的效果 , 整個測試的過程如下

 

備      註  1. 依照我們測試的結果 , DSCP 只能在 7609上使用, 無法在 12416上運作

 2. ip precedence 可以在12416上設定 , 是否可以順利運作有待測試

 3. 7609上 mls qos 與 trust指令, 但12416上沒有

 4. Diffserv over MPLS有指令可以設定,但測不出 bandwidth 分配的效果

意      見 對此次測試發表建議       觀看建議

日    期

 2004/08/14 (六)
工作進度   CISCO 7609有兩種方式可以來建立 VPN , 第一種為  redistribute connected (同2004/08/13的進度)  , 第二種為  redistribute static(今天新增加的方法)

  我們使用  redistribute connected 的方式讓 NSYSU 的 Sender 與 NCU 的 Receiver 形成第一個 VPN A , 再使用 redistribute static 建立 VPN C

結      果  1. Topology 如下圖所示


2. 由中山大學的 NSYSU-7609 上設定成 PE

NSYSU-7609R#conf t
Configuring from terminal, memory, or network [terminal]?
Enter configuration commands, one per line. End with CNTL/Z.
NSYSU-7609R(config)#ip cef distributed
NSYSU-7609R(config)#ip vrf vrf-nsysu-ncu
NSYSU-7609R(config-vrf)#rd 813:813
NSYSU-7609R(config-vrf)#route-target both 813:813
NSYSU-7609R(config-vrf)#exit
NSYSU-7609R(config)#interface gigabitEthernet 9/12
NSYSU-7609R(config-if)#ip vrf forwarding vrf-nsysu-ncu
NSYSU-7609R(config-if)#ip address 192.168.120.120 255.255.255.0
NSYSU-7609R(config-if)#exit

NSYSU-7609R(config)#ip route vrf vrf-nsysu-ncu 211.73.67.0 255.255.255.192 192.168.120.1
NSYSU-7609R(config)#router bgp 7935
NSYSU-7609R(config-router)#no bgp default ipv4-unicast
NSYSU-7609R(config-router)#neighbor 211.79.51.2 remote-as 7539[註] 211.79.51.2 是對方PE(NCU-7609)PE的Loopback0之IP
NSYSU-7609R(config-router)#neighbor 211.79.51.2 update-source Loopback0
NSYSU-7609R(config-router)#address-family vpnv4
NSYSU-7609R(config-router-af)#neighbor 211.79.51.2 activate
NSYSU-7609R(config-router-af)#neighbor 211.79.51.2 send-community extended
NSYSU-7609R(config-router-af)#exit-address-family
NSYSU-7609R(config-router)#address-family ipv4 vrf vrf-nsysu-ncu
NSYSU-7609R(config-router-af)#redistribute connected

NSYSU-7609R(config-router-af)#redistribute static
NSYSU-7609R(config-router-af)#no auto-summary
NSYSU-7609R(config-router-af)#no synchronization
NSYSU-7609R(config-router-af)#exit-address-family
NSYSU-7609R(config-router)#exit
NSYSU-7609R(config)#exit
NSYSU-7609R#


3. 由中央大學的 NCU-7609 上設定成 PE

NCU-7609R#conf
Configuring from terminal, memory, or network [terminal]?
Enter configuration commands, one per line. End with CNTL/Z.
NCU-7609R(config)#ip cef distributed
NCU-7609R(config)#ip vrf vrf-nsysu-ncu
NCU-7609R(config-vrf)#rd 813:813
NCU-7609R(config-vrf)#route-target both 813:813
NCU-7609R(config-vrf)#exit
NCU-7609R(config)#interface gigabitEthernet 9/16
NCU-7609R(config-if)#ip vrf forwarding vrf-nsysu-ncu
NCU-7609R(config-if)#ip address 192.168.34.1 255.255.255.0
NCU-7609R(config-if)#exit

NCU-7609R(config)#ip route vrf vrf-nsysu-ncu 211.73.67.64 255.255.255.192 192.168.34.2
NCU-7609R(config)#router bgp 7539
NCU-7609R(config-router)#no bgp default ipv4-unicast
NCU-7609R(config-router)#neighbor 211.79.58.2 remote-as 7539[註] 211.79.58.2 是對方PE(NSYSU-7609)PE的Loopback0之IP
NCU-7609R(config-router)#neighbor 211.79.58.2 update-source Loopback0
NCU-7609R(config-router)#address-family vpnv4
NCU-7609R(config-router-af)#neighbor 211.79.58.2 activate
NCU-7609R(config-router-af)#neighbor 211.79.58.2 send-community extended
NCU-7609R(config-router-af)#exit-address-family
NCU-7609R(config-router)#address-family ipv4 vrf vrf-nsysu-ncu
NCU-7609R(config-router-af)#redistribute connected

NCU-7609R(config-router-af)#redistribute static
NCU-7609R(config-router-af)#no auto-summary
NCU-7609R(config-router-af)#no synchronization
NCU-7609R(config-router-af)#exit-address-family
NCU-7609R(config-router)#exit
NCU-7609R(config)#exit


4. 由中山大學的 NSYSU 的 Sender PC 上設定成 CE , interface dummy 為CE上所接的 211.73.67.0/26 之網路

[root@eeTWAREN root]# route
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
211.73.67.0 * 255.255.255.192 U 0 0 0 dummy0
140.117.19.0 * 255.255.255.0 U 0 0 0 eth2
192.168.120.0 * 255.255.255.0 U 0 0 0 eth1
192.168.40.0 * 255.255.255.0 U 0 0 0 eth0
140.0.0.0 140.117.19.254 255.0.0.0 UG 0 0 0 eth2
default 192.168.120.120 0.0.0.0 UG 0 0 0 eth1
[root@eeTWAREN root]#

 


5. 由中央大學的 NCU 的 Sender PC 上設定成 CE , interface dummy 為CE上所接的 211.73.67.64/26 之網路

[root@localhost root]# route
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
211.73.67.64 * 255.255.255.192 U 0 0 0 dummy0
192.168.34.0 * 255.255.255.0 U 0 0 0 eth1
169.254.0.0 * 255.255.0.0 U 0 0 0 eth1
127.0.0.0 * 255.0.0.0 U 0 0 0 lo
default 192.168.34.1 0.0.0.0 UG 0 0 0 eth1
[root@localhost root]#


6. 檢查中山大學的 VPN 設定是否成功

NSYSU-7609R#show ip route vrf vrf-nsysu-ncu
Codes: C - connected, S - static, I - IGRP, R - RIP, M - mobile, B - BGP
D - EIGRP, EX - EIGRP external, O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2, E - EGP
i - IS-IS, su - IS-IS summary, L1 - IS-IS level-1, L2 - IS-IS level-2
ia - IS-IS inter area, * - candidate default, U - per-user static route
o - ODR, P - periodic downloaded static route

Gateway of last resort is not set

C 192.168.120.0/24 is directly connected, GigabitEthernet9/12
211.73.67.0/26 is subnetted, 2 subnets
B 211.73.67.64 [200/0] via 211.79.51.2, 00:16:34
S 211.73.67.0 [1/0] via 192.168.120.1
B 192.168.34.0/24 [200/0] via 211.79.51.2, 13:45:49
NSYSU-7609R#


7. 檢查中央大學的 VPN 設定是否成功

NCU-7609R#show ip route vrf vrf-nsysu-ncu
Codes: C - connected, S - static, I - IGRP, R - RIP, M - mobile, B - BGP
D - EIGRP, EX - EIGRP external, O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2, E - EGP
i - IS-IS, su - IS-IS summary, L1 - IS-IS level-1, L2 - IS-IS level-2
ia - IS-IS inter area, * - candidate default, U - per-user static route
o - ODR, P - periodic downloaded static route

Gateway of last resort is not set

B 192.168.120.0/24 [200/0] via 211.79.58.2, 00:04:12
211.73.67.0/26 is subnetted, 2 subnets
S 211.73.67.64 [1/0] via 192.168.34.2
B 211.73.67.0 [200/0] via 211.79.58.2, 00:23:41
C 192.168.34.0/24 is directly connected, GigabitEthernet9/16
NCU-7609R#


8. 由中山大學的 NSYSU-7609 上 traceroute vrf 到中央大學的 PC 192.168.34.1

NSYSU-7609R#traceroute vrf vrf-nsysu-ncu 192.168.34.2

Type escape sequence to abort.
Tracing the route to 192.168.34.2

1 211.79.60.49 [MPLS: Labels 48/60 Exp 0] 4 msec *
211.79.60.57 [MPLS: Labels 48/60 Exp 0] 4 msec
2 211.79.59.185 [MPLS: Labels 19/60 Exp 0] 4 msec 8 msec 8 msec
3 192.168.34.2 4 msec * 4 msec
NSYSU-7609R#


9. 由中山大學的 Sender PC 上 ping 與 traceroute到中央大學的192.168.34.2 與211.73.67.65

[root@eeTWAREN root]# ping 192.168.34.2
PING 192.168.34.2 (192.168.34.2) from 192.168.120.1 : 56(84) bytes of data.
64 bytes from 192.168.34.2: icmp_seq=1 ttl=63 time=5.21 ms
64 bytes from 192.168.34.2: icmp_seq=2 ttl=63 time=5.16 ms
64 bytes from 192.168.34.2: icmp_seq=3 ttl=63 time=5.17 ms
64 bytes from 192.168.34.2: icmp_seq=4 ttl=63 time=5.16 ms

[root@eeTWAREN root]# traceroute 192.168.34.2
traceroute to 192.168.34.2 (192.168.34.2), 30 hops max, 38 byte packets
1 192.168.120.120 (192.168.120.120) 0.491 ms 0.238 ms 0.209 ms
2 211.79.60.57 (211.79.60.57) 5.784 ms 5.381 ms 5.365 ms
3 211.79.59.185 (211.79.59.185) 5.527 ms 5.397 ms 5.449 ms
4 192.168.34.2 (192.168.34.2) 5.199 ms 5.184 ms 5.178 ms
[root@eeTWAREN root]#

[root@eeTWAREN root]# ping 211.73.67.65
PING 211.73.67.65 (211.73.67.65) from 192.168.120.1 : 56(84) bytes of data.
64 bytes from 211.73.67.65: icmp_seq=1 ttl=63 time=5.28 ms
64 bytes from 211.73.67.65: icmp_seq=2 ttl=63 time=5.20 ms
64 bytes from 211.73.67.65: icmp_seq=3 ttl=63 time=5.20 ms
64 bytes from 211.73.67.65: icmp_seq=4 ttl=63 time=5.20 ms


10. 由中央大學的 NCU-7609 上 traceroute vrf 到中山大學的 PC 192.168.120.1與 211.73.67.1

NCU-7609R#traceroute vrf vrf-nsysu-ncu 192.168.120.1

Type escape sequence to abort.
Tracing the route to 192.168.120.1

1 211.79.59.169 [MPLS: Labels 42/58 Exp 0] 4 msec
211.79.59.205 [MPLS: Labels 42/58 Exp 0] 4 msec
211.79.59.201 [MPLS: Labels 42/58 Exp 0] 4 msec
2 211.79.59.186 [MPLS: Labels 17/58 Exp 0] 8 msec 4 msec 4 msec
3 192.168.120.1 8 msec 4 msec 4 msec
NCU-7609R#

[root@localhost root]# ping 211.73.67.1
PING 211.73.67.1 (211.73.67.1) 56(84) bytes of data.
64 bytes from 211.73.67.1: icmp_seq=1 ttl=254 time=5.30 ms
64 bytes from 211.73.67.1: icmp_seq=2 ttl=254 time=5.24 ms
64 bytes from 211.73.67.1: icmp_seq=3 ttl=254 time=5.23 ms
64 bytes from 211.73.67.1: icmp_seq=4 ttl=254 time=5.25 ms

--- 211.73.67.1 ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3025ms
rtt min/avg/max/mdev = 5.238/5.259/5.306/0.092 ms
[root@localhost root]#

 

備      註  此實驗是把 NSYSU-7609R與NCU-7609R當作PE, TN-12416R與HC-12416R當作P, 然後 在中山大學與中央大學內使用Linux Router當作CE,並以MPLS VPN的方式,讓中山大學的192.168.120.0可以與中央大學的192.168.34.0形成VPN.

然後可以在 PE上 (NSYSU-7609R與NCU-7609R) 利用 ip route vrf vrf-nsysu-ncu PE-to-CE_VPN-NETWORK PE-to-CE_VPN-NETMASK NEW-VPN 增加新的VPN,如此範例可以把中山大學內當作CE的Linux Router上新增一個 211.73.67.0 255.255.255.192然後可以與中央大學內當作CE的Linux Router上所新增的另外一個 211.73.67.64 255.255.255.192成為同一個VPN

意      見 對此次測試發表建議       觀看建議

日    期

 2004/08/13 (五)
工作進度  NSYSU 的 Sender 與 NCU 的 Receiver 形成第一個 VPN A
結      果  1. Topology 如下圖所示


2. 由中山大學的 NSYSU-7609 上設定成 PE

NSYSU-7609R#conf t
Configuring from terminal, memory, or network [terminal]?
Enter configuration commands, one per line. End with CNTL/Z.
NSYSU-7609R(config)#ip cef distributed
NSYSU-7609R(config)#ip vrf vrf-nsysu-ncu
NSYSU-7609R(config-vrf)#rd 813:813
NSYSU-7609R(config-vrf)#route-target both 813:813
NSYSU-7609R(config-vrf)#exit
NSYSU-7609R(config)#interface gigabitEthernet 9/12
NSYSU-7609R(config-if)#ip vrf forwarding vrf-nsysu-ncu
NSYSU-7609R(config-if)#ip address 192.168.120.120 255.255.255.0
NSYSU-7609R(config-if)#exit
NSYSU-7609R(config)#router bgp 7935
NSYSU-7609R(config-router)#no bgp default ipv4-unicast
NSYSU-7609R(config-router)#neighbor 211.79.51.2 remote-as 7539[註] 211.79.51.2 是對方PE(NCU-7609)PE的Loopback0之IP
NSYSU-7609R(config-router)#neighbor 211.79.51.2 update-source Loopback0
NSYSU-7609R(config-router)#address-family vpnv4
NSYSU-7609R(config-router-af)#neighbor 211.79.51.2 activate
NSYSU-7609R(config-router-af)#neighbor 211.79.51.2 send-community extended
NSYSU-7609R(config-router-af)#exit-address-family
NSYSU-7609R(config-router)#address-family ipv4 vrf vrf-nsysu-ncu
NSYSU-7609R(config-router-af)#redistribute connected
NSYSU-7609R(config-router-af)#no auto-summary
NSYSU-7609R(config-router-af)#no synchronization
NSYSU-7609R(config-router-af)#exit-address-family
NSYSU-7609R(config-router)#exit
NSYSU-7609R(config)#exit
NSYSU-7609R#


3. 由中央大學的 NCU-7609 上設定成 PE

NCU-7609R#conf
Configuring from terminal, memory, or network [terminal]?
Enter configuration commands, one per line. End with CNTL/Z.
NCU-7609R(config)#ip cef distributed
NCU-7609R(config)#ip vrf vrf-nsysu-ncu
NCU-7609R(config-vrf)#rd 813:813
NCU-7609R(config-vrf)#route-target both 813:813
NCU-7609R(config-vrf)#exit
NCU-7609R(config)#interface gigabitEthernet 9/16
NCU-7609R(config-if)#ip vrf forwarding vrf-nsysu-ncu
NCU-7609R(config-if)#ip address 192.168.34.1 255.255.255.0
NCU-7609R(config-if)#exit
NCU-7609R(config)#router bgp 7539
NCU-7609R(config-router)#no bgp default ipv4-unicast
NCU-7609R(config-router)#neighbor 211.79.58.2 remote-as 7539[註] 211.79.58.2 是對方PE(NSYSU-7609)PE的Loopback0之IP
NCU-7609R(config-router)#neighbor 211.79.58.2 update-source Loopback0
NCU-7609R(config-router)#address-family vpnv4
NCU-7609R(config-router-af)#neighbor 211.79.58.2 activate
NCU-7609R(config-router-af)#neighbor 211.79.58.2 send-community extended
NCU-7609R(config-router-af)#exit-address-family
NCU-7609R(config-router)#address-family ipv4 vrf vrf-nsysu-ncu
NCU-7609R(config-router-af)#redistribute connected
NCU-7609R(config-router-af)#no auto-summary
NCU-7609R(config-router-af)#no synchronization
NCU-7609R(config-router-af)#exit-address-family
NCU-7609R(config-router)#exit
NCU-7609R(config)#exit


4. 由中山大學的 NSYSU 的 Sender PC 上設定成 CE

[root@eeTWAREN root]# route
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
140.117.19.0 * 255.255.255.0 U 0 0 0 eth2
192.168.120.0 * 255.255.255.0 U 0 0 0 eth1
192.168.40.0 * 255.255.255.0 U 0 0 0 eth0
140.0.0.0 140.117.19.254 255.0.0.0 UG 0 0 0 eth2
default 192.168.120.120 0.0.0.0 UG 0 0 0 eth1
[root@eeTWAREN root]#

 


5. 由中央大學的 NSYSU 的 Sender PC 上設定成 CE

[root@localhost root]# route
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
192.168.34.0 * 255.255.255.0 U 0 0 0 eth1
169.254.0.0 * 255.255.0.0 U 0 0 0 eth1
127.0.0.0 * 255.0.0.0 U 0 0 0 lo
default 192.168.34.1 0.0.0.0 UG 0 0 0 eth1
[root@localhost root]#

 


6. 檢查中山大學的 VPN 設定是否成功

NSYSU-7609R#show ip route vrf vrf-nsysu-ncu
Codes: C - connected, S - static, I - IGRP, R - RIP, M - mobile, B - BGP
D - EIGRP, EX - EIGRP external, O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2, E - EGP
i - IS-IS, su - IS-IS summary, L1 - IS-IS level-1, L2 - IS-IS level-2
ia - IS-IS inter area, * - candidate default, U - per-user static route
o - ODR, P - periodic downloaded static route

Gateway of last resort is not set

C 192.168.120.0/24 is directly connected, GigabitEthernet9/12
211.73.67.0/26 is subnetted, 1 subnets
S 211.73.67.0 [1/0] via 192.168.120.1
B 192.168.34.0/24 [200/0] via 211.79.51.2, 00:28:26
NSYSU-7609R#


7. 檢查中央大學的 VPN 設定是否成功

NCU-7609R#show ip route vrf vrf-nsysu-ncu
Codes: C - connected, S - static, I - IGRP, R - RIP, M - mobile, B - BGP
D - EIGRP, EX - EIGRP external, O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2, E - EGP
i - IS-IS, su - IS-IS summary, L1 - IS-IS level-1, L2 - IS-IS level-2
ia - IS-IS inter area, * - candidate default, U - per-user static route
o - ODR, P - periodic downloaded static route

Gateway of last resort is not set

B 192.168.120.0/24 [200/0] via 211.79.58.2, 00:37:47
211.73.67.0/26 is subnetted, 1 subnets
S 211.73.67.64 [1/0] via 192.168.34.2
C 192.168.34.0/24 is directly connected, GigabitEthernet9/16
NCU-7609R#


8. 由中山大學的 NSYSU-7609 上 traceroute vrf 到中央大學的 PC 192.168.34.1

NSYSU-7609R#traceroute vrf vrf-nsysu-ncu 192.168.34.2

Type escape sequence to abort.
Tracing the route to 192.168.34.2

1 211.79.60.49 [MPLS: Labels 48/60 Exp 0] 4 msec *
211.79.60.57 [MPLS: Labels 48/60 Exp 0] 4 msec
2 211.79.59.185 [MPLS: Labels 19/60 Exp 0] 4 msec 8 msec 8 msec
3 192.168.34.2 4 msec * 4 msec
NSYSU-7609R#


9. 由中山大學的 Sender PC 上 ping 與 traceroute到中央大學的192.168.34.2

[root@eeTWAREN root]# ping 192.168.34.2
PING 192.168.34.2 (192.168.34.2) from 192.168.120.1 : 56(84) bytes of data.
64 bytes from 192.168.34.2: icmp_seq=1 ttl=63 time=5.21 ms
64 bytes from 192.168.34.2: icmp_seq=2 ttl=63 time=5.16 ms
64 bytes from 192.168.34.2: icmp_seq=3 ttl=63 time=5.17 ms
64 bytes from 192.168.34.2: icmp_seq=4 ttl=63 time=5.16 ms

[root@eeTWAREN root]# traceroute 192.168.34.2
traceroute to 192.168.34.2 (192.168.34.2), 30 hops max, 38 byte packets
1 192.168.120.120 (192.168.120.120) 0.491 ms 0.238 ms 0.209 ms
2 211.79.60.57 (211.79.60.57) 5.784 ms 5.381 ms 5.365 ms
3 211.79.59.185 (211.79.59.185) 5.527 ms 5.397 ms 5.449 ms
4 192.168.34.2 (192.168.34.2) 5.199 ms 5.184 ms 5.178 ms
[root@eeTWAREN root]#


10. 由中央大學的 NCU-7609 上 traceroute vrf 到中山大學的 PC 192.168.120.1

NCU-7609R#traceroute vrf vrf-nsysu-ncu 192.168.120.1

Type escape sequence to abort.
Tracing the route to 192.168.120.1

1 211.79.59.169 [MPLS: Labels 42/58 Exp 0] 4 msec
211.79.59.205 [MPLS: Labels 42/58 Exp 0] 4 msec
211.79.59.201 [MPLS: Labels 42/58 Exp 0] 4 msec
2 211.79.59.186 [MPLS: Labels 17/58 Exp 0] 8 msec 4 msec 4 msec
3 192.168.120.1 8 msec 4 msec 4 msec
NCU-7609R#

備      註  此實驗是把 NSYSU-7609R與NCU-7609R當作PE, TN-12416R與HC-12416R當作P, 然後 在中山大學與中央大學內使用Linux Router當作CE,並以MPLS VPN的方式,讓中山大學的192.168.120.0可以與中央大學的192.168.34.0形成VPN.
意      見 對此次測試發表建議       觀看建議

日    期

 2004/08/02 (一)
工作進度  MPLS VPN
結      果  1. 原本的Topology與設定變成MPLS VPN的Topology與設定 如下圖所示


2. 由台南的 TN-12416R上設定成 PE

TN-12416R#conf
TN-12416R(config)#ip cef distributed
TN-12416R(config)#interface GigabitEthernet 13/0
TN-12416R(config-if)#no ip vrf forwarding vrf_nsysu
TN-12416R(config-if)#ip address 192.168.111.2 255.255.255.0
TN-12416R(config-if)#no shutdown
TN-12416R(config-if)#exit
TN-12416R(config)#ip vrf vrf_nsysu
TN-12416R(config-vrf)#rd 728:1
TN-12416R(config-vrf)#route-target import 728:1000
TN-12416R(config-vrf)#route-target export 728:1000
TN-12416R(config-vrf)#exit
TN-12416R(config)#interface Loopback 101
TN-12416R(config-if)#ip vrf forwarding vrf_nsysu
TN-12416R(config-if)#ip address 192.168.111.1 255.255.255.0
TN-12416R(config-if)#no shutdown
TN-12416R(config-if)#exit
TN-12416R(config)#router bgp 7539
TN-12416R(config-router)#neighbor 211.79.59.2 remote-as 7539
TN-12416R(config-router)#neighbor 211.79.59.2 update-source loopback 0
TN-12416R(config-router)#address-family vpnv4
TN-12416R(config-router-af)#neighbor 211.79.59.2 activate
TN-12416R(config-router-af)#neighbor 211.79.59.2 send-community both
TN-12416R(config-router-af)#exit-address-family
TN-12416R(config-router)#address-family ipv4 vrf vrf_nsysu
TN-12416R(config-router-af)#redistribute connected
TN-12416R(config-router-af)#no auto-summary
TN-12416R(config-router-af)#no synchronization
TN-12416R(config-router-af)#exit-address-family
TN-12416R(config-router)#address-family ipv4 vrf vrf_nsysu
TN-12416R(config-router-af)#redistribute static
TN-12416R(config-router-af)#neighbor 211.79.58.2 remote-as 7539
TN-12416R(config-router-af)#neighbor 211.79.58.2 activate
TN-12416R(config-router-af)#exit
TN-12416R(config-router)#exit


3. 由台北的 TP-12416R上設定成 PE

TP-12416R#conf
TP-12416R(config)#ip cef distributed
TP-12416R(config)#ip vrf vrf_nsysu
TP-12416R(config-vrf)#rd 728:1
TP-12416R(config-vrf)#route-target export 728:1000
TP-12416R(config-vrf)#route-target import 728:1000
TP-12416R(config-vrf)#exit
TP-12416R(config)#interface Loopback 101
TP-12416R(config-if)#ip address 192.168.112.1 255.255.255.0
TP-12416R(config-if)#ip vrf forwarding vrf_nsysu
TP-12416R(config-if)#ip address 192.168.112.1 255.255.255.0
TP-12416R(config-if)#no shutdown
TP-12416R(config-if)#exit
TP-12416R(config)#router bgp 7539
TP-12416R(config-router)#neighbor 211.79.60.2 remote-as 7539
TP-12416R(config-router)#neighbor 211.79.60.2 update-source loopback 0
TP-12416R(config-router)#address-family vpnv4
TP-12416R(config-router-af)#neighbor 211.79.60.2 activate
TP-12416R(config-router-af)#neighbor 211.79.60.2 send-community both
TP-12416R(config-router-af)#exit
TP-12416R(config-router)#address-family ipv4 vrf vrf_nsysu
TP-12416R(config-router-af)#redistribute connected
TP-12416R(config-router-af)#no auto-summary
TP-12416R(config-router-af)#no synchronization
TP-12416R(config-router-af)#exit-address-family

TP-12416R(config)#interface GigabitEthernet 0/0
TP-12416R(config-if)#ip address 192.168.112.2 255.255.255.0
TP-12416R(config-if)#no shutdown
TP-12416R(config-if)#exit
TP-12416R(config)#exit


4. 由台灣大學的 NTU-7609R上設定成 CE

NTU-7609R#conf
NTU-7609R(config)#interface TenGigabitEthernet3/1
NTU-7609R(config-if)#ip address 192.168.112.1 255.255.255.0
NTU-7609R(config-if)#no shutdown
NTU-7609R(config-if)#exit
NTU-7609R(config)#ip route 192.168.111.0 255.255.255.0 TenGigabitEthernet 3/1
NTU-7609R(config)#ip route 192.168.112.0 255.255.255.0 TenGigabitEthernet 3/1


5. 由中山大學的 NSYSU-7609R上設定成 CE

NSYSU-7609R#conf

NSYSU-7609R(config)#interface GigabitEthernet 9/3
NSYSU-7609R(config-if)#ip address 192.168.111.1 255.255.255.0
NSYSU-7609R(config-if)#no shutdown

NSYSU-7609R(config-if)#exit
NSYSU-7609R(config)#ip route 192.168.111.0 255.255.255.0 GigabitEthernet 9/3
NSYSU-7609R(config)#ip route 192.168.112.0 255.255.255.0 GigabitEthernet 9/3


6. 由台南的 TN-12416R上顯示設定成功的MPLS VPN(vrf_nsysu)

TN-12416R#show ip route vrf vrf_nsysu

Routing Table: vrf_nsysu
Codes: C - connected, S - static, I - IGRP, R - RIP, M - mobile, B - BGP
D - EIGRP, EX - EIGRP external, O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2, E - EGP
i - IS-IS, su - IS-IS summary, L1 - IS-IS level-1, L2 - IS-IS level-2
ia - IS-IS inter area, * - candidate default, U - per-user static route
o - ODR

Gateway of last resort is not set

C 192.168.111.0/24 is directly connected, Loopback101
B 192.168.112.0/24 [200/0] via 211.79.59.2, 1d00h
TN-12416R#traceroute vrf vrf_nsysu 192.168.112.1

Type escape sequence to abort.
Tracing the route to 192.168.112.1

1 192.168.112.1 4 msec 4 msec *
TN-12416R#show ip route vrf vrf_nsysu 192.168.112.1
Routing entry for 192.168.112.0/24
Known via "bgp 7539", distance 200, metric 0, type internal
Last update from 211.79.59.2 1d00h ago
Routing Descriptor Blocks:
* 211.79.59.2 (Default-IP-Routing-Table), from 211.79.59.2, 1d00h ago
Route metric is 0, traffic share count is 1
AS Hops 0, BGP network version 0

TN-12416R#


7. 由台北的 TP-12416R上顯示設定成功的MPLS VPN(vrf_nsysu)

TP-12416R#show ip route vrf vrf_nsysu

Routing Table: vrf_nsysu
Codes: C - connected, S - static, I - IGRP, R - RIP, M - mobile, B - BGP
D - EIGRP, EX - EIGRP external, O - OSPF, IA - OSPF inter area
N1 - OSPF NSSA external type 1, N2 - OSPF NSSA external type 2
E1 - OSPF external type 1, E2 - OSPF external type 2, E - EGP
i - IS-IS, su - IS-IS summary, L1 - IS-IS level-1, L2 - IS-IS level-2
ia - IS-IS inter area, * - candidate default, U - per-user static route
o - ODR

Gateway of last resort is not set

B 192.168.111.0/24 [200/0] via 211.79.60.2, 06:13:13
C 192.168.112.0/24 is directly connected, Loopback101
TP-12416R#traceroute vrf vrf_nsysu 192.168.111.1

Type escape sequence to abort.
Tracing the route to 192.168.111.1

1 192.168.111.1 4 msec * 4 msec
TP-12416R#show ip route vrf vrf_nsysu 192.168.111.1
Routing entry for 192.168.111.0/24
Known via "bgp 7539", distance 200, metric 0, type internal
Last update from 211.79.60.2 06:13:47 ago
Routing Descriptor Blocks:
* 211.79.60.2 (Default-IP-Routing-Table), from 211.79.60.2, 06:13:47 ago
Route metric is 0, traffic share count is 1
AS Hops 0, BGP network version 0

TP-12416R#


8. 由中山大學的 NSYSU-7609R上 ping 中研院的192.168.112.1

NSYSU-7609R#ping 192.168.112.1

Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 192.168.112.1, timeout is 2 seconds:
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 4/5/8 ms
NSYSU-7609R#


9. 由台灣大學的 NTU-7609R上 ping 中山大學的192.168.111.1

NTU-7609R#ping 192.168.111.1

Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 192.168.111.1, timeout is 2 seconds:
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 4/5/8 ms
NTU-7609R#

 

備      註  此實驗是把 TP-12416R與TN-12416R當作PE, NTU-7609R與NSYSU-7609R當作CE, 然後以MPLS VPN的方式,讓NSYSU-7609R的192.168.111.0可以與NTU-7609R的192.168.112.0形成VPN.
意      見 對此次測試發表建議       觀看建議

 

日    期

 2004/04/02 (五)  ,  2004/04/03 (六)  ,   2004/04/04 (日)
工作進度  量測數據
結     果

A. Round Trip Time

      由中山建立 LSP Tunnel 301 經由台南最後到達台北,再由中山建立 LSP Tunnel 300 經由台南、新竹到達台中,由台中建立 LSP Tunnel 302經由新竹到達台北,並由新竹建立 backup path Tunnel 303 經由台南到達台北。其中 Tunnel 300 是為了把 Traffic 導入到台中,以便可以由台中發送 Traffic 到台北間的 fast reroute 所花費的時間而Packet回來的路徑均為台北經由台南到達中山。其 Topology 如下圖所示。

  

我們發現由中山經由 Tunnel 301 到達台北的 Round Trip Time 為 5ms,而由中山經由 Tunnel 300 、Tunnel 302 到達台北的 Round Trip Time 為 8ms,若此時 Tunnel 302 接台北的 interface shutdown 而發生 fast reroute 到 Tunnel 303 ,則其Round Trip Time 為 11 ms。


B. fast reroute

 fast-reroute測試的 topology 如下
 


 1. 首先由NSYSU-7609R經台南、新竹到台中建立LSP tunnel 300,接著建立LSP tunnel 301 由台中經新竹HC-12416R 到台北,再來由新竹建立 backup path LSP tunnel 302 經由台南到達台北.

NSYSU-7609R(config)#ip explicit-path identifier 300 
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.57
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.59.185
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.59.214
NSYSU-7609R(cfg-ip-expl-path)#exit

TC-12416R(config)#ip explicit-path identifier 221 
TC-12416R(cfg-ip-expl-path)#next-address 211.79.59.213
TC-12416R(cfg-ip-expl-path)#next-address 211.79.60.182
TC-12416R(cfg-ip-expl-path)#exit 

HC-12416R(config)#ip explicit-path identifier 223 
HC-12416R(cfg-ip-expl-path)#next-address 211.79.59.186
HC-12416R(cfg-ip-expl-path)#next-address 211.79.60.54
HC-12416R(cfg-ip-expl-path)#exit 

NSYSU-7609R(config)#interface tunnel 300
NSYSU-7609R(config-if)#ip unnumbered loopback 0
NSYSU-7609R(config-if)#tunnel destination 211.79.60.130
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority1 1
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 100000
NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 300
NSYSU-7609R(config-if)#exit

TC-12416R(config)#interface tunnel 301
TC-12416R(config-if)#ip unnumbered loopback 0
TC-12416R(config-if)#tunnel destination 211.79.59.2
TC-12416R(config-if)#tunnel mode mpls traffic-eng 
TC-12416R(config-if)#tunnel mpls traffic-eng priority 1 1
TC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 100000
TC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 221
TC-12416R(config-if)#tunnel mpls traffic-eng fast-reroute
TC-12416R(config-if)#exit

HC-12416R(config)#interface tunnel 302
HC-12416R(config-if)#ip unnumbered loopback 0
HC-12416R(config-if)#tunnel destination 211.79.59.2
HC-12416R(config-if)#tunnel mode mpls traffic-eng 
HC-12416R(config-if)#tunnel mpls traffic-eng priority 1 1
HC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 100000
HC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 223
HC-12416R(config-if)#exit

HC-12416R(config)#interface POS 10/0
HC-12416R(config-if)#mpls traffic-eng tunnels
HC-12416R(config-if)#mpls traffic-eng backup-path tunnel 302
HC-12416R(config-if)#pos ais-shut 
HC-12416R(config-if)#pos report lrdi
HC-12416R(config-if)#ip rsvp bandwidth 900000
HC-12416R(config-if)#exit
 

2. 為了讓 traffic 可以經由 LSP tunnel 301 傳送 , 所以我們在NSYSU的 NSYSU-7609R 把目的地為192.168.111.21 加入 static route ,讓Traffic先經Tunnel 300到達台中

NSYSU-7609R(config)#ip route 192.168.111.21 255.255.255.255 tunnel 300


接著在台中的 TC-12416R 把目的地為192.168.111.21 加入 static route .讓 traffic 可以經由 LSP tunnel 301 傳送

TC-12416R(config)#ip route 192.168.111.21  255.255.255.255 tunnel 301

3.接著到TP-12416R把台北連接新竹的POS 9/0介面關掉,使LSP Tunnel 301斷線,當新竹HC-124016R的POS 10/0得到現露出問題的訊息後,會將原本經由POS 10/0出去的Traffic改由LSP Tunnel 302傳送

我們針對 sending rate 分別為 100 Mbit/s 、200 MBit/s與 300MBit/s 的 Traffic 由中山發送到台北,量測時間為 120 秒,共發出 2000000個 packet,每個 packet 為 1000 Bytes,其所量測到的數據如下表所示

 Sending rate 100 MBit/s 100 MBit/s 100 MBit/s 100 MBit/s
Keep alive time 1 5 10 15
發送端發出的 packet 數量 2000000 2000000 2000000 2000000
接收端收到的 packet 數量 1999968 1862326 1677519 1498003
丟掉的 packet 數量 32 137674 322481 501997
Throughput (量測120秒取平均) 99998274 93104435 84931615 74895553
斷線恢復時間 0 10 31 41

 
 Sending rate 200 MBit/s 200 MBit/s 200 MBit/s 200 MBit/s
Keep alive time 1 5 10 15
發送端發出的 packet 數量 3000000 3000000 3000000 3000000
接收端收到的 packet 數量 2999930 2565905 2220863 1828917
丟掉的 packet 數量 70 434095 779137 1171083
Throughput (量測120秒取平均) 199998412 171060412 148057612 121879878
斷線恢復時間 0 18 31 41

 
 Sending rate 300 MBit/s 300 MBit/s 300 MBit/s 300 MBit/s
Keep alive time 1 5 10 15
發送端發出的 packet 數量 4500000 4500000 4500000 4500000
接收端收到的 packet 數量 4491667 4092203 3513847 2894526
丟掉的 packet 數量 8333 407797 986153 1605474
Throughput (量測120秒取平均) 299444545 272813585 234256519 192968478
斷線恢復時間 0 11 27 41

我們把數據用圖來表示,可以發現到 200Mbit/s 在 Keep alive time 為 5 秒時,其 packet drop 的數量竟然會比 300 Mbit/s 的 traffic 還高,不過此時若看一下圖二的斷線恢復時間可以發現 200Mbit/s的 Traffic 在該次斷線恢復所花費的時間,比 300 Mbit/s 的 Traffic 高出許多,所以斷線的時間會根據 Keep alive的設定而有所不同 ,即使是相同的 keep alive 設定,其偵測到斷線的時間也不見得一樣

圖(一) Packet drop 的數量

 

圖(二) 斷線恢復時間

 

圖(三) 實驗120秒的平均 Throughput


接下來我們我們針對不同的 packet size (1000 Byte, Auto length, 64 byte) , sending rate 均為為 100 Mbit/s 而為了使量測的時間均接近 120 秒,所以由 packet generator 所預估的傳送時間來調整要發送的封包數

Packet size 1000 Byte 1000 Byte 1000 Byte
Keep alive time 5 10 15
發送端發出的 packet 數量 2000000 2000000 2000000
接收端收到的 packet 數量 1862326 1677519 1498003
丟掉的 packet 數量 137674 322481 501997
Throughput(平均) 93104435 84931615 74895553
斷線恢復時間 10 31 41

 

Packet size Auto length Auto length Auto length
Keep alive time 5 10 15
發送端發出的 packet 數量 20000000 20000000 20000000
接收端收到的 packet 數量 17629857 1677519 1498003
丟掉的 packet 數量 2370143 6783407 9444156
Throughput(平均) 86793261 65698162 51967352
斷線恢復時間 12 35 48

 

Packet size 64 Byte 64 Byte 64 Byte
Keep alive time 5 10 15
發送端發出的 packet 數量 20000000 20000000 20000000
接收端收到的 packet 數量 17705277 13654833 9267958
丟掉的 packet 數量 2294723 6345167 10732042
Throughput(平均) 88873669 69220617 57171100
斷線恢復時間 11 34 55

我們把數據用圖來表示,可以發現 Packet Generator packet size 使用 Auto-Length 所產生的 traffic 與使用64 Byte 的 traffic 大致相同,而在相同的速率下, packet size 較小的 packet drop 的數量會比 packet size 較大的 traffic 還高,斷線恢復時間三者頗為接近,至於 Throughput 則是 Keep alive 設定越小其斷線的時間當然越短,packet drop 的數量就比較少,當然平均的 throughput 會比較高

 

 


C. Preemption測試的 topology 如下

1. 首先建立setup priority與holding priority皆為7的 LSP tunnel 300保留頻寬200M ,接著建立 setup priority與holding priority皆為4的LSP tunnel 301保留頻寬300M,在此皆不指定路徑,但routing protocol會先找shortest path,也就是由 NSYSU 7609R 經台南到台北

NSYSU-7609R(config)#interface tunnel 300
NSYSU-7609R(config-if)#ip unnumbered loopback 0
NSYSU-7609R(config-if)#tunnel destination 211.79.59.2
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 7 7
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 200000
NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 2 dynamic
NSYSU-7609R(config-if)#exit


NSYSU-7609R(config)#interface tunnel 301
NSYSU-7609R(config-if)#ip unnumbered loopback 0
NSYSU-7609R(config-if)#tunnel destination 211.79.59.2
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 4 4
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 300000
NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 2 dynamic
NSYSU-7609R(config-if)#exit

 


2. 最後建立setup priority與holding priority皆為1的 LSP tunnel 302,指定路徑為由 NSYSU-7609R 經台南到台北,由於台南與台北之間的頻寬設為550Mbps,不足以滿足LSP tunnel 302 ,所以會搶奪優先權較低的LSP tunnel 300、301的頻寬來建立LSP,而在台南到新竹的頻寬又只剩400Mbps,所以最後LSP Tunnel 301會換路徑,而LSP Tunnel 300因為pariority比301低,故會因沒有資源而斷線

NSYSU-7609R(config)#ip explicit-path identifier 16 
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.53
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.53
NSYSU-7609R(cfg-ip-expl-path)#exit

NSYSU-7609R(config)#interface tunnel 302
NSYSU-7609R(config-if)#ip unnumbered loopback 0
NSYSU-7609R(config-if)#tunnel destination 211.79.59.2
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority1 1
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 500000
NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 16
NSYSU-7609R(config-if)#exit

 

因為低優先權的 LSP Tunnel 會因為被搶奪而中斷而每次實驗時搶奪的時間點皆不相同(手動下指令來讓高優先權的 LSP Tunnel 搶奪中低優先權 LSP Tunnel的資源 )所以量測所得到的低優先權 Traffic 的數據比較沒有意義,而高優先權的 Traffic 是搶奪別人的,所以不會有 packet drop 的情形出現,因此僅列出中優先權的 Traffic 數據,如下表所示

Packet size 1000 Byte 1000 Byte 1000 Byte
Sending rate (Bit/s) 100000000 200000000 300000000
發送端發出的 packet 數量 2000000 4000000 6000000
丟掉的 packet 數量 6 673715 6165
斷線恢復時間 0 27 0

 

Packet size Auto Length Auto Length Auto Length
Sending rate (Bit/s) 100000000 200000000 300000000
發送端發出的 packet 數量 20000000 40000000 60000000
丟掉的 packet 數量 49028 11376638 12683173
斷線恢復時間 0 27 21

 

Packet size 64 Byte 64 Byte 64 Byte
Sending rate (Bit/s) 100000000 200000000 300000000
發送端發出的 packet 數量 2000000 4000000 6000000
丟掉的 packet 數量 49085 50150 15101068
斷線恢復時間 0 0 23

我們把數據用圖來表示,可以發現 Preemption 的斷線恢復時間是沒規則性的,有時它會迅速的找到新路徑並在1秒內就完成切換動作,但有時卻會花費數十秒時間尋找新路徑,因此 Packet drop 的數量會因斷線恢復所花費的時間不同而有差異

 


 D. Load sharing

1. 由中山大學建立兩條 LSP tunnel 到台北 , 第一條 LSP 由中山 NSYSU-7609R 建立經由國網台南 TN-12416R 再到達台北 , 第二條 LSP 由中山 NSYSU-7609R 建立經由國網台南 TN-12416R , 新竹 HC-12416R 到達台北 , 整個 topology 如下圖所示

 

NSYSU-7609R(config)#ip explicit-path identifier 19 
NSYSU-7609R(cfg-ip-expl-path)#
next-address 211.79.60.57
NSYSU-7609R(cfg-ip-expl-path)#
next-address 211.79.60.54
NSYSU-7609R(cfg-ip-expl-path)#
exit

NSYSU-7609R(config)#ip explicit-path identifier 27
NSYSU-7609R(cfg-ip-expl-path)#
next-address 211.79.60.57
NSYSU-7609R(cfg-ip-expl-path)#
next-address 211.79.59.185
NSYSU-7609R(cfg-ip-expl-path)#
next-address 211.79.59.182
NSYSU-7609R(cfg-ip-expl-path)#
exit 

NSYSU-7609R(config)#interface tunnel 271 
NSYSU-7609R(config-if)#
ip unnumbered loopback 0 
NSYSU-7609R(config-if)#
tunnel destination 211.79.59.2 
NSYSU-7609R(config-if)#
tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng priority 0 0 
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng bandwidth 100000 
NSYSU-7609R(config-if)#
tunnel mpls  traffic-eng path-option 1 explicit identifier 19
NSYSU-7609R(config-if)#
exit 

NSYSU-7609R(config)#interface tunnel 272 
NSYSU-7609R(config-if)#
ip unnumbered loopback 0 
NSYSU-7609R(config-if)#
tunnel destination 211.79.59.2 
NSYSU-7609R(config-if)#
tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng priority 0 0 
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng bandwidth 100000 
NSYSU-7609R(config-if)#
tunnel mpls  traffic-eng path-option 1 explicit identifier 27
NSYSU-7609R(config-if)#
exit 

 

2.設定 load-sharing 於 tunnel 271 與 tunnel 272 上 , 並把 192.168.111.0 的子網路 static route 到這兩個 tunnel 上

NSYSU-7609R(config)#ip cef load-sharing algorithm tunnel 271

NSYSU-7609R(config)#ip cef load-sharing algorithm tunnel 272

NSYSU-7609R(config)#ip route 192.168.111.0 255.255.255.0 tunnel 271
NSYSU-7609R(config)#
ip route 192.168.111.0 255.255.255.0 tunnel 272 

NSYSU-7609R#show ip cef 192.168.111.0
192.168.111.0/24, version 4704, epoch 0, attached
0 packets, 0 bytes
tag information set, unshareable
local tag: 41
via Tunnel271, 0 dependencies
traffic share 1
valid adjacency
tag rewrite with Tu271, point2point, tags imposed: {52}
via Tunnel272, 0 dependencies
traffic share 1
valid adjacency
tag rewrite with Tu272, point2point, tags imposed: {55}
0 packets, 0 bytes switched through the prefix
tmstats: external 0 packets, 0 bytes
internal 0 packets, 0 bytes

3. 我們由先前的 load sharing 測試可以知道 , load sharing 的作法是根據 hash function 來分配到相同子網路的 traffic . 我們測試了三組不同的 source-destination pair 來做 load-sharing .

  (1)   192.168.60.51 --- >  192.168.111.21

         192.168.50.53 --- >  192.168.111.21

  (2)   192.168.50.52 --- >  192.168.111.21

         192.168.60.51 --- >  192.168.111.21

  (3)   192.168.50.53 --- >  192.168.111.21

         192.168.60.53 --- >  192.168.111.21

   經由測試我們可以發現 , 

第一組資料會分別走不同的 LSP tunnel , 其中 192.168.60.51 到 192.168.111.21的 Traffic 會走 LSP tunnel 422 , 而 192.168.50.53 到 192.168.111.21的 Traffic 會走 LSP tunnel 421.

第二組資料會走相同的的 LSP tunnel 422 , 而第三組資料會走相同的的 LSP tunnel 421 , 所以 CISCO 的 load sharing 確實可以 work , 但是因為使用 hash function 來分配 traffic , 所以要在大量的不同 source-destination pair 下效果才會明顯 .

 第一組資料的測試
NSYSU-7609R#show mls cef exact-route 192.168.60.51 192.168.111.21

Interface: Gi9/3, Next Hop: 224.0.0.150, Vlan: 1018, Destination Mac: 000d.66ec.0500


NSYSU-7609R#show mls cef exact-route 192.168.50.53 192.168.111.21

Interface: Gi9/3, Next Hop: 224.0.0.190, Vlan: 1018, Destination Mac: 000d.66ec.0500

傳送前
NSYSU-7609R#show ip cef 192.168.111.0
192.168.111.0/24, version 9538, epoch 0, attached
0 packets, 0 bytes
tag information set, unshareable
local tag: 26
via Tunnel421, 0 dependencies
traffic share 1
valid adjacency
tag rewrite with Tu421, point2point, tags imposed: {24}
via Tunnel422, 0 dependencies
traffic share 1
valid adjacency
tag rewrite with Tu422, point2point, tags imposed: {54}
0 packets, 0 bytes switched through the prefix
tmstats: external 0 packets, 0 bytes
internal 0 packets, 0 bytes


NSYSU-7609R#show interfaces tunnel 421
Tunnel421 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
0 packets output, 0 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

傳送後


NSYSU-7609R#show interfaces tunnel 422
Tunnel422 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
0 packets output, 0 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

NSYSU-7609R#show interfaces tunnel 421
Tunnel421 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 65/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 46769000 bits/sec, 5851 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
2000000 packets output, 2000000000 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

NSYSU-7609R#show interfaces tunnel 422
Tunnel422 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 123/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 45479000 bits/sec, 5687 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
2000000 packets output, 2000000000 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out


 第二組資料的測試
NSYSU-7609R#show mls cef exact-route 192.168.50.52 192.168.111.21

Interface: Gi9/3, Next Hop: 224.0.0.150, Vlan: 1018, Destination Mac: 000d.66ec.0500


NSYSU-7609R#show mls cef exact-route 192.168.60.51 192.168.111.21

Interface: Gi9/3, Next Hop: 224.0.0.150, Vlan: 1018, Destination Mac: 000d.66ec.0500

傳送前


NSYSU-7609R#show interfaces tunnel 421
Tunnel421 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 108/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 1838000 bits/sec, 203 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
2000000 packets output, 2000000000 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#show interfaces tunnel 422
Tunnel422 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 184/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 1669000 bits/sec, 185 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
2000000 packets output, 2000000000 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

傳送後

NSYSU-7609R#show interfaces tunnel 421
Tunnel421 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 83/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 274000 bits/sec, 15 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
2000000 packets output, 2000000000 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#show interfaces tunnel 422
Tunnel422 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 67/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 115365000 bits/sec, 14423 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
6000000 packets output, 6000000000 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out



 第三組資料的測試
NSYSU-7609R#show mls cef exact-route 192.168.50.53 192.168.111.21

Interface: Gi9/3, Next Hop: 224.0.0.190, Vlan: 1018, Destination Mac: 000d.66ec.0500

NSYSU-7609R#show mls cef exact-route 192.168.60.53 192.168.111.21

Interface: Gi9/3, Next Hop: 224.0.0.190, Vlan: 1018, Destination Mac: 000d.66ec.0500


傳送前

NSYSU-7609R#show interfaces tunnel 421
Tunnel421 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 4/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 217000 bits/sec, 9 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
2000000 packets output, 2000000000 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#show interfaces tunnel 422
Tunnel422 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 127/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 88198000 bits/sec, 11021 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
6000000 packets output, 6000000000 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

傳送後


NSYSU-7609R#show interfaces tunnel 421
Tunnel421 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 216/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 73058000 bits/sec, 9130 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
5999999 packets output, 5999999000 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#show interfaces tunnel 422
Tunnel422 is up, line protocol is up
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec,
reliability 255/255, txload 241/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 9604000 bits/sec, 1178 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
6000000 packets output, 6000000000 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out


 E. Auto-Bandwidth

 測試的 topology 如下圖所示

1. 首先我們先從中山 NSYSU-7609R 建立 LSP tunnel 311 到台北 , 並設定 auto-bandwidth 最大值為 200Mbps , 最小值為 100Mbps , 調整的時間間隔為可設定的最小值 300 秒 , 頻寬的取樣週期為可設定的最小值 30 秒 , 並把目的地為 192.168.111.21 的 packet binding 到 tunnel 311 .

NSYSU-7609R(config)#interface tunnel 311
NSYSU-7609R(config-if)#
ip unnumbered loopback 0
NSYSU-7609R(config-if)#
tunnel destination 211.79.59.2
NSYSU-7609R(config-if)#
tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng priority 0 0
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng bandwidth 100000 
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng path-option 1 dynamic 
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng auto-bw max-bw 200000 min-bw 100000
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng auto-bw frequency 300
NSYSU-7609R(config-if)#
load-interval 30
NSYSU-7609R(config-if)#
exit
NSYSU-7609R(config)#
ip route 192.168.111.21 255.255.255.255 tunnel 311
NSYSU-7609R(config)#
^Z


 2. 我們由中山大學的 packet generator 送出 traffic , 剛開始的速率為 150 Mbps , 經過 214 秒後把速率降為 120M bps , 在 521 秒時把速率提升到 160 Mbps , 在 826 秒時再提升速率到 190 Mbps


 3.  剛開始 traffic 的速率為 150 Mbps 然後在中山 NSYSU-7609R 觀察 tunnel 311 , 發現此時的取樣頻寬最大值為 149993

NSYSU-7609R# show mpls traffic-eng tunnels tunnel 311

Name: NSYSU-7609R_t311 (Tunnel311) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 2, type dynamic (Basis for Setup, path weight 20)

Config Parameters:
Bandwidth: 100000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 0 bw-based
auto-bw: (300/46) 149993 Bandwidth Requested: 0


 4. 等待時間超過調整時間 300 秒間隔後 , 我們可以發現 Bandwidth Requested 已經變成 119994, 表示此時的 Auto-bandwidth adjustment 已經開始作用 . 


NSYSU-7609R# show mpls traffic-eng tunnels tunnel 311

Name: NSYSU-7609R_t311 (Tunnel311) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 2, type dynamic (Basis for Setup, path weight 20)
path option 2, delayed clean in progress
Change in required resources detected: reroute pending
Currently Signalled Parameters:
Bandwidth: 0 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFF
FF
Metric Type: TE (default)

Config Parameters:
Bandwidth: 100000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 119994 bw-based
auto-bw: (300/299) 0 Bandwidth Requested: 119994

InLabel : -
OutLabel : GigabitEthernet9/3, 49
RSVP Signalling Info:
Src 211.79.58.2, Dst 211.79.59.2, Tun_Id 311, Tun_Instance 10
RSVP Path Info:
My Address: 211.79.60.58
Explicit Route: 211.79.60.57 211.79.60.54 211.79.59.2
Record Route: NONE
Tspec: ave rate=119994 kbits, burst=1000 bytes, peak rate=119994 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=119994 kbits, burst=1000 bytes, peak rate=119994 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.54 211.79.59.2
History:
Tunnel:
Time since created: 1 hours, 14 minutes
Time since path change: 2 seconds
Current LSP:
Uptime: 2 seconds
Selection: reoptimation
Prior LSP:
ID: path option 2 [9]
Removal Trigger: configuration changed


  5. 等待時間超過調整時間 300 秒間隔後 , 我們可以發現 Bandwidth Requested 已經變成 157121

NSYSU-7609R# show mpls traffic-eng tunnels tunnel 311

Name: NSYSU-7609R_t311 (Tunnel311) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 2, type dynamic (Basis for Setup, path weight 20)
path option 2, delayed clean in progress
Change in required resources detected: reroute pending
Currently Signalled Parameters:
Bandwidth: 119994 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFF
FF
Metric Type: TE (default)

Config Parameters:
Bandwidth: 100000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 157121 bw-based
auto-bw: (300/296) 0 Bandwidth Requested: 157121

InLabel : -
OutLabel : GigabitEthernet9/3, 23
RSVP Signalling Info:
Src 211.79.58.2, Dst 211.79.59.2, Tun_Id 311, Tun_Instance 11
RSVP Path Info:
My Address: 211.79.60.58
Explicit Route: 211.79.60.57 211.79.60.54 211.79.59.2
Record Route: NONE
Tspec: ave rate=157120 kbits, burst=1000 bytes, peak rate=157120 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=157120 kbits, burst=1000 bytes, peak rate=157120 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.54 211.79.59.2
History:
Tunnel:
Time since created: 1 hours, 19 minutes
Time since path change: 5 minutes, 5 seconds
Current LSP:
Uptime: 5 seconds
Selection: reoptimation
Prior LSP:
ID: path option 2 [10]
Removal Trigger: configuration changed


  6. 再等待時間超過調整時間 300 秒間隔後 , 我們可以發現 Bandwidth Requested 已經變成 186872

NSYSU-7609R# show mpls traffic-eng tunnels tunnel 311

Name: NSYSU-7609R_t311 (Tunnel311) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 2, type dynamic (Basis for Setup, path weight 20)
path option 2, delayed clean in progress
Change in required resources detected: reroute pending
Currently Signalled Parameters:
Bandwidth: 157121 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFF
FF
Metric Type: TE (default)

Config Parameters:
Bandwidth: 100000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 186872 bw-based
auto-bw: (300/299) 0 Bandwidth Requested: 186872

InLabel : -
OutLabel : GigabitEthernet9/3, 49
RSVP Signalling Info:
Src 211.79.58.2, Dst 211.79.59.2, Tun_Id 311, Tun_Instance 12
RSVP Path Info:
My Address: 211.79.60.58
Explicit Route: 211.79.60.57 211.79.60.54 211.79.59.2
Record Route: NONE
Tspec: ave rate=186872 kbits, burst=1000 bytes, peak rate=186872 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=186872 kbits, burst=1000 bytes, peak rate=186872 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.54 211.79.59.2
History:
Tunnel:
Time since created: 1 hours, 24 minutes
Time since path change: 10 minutes, 3 seconds
Current LSP:
Uptime: 3 seconds
Selection: reoptimation
Prior LSP:
ID: path option 2 [11]
Removal Trigger: configuration changed


  7.  再 等待時間超過調整時間 300 秒間隔後 , 我們可以發現 Bandwidth Requested 已經變成 190042

NSYSU-7609R# show mpls traffic-eng tunnels tunnel 311

Name: NSYSU-7609R_t311 (Tunnel311) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 2, type dynamic (Basis for Setup, path weight 20)
path option 2, delayed clean in progress
Change in required resources detected: reroute pending
Currently Signalled Parameters:
Bandwidth: 186872 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFF
FF
Metric Type: TE (default)

Config Parameters:
Bandwidth: 100000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 190042 bw-based
auto-bw: (300/297) 0 Bandwidth Requested: 190042

InLabel : -
OutLabel : GigabitEthernet9/3, 23
RSVP Signalling Info:
Src 211.79.58.2, Dst 211.79.59.2, Tun_Id 311, Tun_Instance 13
RSVP Path Info:
My Address: 211.79.60.58
Explicit Route: 211.79.60.57 211.79.60.54 211.79.59.2
Record Route: NONE
Tspec: ave rate=190042 kbits, burst=1000 bytes, peak rate=190042 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=190042 kbits, burst=1000 bytes, peak rate=190042 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.54 211.79.59.2
History:
Tunnel:
Time since created: 1 hours, 29 minutes
Time since path change: 15 minutes, 6 seconds
Current LSP:
Uptime: 5 seconds
Selection: reoptimation
Prior LSP:
ID: path option 2 [12]
Removal Trigger: configuration changed

 Auto-bandwidth 是可以 work 的 , 只是說明文件太簡略 , 以致於我們無法得知它運作的詳細過程.

 接著我們把剛剛所走的 LSP Tunnel , 增加 background traffic , 讓流量超過實際頻寬 , 此時因為 signaling 的封包很容易因為擁擠而被丟棄 , 導致 LSP tunnel 會一下子 down 一下子 up , 使得 timer 還沒 timeout 之前 , LSP tunnel 的 link state 就會變成 down 讓 Auto-bandwidth 無法正常 work .


NSYSU-7609R# show mpls traffic-eng tunnels tunnel 311

Name: NSYSU-7609R_t311 (Tunnel311) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected


NSYSU-7609R# show mpls traffic-eng tunnels tunnel 311

Name: NSYSU-7609R_t311 (Tunnel311) Destination: 211.79.59.2
Status:
Admin: up Oper: down Path: not valid Signalling: Down
path option 1, type explicit 16


NSYSU-7609R# show mpls traffic-eng tunnels tunnel 311

Name: NSYSU-7609R_t311 (Tunnel311) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected


NSYSU-7609R# show mpls traffic-eng tunnels tunnel 311

Name: NSYSU-7609R_t311 (Tunnel311) Destination: 211.79.59.2
Status:
Admin: up Oper: down Path: not valid Signalling: Down
path option 1, type explicit 16


NSYSU-7609R# show mpls traffic-eng tunnels tunnel 311

Name: NSYSU-7609R_t311 (Tunnel311) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected


NSYSU-7609R# show mpls traffic-eng tunnels tunnel 311

Name: NSYSU-7609R_t311 (Tunnel311) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected


  F.  Guarantee Bandwidth

關於guarantee bw 的測試 , 在 TenGigabitEthernet 的 interface 中可以用 tx-cos 來 config , 但測試的結果無法呈現是否成功 ,也許要灌滿 10G 才知道受否有保障頻寬 , 但我們的 packet generator 最多只能產生 1G 的 traffic , 無法灌爆 10G , 因此無法測試是否可以 work , 而 POS 及 GigabitEthernet 的 interface 上, 在 config 時就會有錯誤訊息所以無法測試 .

 

TN-12416R>en
Password: 
TN-12416R#
conf 
Configuring from terminal, memory, or network [terminal]? 
Enter configuration commands, one per line. End with CNTL/Z.
TN-12416R(config)#
interface GigabitEthernet 1/0
TN-12416R(config-if)#
mpls traffic-eng tunnels
TN-12416R(config-if)#
ip rsvp bandwidth 100000 10000 sub-pool 20000
TN-12416R(config-if)#
exit
TN-12416R(config)#
cos-queue-group nsysugb
TN-12416R(config-cos-que)#
precedence 4 queue 4
TN-12416R(config-cos-que)#
precedence 5 queue low-latency 
TN-12416R(config-cos-que)#
queue 4 500
TN-12416R(config-cos-que)#
queue low-latency strict-priority 
TN-12416R(config-cos-que)#
random-detect-label 4 500 1250 1
TN-12416R(config-cos-que)#
precedence 4 random-detect-label 4
TN-12416R(config-cos-que)#
exit

TN-12416R(config)#interface GigabitEthernet 1/0 
TN-12416R(config-if)#
tx-cos nsysugb 
TN-12416R(config-if)#

TN-12416R(config)#class-map MPLS-EF 
TN-12416R(config-cmap)#
match mpls experimental 4 4

 

C:\TWAREN\Iperf>iperf -c 211.79.56.2 -u -b 1000m -t 10 -T 0xb8
------------------------------------------------------------
Client connecting to 211.79.56.2, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size: 8.00 KByte (default)
------------------------------------------------------------
[1952] local 192.168.20.21 port 4033 connected with 211.79.56.2 port 5001
[ ID] Interval Transfer Bandwidth
[1952] 0.0-10.0 sec 105 MBytes 87.9 Mbits/sec

 

NSYSU-7609R#show interfaces TenGigabitEthernet 3/1
TenGigabitEthernet3/1 is up, line protocol is up (connected)
Hardware is C6k 10000Mb 802.3, address is 000e.3802.0a40 (bia 000e.3802.0a40)
Description: "10GbE to TN-12416R 1X10GbE-LR-SC 10GbE-2/0"
Internet address is 211.79.60.50/30
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec, 
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full-duplex, 10Gb/s
input flow-control is off, output flow-control is on 
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:02, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/51/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 4965000 bits/sec, 390 packets/sec
L2 Switched: ucast: 93677 pkt, 12305709 bytes - mcast: 2264458 pkt, 1878331957 bytes
L3 in Switched: ucast: 555 pkt, 41422 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 463210409 pkt, 463553669826 bytes mcast: 0 pkt, 0 bytes
2585558 packets input, 1968108725 bytes, 0 no buffer
Received 2431724 broadcasts, 0 runts, 0 giants, 0 throttles
51 input errors, 51 CRC, 0 frame, 0 overrun, 0 ignored
0 input packets with dribble condition detected
470223544 packets output, 470981423118 bytes, 0 underruns
0 output errors, 0 collisions, 8 interface resets
0 babbles, 0 late collision, 0 deferred

NSYSU-7609R#
show interfaces TenGigabitEthernet 3/1
TenGigabitEthernet3/1 is up, line protocol is up (connected)
Hardware is C6k 10000Mb 802.3, address is 000e.3802.0a40 (bia 000e.3802.0a40)
Description: "10GbE to TN-12416R 1X10GbE-LR-SC 10GbE-2/0"
Internet address is 211.79.60.50/30
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec, 
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full-duplex, 10Gb/s
input flow-control is off, output flow-control is on 
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:01, output 00:00:01, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/51/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 1000 bits/sec, 1 packets/sec
5 minute output rate 7458000 bits/sec, 598 packets/sec
L2 Switched: ucast: 93679 pkt, 12305849 bytes - mcast: 2264472 pkt, 1878339051 bytes
L3 in Switched: ucast: 576 pkt, 42976 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 463285303 pkt, 463667209130 bytes mcast: 0 pkt, 0 bytes
2585600 packets input, 1968119820 bytes, 0 no buffer
Received 2431742 broadcasts, 0 runts, 0 giants, 0 throttles
51 input errors, 51 CRC, 0 frame, 0 overrun, 0 ignored
0 input packets with dribble condition detected
470298469 packets output, 471094988985 bytes, 0 underruns
0 output errors, 0 collisions, 8 interface resets
0 babbles, 0 late collision, 0 deferred

 

NCKU-7609R#show interfaces TenGigabitEthernet 3/1
TenGigabitEthernet3/1 is up, line protocol is up (connected)
Hardware is C6k 10000Mb 802.3, address is 000e.3802.0b40 (bia 000e.3802.0b40)
Description: "10GbE to TN-12416R 1X10GbE-LR-SC 10GbE-1/0"
Internet address is 211.79.60.46/30
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec, 
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full-duplex, 10Gb/s
input flow-control is off, output flow-control is on 
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:01, output 00:00:02, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/1371/289152 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 7205000 bits/sec, 576 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
L2 Switched: ucast: 598269 pkt, 895995274 bytes - mcast: 2327615 pkt, 1982297657 bytes
L3 in Switched: ucast: 3 pkt, 558 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
3103359 packets input, 2948381852 bytes, 0 no buffer
Received 2042071 broadcasts, 0 runts, 0 giants, 0 throttles
1371 input errors, 44 CRC, 0 frame, 6 overrun, 0 ignored
0 input packets with dribble condition detected
4114943 packets output, 2716220744 bytes, 0 underruns
0 output errors, 0 collisions, 8 interface resets
0 babbles, 0 late collision, 0 deferred

NCKU-7609R#show interfaces TenGigabitEthernet 3/1
TenGigabitEthernet3/1 is up, line protocol is up (connected)
Hardware is C6k 10000Mb 802.3, address is 000e.3802.0b40 (bia 000e.3802.0b40)
Description: "10GbE to TN-12416R 1X10GbE-LR-SC 10GbE-1/0"
Internet address is 211.79.60.46/30
MTU 1500 bytes, BW 10000000 Kbit, DLY 10 usec, 
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation ARPA, loopback not set
Keepalive not set
Full-duplex, 10Gb/s
input flow-control is off, output flow-control is on 
ARP type: ARPA, ARP Timeout 04:00:00
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/1371/324668 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/40 (size/max)
5 minute input rate 9398000 bits/sec, 760 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
L2 Switched: ucast: 671822 pkt, 1007498768 bytes - mcast: 2327627 pkt, 1982302973 bytes
L3 in Switched: ucast: 3 pkt, 558 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
3176927 packets input, 3059892655 bytes, 0 no buffer
Received 2042086 broadcasts, 0 runts, 0 giants, 0 throttles
1371 input errors, 44 CRC, 0 frame, 6 overrun, 0 ignored
0 input packets with dribble condition detected
4114980 packets output, 2716247845 bytes, 0 underruns
0 output errors, 0 collisions, 8 interface resets
0 babbles, 0 late collision, 0 deferred

備      註  本階段測試到此結束 .
意      見 對此次測試發表建議       觀看建議

日    期

 2004/04/01 (四)
工作進度  暫停測試一天
結     果

 

備      註  配合東森電路轉移
意      見 對此次測試發表建議       觀看建議

日    期

2004/03/30、31(二、三)
工作進度  測試 MPLS 的 Preemption與Reroute功能,並使用Traffic Generator測量數據
結      果

 

A. Preemption測試的 topology 如下

 1. 首先建立setup priority與holding priority皆為7的 LSP tunnel 300 ,接著建立 setup priority與holding priority皆為4的LSP tunnel 301,在此皆不指定路徑,但routing protocol會先找shortest path,也就是由 NSYSU 7609R 經台南到台北

NSYSU-7609R(config)#interface tunnel 300
NSYSU-7609R(config-if)#ip unnumbered loopback 0
NSYSU-7609R(config-if)#tunnel destination 211.79.59.2
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 7 7
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 200000
NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 2 dynamic
NSYSU-7609R(config-if)#exit


NSYSU-7609R(config)#interface tunnel 301
NSYSU-7609R(config-if)#ip unnumbered loopback 0
NSYSU-7609R(config-if)#tunnel destination 211.79.59.2
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 4 4
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 300000
NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 2 dynamic
NSYSU-7609R(config-if)#exit


2. 最後建立setup priority與holding priority皆為1的 LSP tunnel 302,指定路徑為由 NSYSU-7609R 經台南到台北,由於台南與台北之間的頻寬設為550Mbps,不足以滿足LSP tunnel 302 ,所以會搶奪優先權較低的LSP tunnel 300、301的頻寬來建立LSP,而在台南到新竹的頻寬又只剩400Mbps,所以最後LSP Tunnel 301會換路徑,而LSP Tunnel 300因為pariority比301低,故會因沒有資源而斷線

NSYSU-7609R(config)#ip explicit-path identifier 16 
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.53
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.53
NSYSU-7609R(cfg-ip-expl-path)#exit

NSYSU-7609R(config)#interface tunnel 302
NSYSU-7609R(config-if)#ip unnumbered loopback 0
NSYSU-7609R(config-if)#tunnel destination 211.79.59.2
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority1 1
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 500000
NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 16
NSYSU-7609R(config-if)#exit


3.在建好LSP Tunnel 300、301後,各傳送一條 100Mbps的UDP flow,其封包在經過 2. 的步驟後,發現在Preemption發生到LSP Tunnel 301沿新路徑重新建好,總共掉了 99,374個封包,而LSP Tunnel 300則因完全斷線,所以接下來的封包全被丟棄。

 

a. Packet Size固定為 1000 bytes
  Tunnel 300 Tunnel 301
sent packets 3,059,591 3,097,290
received packets 1,098,416 2,997,916
dropped packets 1,961,175 99,374

 

b. Packet Size為 auto-length
  Tunnel 300 Tunnel 301
sent packets 30,000,001 30,000,001
received packets 12,924,615 29,975,963
dropped packets 17,075,386 24,038

附註:因為無法固定傳送時間,故在auto-length時,傳送較多的封包以滿足時要所需的時間


B. Fast-Reroute測試的 topology 如下
 


 1. 首先由NSYSU-7609R經台南、新竹到台中建立LSP tunnel 300,接著建立LSP tunnel 301 由台中經新竹HC-12416R 到台北,再來由新竹建立 backup path LSP tunnel 302 經由台南到達台北.


NSYSU-7609R(config)#ip explicit-path identifier 300 
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.57
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.59.185
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.59.214
NSYSU-7609R(cfg-ip-expl-path)#exit


TC-12416R(config)#ip explicit-path identifier 221 
TC-12416R(cfg-ip-expl-path)#next-address 211.79.59.213
TC-12416R(cfg-ip-expl-path)#next-address 211.79.60.182
TC-12416R(cfg-ip-expl-path)#exit
 

HC-12416R(config)#ip explicit-path identifier 223 
HC-12416R(cfg-ip-expl-path)#next-address 211.79.59.186
HC-12416R(cfg-ip-expl-path)#next-address 211.79.60.54
HC-12416R(cfg-ip-expl-path)#exit 


NSYSU-7609R(config)#interface tunnel 300
NSYSU-7609R(config-if)#ip unnumbered loopback 0
NSYSU-7609R(config-if)#tunnel destination 211.79.60.130
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority1 1
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 100000
NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 300
NSYSU-7609R(config-if)#exit

TC-12416R(config)#interface tunnel 301
TC-12416R(config-if)#ip unnumbered loopback 0
TC-12416R(config-if)#tunnel destination 211.79.59.2
TC-12416R(config-if)#tunnel mode mpls traffic-eng 
TC-12416R(config-if)#tunnel mpls traffic-eng priority 1 1
TC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 100000
TC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 221
TC-12416R(config-if)#tunnel mpls traffic-eng fast-reroute
TC-12416R(config-if)#exit

 
HC-12416R(config)#interface tunnel 302
HC-12416R(config-if)#ip unnumbered loopback 0
HC-12416R(config-if)#tunnel destination 211.79.59.2
HC-12416R(config-if)#tunnel mode mpls traffic-eng 
HC-12416R(config-if)#tunnel mpls traffic-eng priority 1 1
HC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 100000
HC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 223
HC-12416R(config-if)#exit


HC-12416R(config)#interface POS 10/0
HC-12416R(config-if)#mpls traffic-eng tunnels
HC-12416R(config-if)#mpls traffic-eng backup-path tunnel 302
HC-12416R(config-if)#pos ais-shut 
HC-12416R(config-if)#pos report lrdi
HC-12416R(config-if)#ip rsvp bandwidth 900000
HC-12416R(config-if)#exit
 



 2. 為了讓 traffic 可以經由 LSP tunnel 301 傳送 , 所以我們在NSYSU的 NSYSU-7609R 把目的地為192.168.111.21 加入 static route ,讓Traffic先經Tunnel 300到達台中

NSYSU-7609R(config)#ip route 192.168.111.21 255.255.255.255 tunnel 300


接著在台中的 TC-12416R 把目的地為192.168.111.21 加入 static route .讓 traffic 可以經由 LSP tunnel 301 傳送

TC-12416R(config)#ip route 192.168.111.21  255.255.255.255 tunnel 301


3.接著到TP-12416R把台北連接新竹的POS 9/0介面關掉,使LSP Tunnel 301斷線,當新竹HC-124016R的POS 10/0得到現露出問題的訊息後,會將原本經由POS 10/0出去的Traffic改由LSP Tunnel 302傳送

 

 


4.在步驟 2.時我們已經在傳送100Mbps的Traffic Flow經LSP Tunnel 300在再經 LSP Tubnnel 301到台北,當新竹到台北斷線,而HC -12416R測到並Reroute之前,沿著LSP Tunnel 301傳送的封包都會被丟棄

a. Packet Size固定為 1000 bytes
  Tunnel 301
Sent Packets 1,500,001
Received Packets 1,197,597
Dropped Packets 302,504
斷線偵測時間 26 sec

a. Packet Size為 auto-length

  Tunnel 301
Sent Packets 20,000,001
Received Packets 14,733,101
Dropped Packets 5,266,900
斷線偵測時間 26 sec

 

備      註 1.在Fast-Reroute實驗中, 發現從Traffic Generator中間突然收不到封包到繼續收到封包大約是26秒,試了多次皆如此,表示Cisco 12416偵測的週期約為26秒 ,相較之下Preemption測驗中尋找路徑重新建立的速度便快很多,丟掉的封包也較少

2.若能調小Interface偵測斷線的timer,應該可以減少封包被丟掉的數目

意      見 對此次測試發表建議       觀看建議

日    期

2004/03/29 (一)
工作進度  測試 MPLS 的 Preemption與Reroute功能
結      果

 

此次測試的 topology 如下

 1. 首先建立setup priority與holding priority皆為7的 LSP tunnel 20 由 新竹HC-12416R 到台北,接著建立 setup priority與holding priority皆為3的LSP tunnel 221,由 台中 TC-12416R 經由新竹到達台北

TC-12416R(config)#ip explicit-path identifier 221 
TC-12416R(cfg-ip-expl-path)#next-address 211.79.59.213
TC-12416R(cfg-ip-expl-path)#next-address 211.79.60.182
TC-12416R(cfg-ip-expl-path)#exit

HC-12416R(config)#interface tunnel 20
HC-12416R(config-if)#ip unnumbered loopback 0
HC-12416R(config-if)#tunnel destination 211.79.59.2
HC-12416R(config-if)#tunnel mode mpls traffic-eng 
HC-12416R(config-if)#tunnel mpls traffic-eng priority 7 7
HC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 300000
HC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 20
HC-12416R(config-if)#exit


TC-12416R(config)#interface tunnel 221
TC-12416R(config-if)#ip unnumbered loopback 0
TC-12416R(config-if)#tunnel destination 211.79.59.2
TC-12416R(config-if)#tunnel mode mpls traffic-eng 
TC-12416R(config-if)#tunnel mpls traffic-eng priority 4 4
TC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 100000
TC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 221
TC-12416R(config-if)#tunnel mpls traffic-eng fast-reroute
TC-12416R(config-if)#exit

TC-12416R#show mpls traffic-eng tunnels tunnel 221

Name: TC-12416R_t221 (Tunnel221) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 2, type dynamic (Basis for Setup, path weight 20)

Config Parameters:
Bandwidth: 600000 kbps (Global) Priority: 4 4 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 600000 bw-based
auto-bw: disabled

InLabel : - 
OutLabel : POS9/0, 70
RSVP Signalling Info:
Src 211.79.60.130, Dst 211.79.59.2, Tun_Id 221, Tun_Instance 2
RSVP Path Info:
My Address: 211.79.60.130 
Explicit Route: 211.79.59.213 211.79.59.182 211.79.59.2 
Record Route: NONE
Tspec: ave rate=600000 kbits, burst=1000 bytes, peak rate=600000 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=600000 kbits, burst=1000 bytes, peak rate=600000 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.59.213 211.79.59.182 211.79.59.2 
History:
Tunnel:
Time since created: 10 minutes, 46 seconds
Time since path change: 5 minutes, 58 seconds
Current LSP:
Uptime: 5 minutes, 58 seconds
Prior LSP:
ID: path option 1 [1]
Removal Trigger: path option removed



HC-12416R#show mpls traffic-eng tunnels tunnel 20

Name: HC-12416R_t20 (Tunnel20) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 2, type dynamic (Basis for Setup, path weight 20)

Config Parameters:
Bandwidth: 300000 kbps (Global) Priority: 7 7 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 300000 bw-based
auto-bw: disabled

InLabel : - 
OutLabel : POS9/0, 54
RSVP Signalling Info:
Src 211.79.59.130, Dst 211.79.59.2, Tun_Id 20, Tun_Instance 1
RSVP Path Info:
My Address: 211.79.59.130 
Explicit Route: 211.79.59.186 211.79.60.54 211.79.59.2 
Record Route: NONE
Tspec: ave rate=300000 kbits, burst=1000 bytes, peak rate=300000 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=300000 kbits, burst=1000 bytes, peak rate=300000 kbits
Shortest Unconstrained Path Info:
Path Weight: 10 (TE)
Explicit Route: 211.79.59.182 211.79.59.2 
History:
Tunnel:
Time since created: 4 minutes, 10 seconds
Time since path change: 3 minutes, 18 seconds
Current LSP:
Uptime: 3 minutes, 18 seconds


2. 最後建立setup priority與holding priority皆為1的 LSP tunnel 251 由 新竹HC-12416R 到台北,由於新竹與台北之間的頻寬設為500Mbps,不足以滿足LSP tunnel 251 ,所以會搶奪優先權較低的LSP tunnel221的頻寬來建立LSP

TC-12416R(config)#ip explicit-path identifier 20 
TC-12416R(cfg-ip-expl-path)#next-address 211.79.59.182
TC-12416R(cfg-ip-expl-path)#exit

HC-12416R(config)#interface tunnel 251
HC-12416R(config-if)#ip unnumbered loopback 0
HC-12416R(config-if)#tunnel destination 211.79.59.2
HC-12416R(config-if)#tunnel mode mpls traffic-eng 
HC-12416R(config-if)#tunnel mpls traffic-eng priority 1 1
HC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 500000
HC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 20
HC-12416R(config-if)#exit

HC-12416R#show mpls traffic-eng tunnels tunnel 251

Name: HC-12416R_t251 (Tunnel251) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type explicit 20 (Basis for Setup, path weight 10)

Config Parameters:
Bandwidth: 500000 kbps (Global) Priority: 1 1 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 500000 bw-based
auto-bw: disabled

InLabel : - 
OutLabel : POS10/0, implicit-null
RSVP Signalling Info:
Src 211.79.59.130, Dst 211.79.59.2, Tun_Id 251, Tun_Instance 1
RSVP Path Info:
My Address: 211.79.59.130 
Explicit Route: 211.79.59.182 211.79.59.2 
Record Route: NONE
Tspec: ave rate=500000 kbits, burst=1000 bytes, peak rate=500000 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=500000 kbits, burst=1000 bytes, peak rate=500000 kbits
History:
Tunnel:
Time since created: 1 minutes, 24 seconds
Time since path change: 48 seconds
Current LSP:
Uptime: 48 seconds

 

3.發現中優先權LSP tunnel 221的已經改走另外一條路徑,改走經由台南到台北,而低優先權的LSP tunnel 20 ,也從原本由新竹經台南到台北的路徑,變成直接由新竹到台北

TC-12416R#show mpls traffic-eng tunnels tunnel 221

Name: TC-12416R_t221 (Tunnel221) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 2, type dynamic (Basis for Setup, path weight 30)

Config Parameters:
Bandwidth: 600000 kbps (Global) Priority: 4 4 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 600000 bw-based
auto-bw: disabled

InLabel : - 
OutLabel : POS9/0, 70
RSVP Signalling Info:
Src 211.79.60.130, Dst 211.79.59.2, Tun_Id 221, Tun_Instance 5
RSVP Path Info:
My Address: 211.79.60.130 
Explicit Route: 211.79.59.213 211.79.59.186 211.79.60.54 211.79.59.2 
Record Route: NONE
Tspec: ave rate=600000 kbits, burst=1000 bytes, peak rate=600000 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=600000 kbits, burst=1000 bytes, peak rate=600000 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.59.213 211.79.59.182 211.79.59.2 
History:
Tunnel:
Time since created: 19 minutes, 48 seconds
Time since path change: 5 minutes, 56 seconds
Current LSP:
Uptime: 5 minutes, 56 seconds
Prior LSP:
ID: path option 2 [3]
Removal Trigger: path error

HC-12416R#show mpls traffic-eng tunnels tunnel 20

Name: HC-12416R_t20 (Tunnel20) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 2, type dynamic (Basis for Setup, path weight 10)

Config Parameters:
Bandwidth: 300000 kbps (Global) Priority: 7 7 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 300000 bw-based
auto-bw: disabled

InLabel : - 
OutLabel : POS10/0, implicit-null
RSVP Signalling Info:
Src 211.79.59.130, Dst 211.79.59.2, Tun_Id 20, Tun_Instance 2
RSVP Path Info:
My Address: 211.79.59.130 
Explicit Route: 211.79.59.182 211.79.59.2 
Record Route: NONE
Tspec: ave rate=300000 kbits, burst=1000 bytes, peak rate=300000 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=300000 kbits, burst=1000 bytes, peak rate=300000 kbits
History:
Tunnel:
Time since created: 6 minutes, 46 seconds
Time since path change: 20 seconds
Current LSP:
Uptime: 20 seconds
Selection: reoptimation
Prior LSP:
ID: path option 2 [1]
Removal Trigger: path error

4.在LSP tunnel 221被LSP Tunnel 251搶奪之後,會改走別的路經,而在LSP tunnel 20也可能會因原本的路徑上的資源被LSP tunnel221搶走,而改道原LSP tunnel 221 的路徑。如果在建立LSP時指定路徑,如20040325所做的設定,則在指定路徑資源不足時,便會直接斷線,而不會改走其他路徑

備      註 如果在建立LSP時指定路徑的話,則在指定路徑資源不足時,便會直接斷線,而不會改走其他路徑,若是DYNAMIC建立的,則會在資源被搶奪後,找其他替代路徑
意      見 對此次測試發表建議       觀看建議

 

日    期

 2004/03/28 (日)
工作進度  Load sharing 的測試
結     果

 1. 由中山大學建立兩條 LSP tunnel 到台北 , 第一條 LSP 由中山 NSYSU-7609R 建立經由國網台南 TN-12416R 再到達台北 , 第二條 LSP 由中山 NSYSU-7609R 建立經由國網台南 TN-12416R , 新竹 HC-12416R 到達台北 , 整個 topology 如下圖所示

 

NSYSU-7609R(config)#ip explicit-path identifier 19 
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.57
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.57
NSYSU-7609R(cfg-ip-expl-path)#exit

NSYSU-7609R(config)#ip explicit-path identifier 27
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.57
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.59.185
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.59.182
NSYSU-7609R(cfg-ip-expl-path)#exit 

NSYSU-7609R(config)#interface tunnel 271 
NSYSU-7609R(config-if)#ip unnumbered loopback 0 
NSYSU-7609R(config-if)#tunnel destination 211.79.59.2 
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 0 0 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 100000 
NSYSU-7609R(config-if)#tunnel mpls  traffic-eng path-option 1 explicit identifier 19
NSYSU-7609R(config-if)#exit 

NSYSU-7609R(config)#interface tunnel 272 
NSYSU-7609R(config-if)#ip unnumbered loopback 0 
NSYSU-7609R(config-if)#tunnel destination 211.79.59.2 
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 0 0 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 100000 
NSYSU-7609R(config-if)#tunnel mpls  traffic-eng path-option 1 explicit identifier 27
NSYSU-7609R(config-if)#exit 

 

2.設定 load-sharing 於 tunnel 271 與 tunnel 272 上 , 並把 192.168.111.0 的子網路 static route 到這兩個 tunnel 上

NSYSU-7609R(config)#ip cef load-sharing algorithm tunnel 271

NSYSU-7609R(config)#ip cef load-sharing algorithm tunnel 272

NSYSU-7609R(config)#ip route 192.168.111.0 255.255.255.0 tunnel 271
NSYSU-7609R(config)#ip route 192.168.111.0 255.255.255.0 tunnel 272 

NSYSU-7609R#show ip cef 192.168.111.0
192.168.111.0/24, version 4704, epoch 0, attached
0 packets, 0 bytes
tag information set, unshareable
local tag: 41
via Tunnel271, 0 dependencies
traffic share 1
valid adjacency
tag rewrite with Tu271, point2point, tags imposed: {52}
via Tunnel272, 0 dependencies
traffic share 1
valid adjacency
tag rewrite with Tu272, point2point, tags imposed: {55}
0 packets, 0 bytes switched through the prefix
tmstats: external 0 packets, 0 bytes
internal 0 packets, 0 bytes

3. 由中山的 sender PC 發出 packet 

C:\TWAREN\Iperf> iperf -c 192.168.111.1 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.2 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.3 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.4 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.5 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.6 -u -b 100m -l 1000 -t 10

4. 查看這兩條 tunnel

NSYSU-7609R#show interfaces tunnel 271
Tunnel271 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, 
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
287560 packets output, 300787760 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#show interfaces tunnel 272
Tunnel272 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, 
reliability 255/255, txload 138/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 1062000 bits/sec, 105 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
272910 packets output, 285463860 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#

 5. 可以發現到這兩條 tunnel 均有 packet forward.  所以 load-sharing 是可以 work.

 

 6. 經由 David 告知我們 7609 Router 是利用 hash function 來做  load-sharing 的 , 也就是說每一個 source-destination pair 均會 hash 到某一個 tunnel , 所以 load-sharing 是要在很多不同的 source-destination pair , 才會比較平均的分配 traffic 到 tunnels 中 , 如果說 flow 太少 , 則這些 flow 就可能會剛好分配到相同的 tunnel , 此時無法看出 load-sharing的功用.

NSYSU-7609R#show mls cef exact-route 192.168.20.21 192.168.111.1

Interface: Gi9/3, Next Hop: 224.0.0.
142, Vlan: 1018, Destination Mac: 000d.66ec.0500

NSYSU-7609R#show mls cef exact-route 192.168.20.21 192.168.111.2

Interface: Gi9/3, Next Hop: 224.0.0.
127, Vlan: 1018, Destination Mac: 000d.66ec.0500

NSYSU-7609R#show mls cef exact-route 192.168.20.21 192.168.111.3

Interface: Gi9/3, Next Hop: 224.0.0.
142, Vlan: 1018, Destination Mac: 000d.66ec.0500

NSYSU-7609R#show mls cef exact-route 192.168.20.21 192.168.111.4

Interface: Gi9/3, Next Hop: 224.0.0.
142, Vlan: 1018, Destination Mac: 000d.66ec.0500

NSYSU-7609R#show mls cef exact-route 192.168.20.21 192.168.111.5

Interface: Gi9/3, Next Hop: 224.0.0.
127, Vlan: 1018, Destination Mac: 000d.66ec.0500

NSYSU-7609R#show mls cef exact-route 192.168.20.21 192.168.111.6

Interface: Gi9/3, Next Hop: 224.0.0.
142, Vlan: 1018, Destination Mac: 000d.66ec.0500

7. 我們利用 show ip cef exact-route [source ip] [destination ip] 來查看 flow 到底是往哪一條 tunnel 走 , 卻發現與 步驟 6 show mls cef exact-route [source ip] [destination ip]  所得到的結果有所不同 , 

NSYSU-7609R#show ip cef exact-route 192.168.20.21 192.168.111.
192.168.20.21 -> 192.168.111.1 : Tunnel
271 (attached)
NSYSU-7609R#show ip cef exact-route 192.168.20.21 192.168.111.2
192.168.20.21 -> 192.168.111.2 : Tunnel
272 (attached)
NSYSU-7609R#show ip cef exact-route 192.168.20.21 192.168.111.3
192.168.20.21 -> 192.168.111.3 : Tunnel
271 (attached)
NSYSU-7609R#show ip cef exact-route 192.168.20.21 192.168.111.4
192.168.20.21 -> 192.168.111.4 : Tunnel
272 (attached)
NSYSU-7609R#show ip cef exact-route 192.168.20.21 192.168.111.5
192.168.20.21 -> 192.168.111.5 : Tunnel
271 (attached)
NSYSU-7609R#show ip cef exact-route 192.168.20.21 192.168.111.6
192.168.20.21 -> 192.168.111.6 : Tunnel
272 (attached)

8. 我們利用中山 sender PC 發 packet 來驗證一下看哪一邊顯示出來是對的 , 所以我們發送 packet 到 192.168.111.1 ,  192.168.111.2 ,  192.168.111.4 , 比較之後就可以知道哪一邊是對的

C:\TWAREN\Iperf> iperf -c 192.168.111.1 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.2 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.4 -u -b 100m -l 1000 -t 10

發送前 

NSYSU-7609R#show interfaces tunnel 271
Tunnel271 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, 
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
300072 packets output, 313875312 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#show interfaces tunnel 272
Tunnel272 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, 
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
310446 packets output, 324726516 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#

發送後

NSYSU-7609R#show interfaces tunnel 271
Tunnel271 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, 
reliability 255/255, txload 97/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 5777000 bits/sec, 691 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
425084 packets output, 444637864 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#show interfaces tunnel 272
Tunnel272 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, 
reliability 255/255, txload 42/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 11382000 bits/sec, 1364 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
560470 packets output, 586251620 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#

9 . 所以 show mls cef exact-route [source ip] [destination ip]  這個觀察指令才是對的

10. 相同的設定在台中的 TC-12416R 上還是無法 work

備      註  load-sharing 是可以在 7609 上 work 的 , 但 12416R上無法 work
意      見 對此次測試發表建議       觀看建議

 

日    期

 2004/03/27 (六)
工作進度  Load sharing 的測試
結     果

 1. 由中山大學建立兩條 LSP tunnel 到台北 , 第一條 LSP 由中山 NSYSU-7609R 建立經由國網台南 TN-12416R 再到達台北 , 第二條 LSP 由中山 NSYSU-7609R 建立經由國網台南 TN-12416R , 新竹 HC-12416R 到達台北 , 整個 topology 如下圖所示

 

NSYSU-7609R(config)#ip explicit-path identifier 19 
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.57
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.57
NSYSU-7609R(cfg-ip-expl-path)#exit

NSYSU-7609R(config)#ip explicit-path identifier 27
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.57
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.59.185
NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.59.182
NSYSU-7609R(cfg-ip-expl-path)#exit 

NSYSU-7609R(config)#interface tunnel 271 
NSYSU-7609R(config-if)#ip unnumbered loopback 0 
NSYSU-7609R(config-if)#tunnel destination 211.79.59.2 
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 0 0 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 100000 
NSYSU-7609R(config-if)#tunnel mpls  traffic-eng path-option 1 explicit identifier 19
NSYSU-7609R(config-if)#exit 

NSYSU-7609R(config)#interface tunnel 272 
NSYSU-7609R(config-if)#ip unnumbered loopback 0 
NSYSU-7609R(config-if)#tunnel destination 211.79.59.2 
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 0 0 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 100000 
NSYSU-7609R(config-if)#tunnel mpls  traffic-eng path-option 1 explicit identifier 27
NSYSU-7609R(config-if)#exit 

 

2. 設定 load-sharing 於 tunnel 271 與 tunnel 272 上 , 並把 192.168.111.0 的子網路 static route 到這兩個 tunnel 上

NSYSU-7609R(config)#ip cef load-sharing algorithm tunnel 271

NSYSU-7609R(config)#ip cef load-sharing algorithm tunnel 272

NSYSU-7609R(config)#ip route 192.168.111.0 255.255.255.0 tunnel 271
NSYSU-7609R(config)#ip route 192.168.111.0 255.255.255.0 tunnel 272 

NSYSU-7609R#show ip cef 192.168.111.0
192.168.111.0/24, version 4704, epoch 0, attached
0 packets, 0 bytes
tag information set, unshareable
local tag: 41
via Tunnel271, 0 dependencies
traffic share 1
valid adjacency
tag rewrite with Tu271, point2point, tags imposed: {52}
via Tunnel272, 0 dependencies
traffic share 1
valid adjacency
tag rewrite with Tu272, point2point, tags imposed: {55}
0 packets, 0 bytes switched through the prefix
tmstats: external 0 packets, 0 bytes
internal 0 packets, 0 bytes

3. 由中山的 sender PC 發出 packet 

C:\TWAREN\Iperf> iperf -c 192.168.111.1 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.2 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.3 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.4 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.5 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf> iperf -c 192.168.111.6 -u -b 100m -l 1000 -t 10

4. 查看這兩條 tunnel

NSYSU-7609R#show interfaces tunnel 271
Tunnel271 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, 
reliability 255/255, txload 1/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
287560 packets output, 300787760 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#show interfaces tunnel 272
Tunnel272 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.58.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, 
reliability 255/255, txload 138/255, rxload 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 211.79.58.2, destination 211.79.59.2, fastswitch TTL 255
Tunnel protocol/transport Label Switching, key disabled, sequencing disabled
Checksumming of packets disabled, fast tunneling enabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: fifo
Output queue: 0/0 (size/max)
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 1062000 bits/sec, 105 packets/sec
L2 Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes
L3 in Switched: ucast: 0 pkt, 0 bytes - mcast: 0 pkt, 0 bytes mcast
L3 out Switched: ucast: 0 pkt, 0 bytes mcast: 0 pkt, 0 bytes
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
272910 packets output, 285463860 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
NSYSU-7609R#

 5. 可以發現到這兩條 tunnel 均有 packet forward. 所以 load-sharing 是可以 work.

備      註  load-sharing 是可以在 7609 上 work 的 
意      見 對此次測試發表建議       觀看建議

 

日    期

 2004/03/26 (五)
工作進度  找尋 queuing 相關文章
結     果

 找到

 1. MPLS DiffServ Tunneling Modes

 2. MPLS Quality of Service (Qos)

 3. Configuring IP Unicast Layer 3 Switching on Supervisor Engine 1

 等文章

備      註  正在研究如何利用 queue 來達到 Guaranteed bandwidth .
意      見 對此次測試發表建議       觀看建議

日    期

2004/03/25 (四)
工作進度  測試 MPLS 的 Preemption與Fast-Reroute 功能
結      果

 

此次測試的 topology 如下

 1. 首先建立setup priority與holding priority皆為7的 LSP tunnel 20 由 新竹HC-12416R 到台北,接著建立 setup priority與holding priority皆為3的LSP tunnel 221,由 台中 TC-12416R 經由新竹到達台北 , 再來由新竹建立 backup path LSP tunnel 223 經由台南到達台北.

HC-12416R(config)#ip explicit-path identifier 20 
HC-12416R(cfg-ip-expl-path)#next-address 211.79.59.182
HC-12416R(cfg-ip-expl-path)#exit 

TC-12416R(config)#ip explicit-path identifier 221 
TC-12416R(cfg-ip-expl-path)#next-address 211.79.59.213
TC-12416R(cfg-ip-expl-path)#next-address 211.79.60.182
TC-12416R(cfg-ip-expl-path)#exit

HC-12416R(config)#ip explicit-path identifier 223 
HC-12416R(cfg-ip-expl-path)#next-address 211.79.59.186
HC-12416R(cfg-ip-expl-path)#next-address 211.79.60.54
HC-12416R(cfg-ip-expl-path)#exit 

HC-12416R(config)#interface tunnel 20
HC-12416R(config-if)#ip unnumbered loopback 0
HC-12416R(config-if)#tunnel destination 211.79.59.2
HC-12416R(config-if)#tunnel mode mpls traffic-eng 
HC-12416R(config-if)#tunnel mpls traffic-eng priority 7 7
HC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 300000
HC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 20
HC-12416R(config-if)#exit


TC-12416R(config)#interface tunnel 221
TC-12416R(config-if)#ip unnumbered loopback 0
TC-12416R(config-if)#tunnel destination 211.79.59.2
TC-12416R(config-if)#tunnel mode mpls traffic-eng 
TC-12416R(config-if)#tunnel mpls traffic-eng priority 4 4
TC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 100000
TC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 221
TC-12416R(config-if)#tunnel mpls traffic-eng fast-reroute
TC-12416R(config-if)#exit

HC-12416R(config)#interface tunnel 223
HC-12416R(config-if)#ip unnumbered loopback 0
HC-12416R(config-if)#tunnel destination 211.79.59.2
HC-12416R(config-if)#tunnel mode mpls traffic-eng 
HC-12416R(config-if)#tunnel mpls traffic-eng priority 0 0
HC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 100000
HC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 223
HC-12416R(config-if)#exit

HC-12416R(config)#interface POS 10/0
HC-12416R(config-if)#mpls traffic-eng tunnels
HC-12416R(config-if)#mpls traffic-eng backup-path tunnel 223
HC-12416R(config-if)#pos ais-shut 
HC-12416R(config-if)#pos report lrdi
HC-12416R(config-if)#ip rsvp bandwidth 900000
HC-12416R(config-if)#exit

 


 2. 為了讓 traffic 可以經由 LSP tunnel 221 傳送 , 所以我們在台中的 TC-12416R 把目的地為192.168.111.2 加入 static route .


TC-12416R(config)#ip route 192.168.111.2 255.255.255.255 tunnel 221


 3. 最後建立setup priority與holding priority皆為1的 LSP tunnel 251 由 新竹HC-12416R 到台北,由於新竹與台北之間的頻寬設為500Mbps,不足以滿足LSP tunnel 251 ,所以會搶奪優先權較低的LSP tunnel 20與221的頻寬來建立LSP

HC-12416R(config)#interface tunnel 251
HC-12416R(config-if)#ip unnumbered loopback 0
HC-12416R(config-if)#tunnel destination 211.79.59.2
HC-12416R(config-if)#tunnel mode mpls traffic-eng 
HC-12416R(config-if)#tunnel mpls traffic-eng priority 1 1
HC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 450000
HC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 20
HC-12416R(config-if)#exit

HC-12416R#show interfaces tunnel 223
Tunnel223 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.59.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 2d22h, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
324 packets output, 19128 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

 


4.發現最低優先權的LSP tunnel 20已被中斷了,而中優先權的LSP tunnel221也被中斷了,而我們原本認為的中優先權LSP上的traffic應該被reroute到backup path,但是並沒有reroute,我們發現這是cisco的backup path只是針對link protection作用,並不會針對被preemption的tunnel做 reroute。

HC-12416R#show interfaces tunnel 251
Tunnel251 is administratively down, line protocol is down 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.59.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
121 packets output, 5566 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

TC-12416R#show interfaces tunnel 221
Tunnel221 is up, line protocol is down 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.60.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 236/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 01:04:41, output hang never
Last clearing of "show interface" counters 1d04h
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 4020000 bits/sec, 438 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
1861600 packets output, 1928567536 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

HC-12416R#show interfaces tunnel 223
Tunnel223 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.59.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 2d22h, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
324 packets output, 19128 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

 

備      註   cisco的preemption是可以work的,而Fast-reroute只會針對Link fail才會開始作用,故backup path只是針對link protection作用,並不會針對被preemption的tunnel做 reroute。
意      見 對此次測試發表建議       觀看建議

日    期

 2004/03/24 (三)
工作進度  Auto-bandwidth 的測試
結      果

 1. 首先我們先從中山 NSYSU-7609R 建立 LSP tunnel 18 到台北 , 並設定 auto-bandwidth 最大值為 100Mbps , 最小值為 10Mbps , 調整的時間間隔為可設定的最小值 300 秒 , 頻寬的取樣週期為可設定的最小值 30 秒 , 並把目的地為 211.79.59.2 的 packet binding 到 tunnel 18 .

NSYSU-7609R(config)#interface tunnel 18
NSYSU-7609R(config-if)#
ip unnumbered loopback 0
NSYSU-7609R(config-if)#
tunnel destination 211.79.59.2
NSYSU-7609R(config-if)#
tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng priority 0 0
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng bandwidth 10000 
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng path-option 1 dynamic 
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng auto-bw max-bw 100000 min-bw 10000
NSYSU-7609R(config-if)#
tunnel mpls traffic-eng auto-bw frequency 300
NSYSU-7609R(config-if)#
load-interval 30
NSYSU-7609R(config-if)#
exit
NSYSU-7609R(config)#
ip route 211.79.59.2 255.255.255.255 tunnel 18
NSYSU-7609R(config)#
^Z


 2. 我們由中山大學的 sender PC 送出 50 Mbps 的 udp traffic 到台北

C:\TWAREN\Iperf>iperf -c 211.79.59.2 -u -b 50m -l 1000 -t 350


 3. 然後在中山 NSYSU-7609R 觀察 tunnel 18 , 發現此時的取樣頻寬最大值為 51622

NSYSU-7609R#show mpls traffic-eng tunnels tunnel 18 

Name: NSYSU-7609R_t18 (Tunnel18) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type dynamic (Basis for Setup, path weight 20)

Config Parameters:
Bandwidth: 10000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 10000 bw-based
auto-bw: (300/141) 51622 Bandwidth Requested: 10000 

InLabel : - 
OutLabel : GigabitEthernet9/3, 52
RSVP Signalling Info:
Src 211.79.58.2, Dst 211.79.59.2, Tun_Id 18, Tun_Instance 1
RSVP Path Info:
My Address: 211.79.60.58 
Explicit Route: 211.79.60.57 211.79.60.54 211.79.59.2 
Record Route: NONE
Tspec: ave rate=10000 kbits, burst=1000 bytes, peak rate=10000 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=10000 kbits, burst=1000 bytes, peak rate=10000 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.54 211.79.59.2 
History:
Tunnel:
Time since created: 4 minutes, 3 seconds
Time since path change: 3 minutes, 36 seconds
Current LSP:
Uptime: 3 minutes, 36 seconds


 4. 等待時間超過調整時間 300 秒間隔後 , 我們可以發現 Bandwidth Requested 已經變成 52300 , 表示此時的 Auto-bandwidth adjustment 已經開始作用 .

NSYSU-7609R#show mpls traffic-eng tunnels tunnel 18 

Name: NSYSU-7609R_t18 (Tunnel18) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type dynamic (Basis for Setup, path weight 20)
path option 1, delayed clean in progress
Change in required resources detected: reroute pending
Currently Signalled Parameters:
Bandwidth: 10000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)

Config Parameters:
Bandwidth: 10000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 52300 bw-based
auto-bw: (300/269) 49014 Bandwidth Requested: 52300 

InLabel : - 
OutLabel : GigabitEthernet9/3, 54
RSVP Signalling Info:
Src 211.79.58.2, Dst 211.79.59.2, Tun_Id 18, Tun_Instance 2
RSVP Path Info:
My Address: 211.79.60.58 
Explicit Route: 211.79.60.57 211.79.60.54 211.79.59.2 
Record Route: NONE
Tspec: ave rate=52300 kbits, burst=1000 bytes, peak rate=52300 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=52300 kbits, burst=1000 bytes, peak rate=52300 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.54 211.79.59.2 
History:
Tunnel:
Time since created: 6 minutes, 47 seconds
Time since path change: 6 minutes, 19 seconds
Current LSP:
Uptime: 42 seconds
Selection: reoptimation
Prior LSP:
ID: path option 1 [1]
Removal Trigger: configuration changed
NSYSU-7609R#


  5. 接下來我們把 traffic 由 50Mbps 調整成 20Mbs .然後觀察 tunnel . 可以發現此時的取樣頻寬最大值為 20920 .

NSYSU-7609R#show mpls traffic-eng tunnels tunnel 18 

Name: NSYSU-7609R_t18 (Tunnel18) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type dynamic (Basis for Setup, path weight 20)

Config Parameters:
Bandwidth: 10000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 52300 bw-based
auto-bw: (300/225) 20920 Bandwidth Requested: 52300 

InLabel : - 
OutLabel : GigabitEthernet9/3, 54
RSVP Signalling Info:
Src 211.79.58.2, Dst 211.79.59.2, Tun_Id 18, Tun_Instance 2
RSVP Path Info:
My Address: 211.79.60.58 
Explicit Route: 211.79.60.57 211.79.60.54 211.79.59.2 
Record Route: NONE
Tspec: ave rate=52300 kbits, burst=1000 bytes, peak rate=52300 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=52300 kbits, burst=1000 bytes, peak rate=52300 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.54 211.79.59.2 
History:
Tunnel:
Time since created: 12 minutes, 26 seconds
Time since path change: 11 minutes, 58 seconds
Current LSP:
Uptime: 6 minutes, 21 seconds
Selection: reoptimation
Prior LSP:
ID: path option 1 [1]
Removal Trigger: configuration changed
NSYSU-7609R#


 6. 再等待時間超過調整時間 300 秒間隔後 , 我們可以發現 Bandwidth Requested 由 52300 已經改成 20920, 表示此時的 Auto-bandwidth adjustment 已經開始作用而且也是成功的 .

SYSU-7609R#show mpls traffic-eng tunnels tunnel 18 

Name: NSYSU-7609R_t18 (Tunnel18) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type dynamic (Basis for Setup, path weight 20)
path option 1, delayed clean in progress
Change in required resources detected: reroute pending
Currently Signalled Parameters:
Bandwidth: 52300 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)

Config Parameters:
Bandwidth: 10000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 20920 bw-based
auto-bw: (300/299) 0 Bandwidth Requested: 20920 

InLabel : - 
OutLabel : GigabitEthernet9/3, 52
RSVP Signalling Info:
Src 211.79.58.2, Dst 211.79.59.2, Tun_Id 18, Tun_Instance 3
RSVP Path Info:
My Address: 211.79.60.58 
Explicit Route: 211.79.60.57 211.79.60.54 211.79.59.2 
Record Route: NONE
Tspec: ave rate=20920 kbits, burst=1000 bytes, peak rate=20920 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=20920 kbits, burst=1000 bytes, peak rate=20920 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.54 211.79.59.2 
History:
Tunnel:
Time since created: 16 minutes, 11 seconds
Time since path change: 15 minutes, 44 seconds
Current LSP:
Uptime: 7 seconds
Selection: reoptimation
Prior LSP:
ID: path option 1 [2]
Removal Trigger: configuration changed
NSYSU-7609R#


  7. 接下來我們把 traffic 由 20Mbps 調整成 60Mbs .然後觀察 tunnel . 可以發現此時的取樣頻寬最大值為 62810 .

NSYSU-7609R#show mpls traffic-eng tunnels tunnel 18 

Name: NSYSU-7609R_t18 (Tunnel18) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type dynamic (Basis for Setup, path weight 20)

Config Parameters:
Bandwidth: 10000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 20920 bw-based
auto-bw: (300/171) 62810 Bandwidth Requested: 20920 

InLabel : - 
OutLabel : GigabitEthernet9/3, 52
RSVP Signalling Info:
Src 211.79.58.2, Dst 211.79.59.2, Tun_Id 18, Tun_Instance 3
RSVP Path Info:
My Address: 211.79.60.58 
Explicit Route: 211.79.60.57 211.79.60.54 211.79.59.2 
Record Route: NONE
Tspec: ave rate=20920 kbits, burst=1000 bytes, peak rate=20920 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=20920 kbits, burst=1000 bytes, peak rate=20920 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.54 211.79.59.2 
History:
Tunnel:
Time since created: 18 minutes, 17 seconds
Time since path change: 17 minutes, 50 seconds
Current LSP:
Uptime: 2 minutes, 13 seconds
Selection: reoptimation
Prior LSP:
ID: path option 1 [2]
Removal Trigger: configuration changed
NSYSU-7609R#


 8. 再等待時間超過調整時間 300 秒間隔後 , 我們可以發現 Bandwidth Requested 已經上升為 54583 .

NSYSU-7609R#show mpls traffic-eng tunnels tunnel 18 

Name: NSYSU-7609R_t18 (Tunnel18) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type dynamic (Basis for Setup, path weight 20)

Config Parameters:
Bandwidth: 10000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 54583 bw-based
auto-bw: (300/22) 62910 Bandwidth Requested: 54583 

InLabel : - 
OutLabel : GigabitEthernet9/3, 54
RSVP Signalling Info:
Src 211.79.58.2, Dst 211.79.59.2, Tun_Id 18, Tun_Instance 4
RSVP Path Info:
My Address: 211.79.60.58 
Explicit Route: 211.79.60.57 211.79.60.54 211.79.59.2 
Record Route: NONE
Tspec: ave rate=54583 kbits, burst=1000 bytes, peak rate=54583 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=54583 kbits, burst=1000 bytes, peak rate=54583 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.54 211.79.59.2 
History:
Tunnel:
Time since created: 25 minutes, 55 seconds
Time since path change: 25 minutes, 28 seconds
Current LSP:
Uptime: 4 minutes, 51 seconds
Selection: reoptimation
Prior LSP:
ID: path option 1 [3]
Removal Trigger: configuration changed
NSYSU-7609R#


 9. 再等一次調整時間 , 我們可以發現 Bandwidth Requested 由  54583 變成 61244 , 所以我們認為 Bandwidth Requested 所取的值是這段期間內的平均值 . 

NSYSU-7609R#show mpls traffic-eng tunnels tunnel 18 

Name: NSYSU-7609R_t18 (Tunnel18) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type dynamic (Basis for Setup, path weight 20)
path option 1, delayed clean in progress
Change in required resources detected: reroute pending
Currently Signalled Parameters:
Bandwidth: 54583 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)

Config Parameters:
Bandwidth: 10000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 61244 bw-based
auto-bw: (300/278) 0 Bandwidth Requested: 61244 

InLabel : - 
OutLabel : GigabitEthernet9/3, 52
RSVP Signalling Info:
Src 211.79.58.2, Dst 211.79.59.2, Tun_Id 18, Tun_Instance 5
RSVP Path Info:
My Address: 211.79.60.58 
Explicit Route: 211.79.60.57 211.79.60.54 211.79.59.2 
Record Route: NONE
Tspec: ave rate=61244 kbits, burst=1000 bytes, peak rate=61244 kbits
RSVP Resv Info:
Record Route: NONE
Fspec: ave rate=61244 kbits, burst=1000 bytes, peak rate=61244 kbits
Shortest Unconstrained Path Info:
Path Weight: 20 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.54 211.79.59.2 
History:
Tunnel:
Time since created: 26 minutes, 30 seconds
Time since path change: 26 minutes, 3 seconds
Current LSP:
Uptime: 26 seconds
Selection: reoptimation
Prior LSP:
ID: path option 1 [4]
Removal Trigger: configuration changed
NSYSU-7609R#

 備    註 

 Auto-bandwidth 是可以 work 的 , 只是說明文件太簡略 , 以致於我們無法得知它運作的詳細過程.

意      見 對此次測試發表建議       觀看建議

日    期

2004/03/23 (二)
工作進度  測試 MPLS 的 Load Balancing 功能
結      果

 

此次測試的 topology 如下


 1. 建立 LSP tunnel 221 由 台中 TC-12416R 經由新竹到達台北 , 然後再建立 LSP tunnel 222 由台中經新竹  , 台南到達台北 .

TC-12416R(config)#ip explicit-path identifier 221 
TC-12416R(cfg-ip-expl-path)#next-address 211.79.59.213
TC-12416R(cfg-ip-expl-path)#next-address 211.79.60.182
TC-12416R(cfg-ip-expl-path)#exit

TC-12416R(config)#ip explicit-path identifier 222 
TC-12416R(cfg-ip-expl-path)#next-address 211.79.59.213

TC-12416R(cfg-ip-expl-path)#next-address 211.79.59.186
TC-12416R(cfg-ip-expl-path)#next-address 211.79.60.54
TC-12416R(cfg-ip-expl-path)#exit 


TC-12416R(config)#interface tunnel 221
TC-12416R(config-if)#ip unnumbered loopback 0
TC-12416R(config-if)#tunnel destination 211.79.59.2
TC-12416R(config-if)#tunnel mode mpls traffic-eng 
TC-12416R(config-if)#tunnel mpls traffic-eng priority 0 0
TC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 100000
TC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 221
TC-12416R(config-if)#tunnel mpls traffic-eng fast-reroute
TC-12416R(config-if)#exit

TC-12416R(config)#interface tunnel 222
TC-12416R(config-if)#ip unnumbered loopback 0
TC-12416R(config-if)#tunnel destination 211.79.59.2
TC-12416R(config-if)#tunnel mode mpls traffic-eng 
TC-12416R(config-if)#tunnel mpls traffic-eng priority 0 0
TC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 100000
TC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 222
TC-12416R(config-if)#exit


  2. 我們台北的 TP-12416R 有一個要 Load-Balancing 的目的地子網路 192.168.111.0 , 所以我們在中山的 sender PC 加入 static route 把往 192.168.111.0 的 packet 全部導入 NSYSU-7609 Router 中 .

C:\TWAREN\Iperf>route add 192.168.111.0 mask 255.255.255.0 192.168.20.20 


 3. 在中山的 NSYSU-7609R 建 LSP tunnel 231 到台中

NSYSU-7609R(config)#interface tunnel 231
NSYSU-7609R(config-if)#ip unnumbered loopback 0
NSYSU-7609R(config-if)#tunnel destination 211.79.60.130
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 100000
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 0 0
NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 2 dynamic


4. 我們把 tunnel 221 與 tunnel 222 開啟 load-sharing , 然後把往 192.168.111.0 的 packet 導入到 tunnel 221 與 tunnel 222. 

TC-12416R(config)#ip cef load-sharing algorithm tunnel 221

TC-12416R(config)#ip cef load-sharing algorithm tunnel 222

TC-12416R(config)#ip route 192.168.111.0 255.255.255.0 tunnel 221
TC-12416R(config)#ip route 192.168.111.0 255.255.255.0 tunnel 222

然後我們先確定一下 load 是否可以 sharing 在這兩條 tunnel 上

TC-12416R#show ip cef 192.168.111.0
192.168.111.0/24, version 100287, epoch 0, attached, per-destination sharing
0 packets, 0 bytes
tag information set, unshareable, all rewrites owned
local tag: 26
via Tunnel221, 0 dependencies
traffic share 1
valid adjacency
tag rewrite with Tu221, point2point, tags imposed {86}
via Tunnel222, 0 dependencies
traffic share 1
valid adjacency
tag rewrite with Tu222, point2point, tags imposed {88}
0 packets, 0 bytes switched through the prefix
tmstats: external 0 packets, 0 bytes
internal 0 packets, 0 bytes

 


5. 在由中山 sender PC 發出 traffic 到 192.168.111.1 與 192.168.111.2 之前 , 由台中 TC-12416R 觀察 tunnel 221 與 tunnel 222 的發送數 , 然後由中山 sender PC 發出 traffic 到 192.168.111.1 與 192.168.111.2 之後 , 再觀察台中 TC-12416R 的 tunnel 221 與 tunnel 222 的發送數 

TC-12416R#show interfaces tunnel 221
Tunnel221 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.60.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 01:17:00, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
730637 packets output, 755831360 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
TC-12416R#show interfaces tunnel 222 
Tunnel222 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.60.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 01:17:04, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
944494 packets output, 976488514 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
TC-12416R#

 

C:\TWAREN\Iperf>iperf -c 192.168.111.1 -u -b 100m -l 1000 -t 10

C:\TWAREN\Iperf>iperf -c 192.168.111.2 -u -b 100m -l 1000 -t 10

TC-12416R#show interfaces tunnel 221
Tunnel221 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.60.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 01:18:01, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
730637 packets output, 755831360 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
TC-12416R#show interfaces tunnel 222
Tunnel222 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.60.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 146/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 01:18:02, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 6104000 bits/sec, 734 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
1182470 packets output, 1223030698 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
TC-12416R#

 


6. 發現 packet 只從 LSP tunnel 222 傳送 , 並沒有照預期的將 traffic 分散到兩條 LSP tunnel 上 

 

備      註   Per- destination load balancing 並未成功 , 不確定我們所做的步驟是否完整 , 有待研究 .
意      見 對此次測試發表建議       觀看建議

日    期

2004/03/22 (一)
工作進度  測試 MPLS 的 fast-reroute 功能
結      果

 

此次測試的 topology 如下

 

 1. 建立 LSP tunnel 221 由 台中 TC-12416R 經由新竹到達台北 , 由新竹建立 backup path LSP tunnel 223 經由台南到達台北.

TC-12416R(config)#ip explicit-path identifier 221 
TC-12416R(cfg-ip-expl-path)#next-address 211.79.59.213
TC-12416R(cfg-ip-expl-path)#next-address 211.79.60.182
TC-12416R(cfg-ip-expl-path)#exit

HC-12416R(config)#ip explicit-path identifier 223 
HC-12416R(cfg-ip-expl-path)#next-address 211.79.59.186
HC-12416R(cfg-ip-expl-path)#next-address 211.79.60.54
HC-12416R(cfg-ip-expl-path)#exit 


TC-12416R(config)#interface tunnel 221
TC-12416R(config-if)#ip unnumbered loopback 0
TC-12416R(config-if)#tunnel destination 211.79.59.2
TC-12416R(config-if)#tunnel mode mpls traffic-eng 
TC-12416R(config-if)#tunnel mpls traffic-eng priority 0 0
TC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 100000
TC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 221
TC-12416R(config-if)#tunnel mpls traffic-eng fast-reroute
TC-12416R(config-if)#exit

HC-12416R(config)#interface tunnel 223
HC-12416R(config-if)#ip unnumbered loopback 0
HC-12416R(config-if)#tunnel destination 211.79.59.2
HC-12416R(config-if)#tunnel mode mpls traffic-eng 
HC-12416R(config-if)#tunnel mpls traffic-eng priority 0 0
HC-12416R(config-if)#tunnel mpls traffic-eng bandwidth 100000
HC-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 223
HC-12416R(config-if)#exit

HC-12416R(config)#interface POS 10/0
HC-12416R(config-if)#mpls traffic-eng tunnels
HC-12416R(config-if)#mpls traffic-eng backup-path tunnel 223
HC-12416R(config-if)#pos ais-shut 
HC-12416R(config-if)#pos report lrdi
HC-12416R(config-if)#ip rsvp bandwidth 900000
HC-12416R(config-if)#exit

由新竹的 HC-12416R 看看 fast-reroute 的 database 確實有設定成功

HC-12416R#show mpls traffic-eng fast-reroute database
Tunnel head end item frr information:
Protected tunnel In-label Out intf/label FRR intf/label Status

Prefix item frr information:
Prefix Tunnel In-label Out intf/label FRR intf/label Status

LSP midpoint item frr information:
LSP identifier In-label Out intf/label FRR intf/label Status
211.79.60.130 221 [16] 86 PO10/0:Pop tag Tu223:tag-implic ready 
HC-12416R#


 2. 為了讓 traffic 可以經由 LSP tunnel 221 傳送 , 所以我們在台中的 TC-12416R 把目的地為211.79.59.2 加入 static route .


TC-12416R(config)#ip route 211.79.59.2 255.255.255.255 tunnel 221

TC-12416R#show interfaces tunnel 221
Tunnel221 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.60.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
221 packets output, 19405 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

HC-12416R#show interfaces tunnel 223
Tunnel223 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.59.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 01:44:29, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
295 packets output, 15698 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out


 3. 我們在台中發送目的地為211.79.59.2 的 ICMP 封包 .


TC-12416R#ping 211.79.59.2 

Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 211.79.59.2, timeout is 2 seconds:
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 8/11/12 ms

 


 4. 然後我們把台北連接新竹的 interface POS 9/0 shutdown .


TP-12416R(config)#interface POS 9/0
TP-12416R(config-if)#shutdown 
TP-12416R(config-if)#exit


 5. 然後由台中繼續發送 ICMP 封包 , 起初因為剛斷線 , signalling 還來不及反應 , 所以封包會由原本的 路徑LSP tunnel 221 送 , 所以沒有回應 , 連續發送幾次 ICMP 封包後 , 就會發現開始收到回應 , 表示 fast reroute work ,  LSP tunnel 223 開始有封包輸出 .

TC-12416R#ping 211.79.59.2 

Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 211.79.59.2, timeout is 2 seconds:
.....
Success rate is 0 percent (0/5)
TC-12416R#ping 211.79.59.2

Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 211.79.59.2, timeout is 2 seconds:
.....
Success rate is 0 percent (0/5)
TC-12416R#ping 211.79.59.2

Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 211.79.59.2, timeout is 2 seconds:
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 8/11/12 ms
TC-12416R#ping 211.79.59.2

Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 211.79.59.2, timeout is 2 seconds:
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 8/11/12 ms
TC-12416R#ping 211.79.59.2

Type escape sequence to abort.
Sending 5, 100-byte ICMP Echos to 211.79.59.2, timeout is 2 seconds:
!!!!!
Success rate is 100 percent (5/5), round-trip min/avg/max = 8/11/12 ms


TC-12416R#show interfaces tunnel 221
Tunnel221 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.60.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output never, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
249 packets output, 22088 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out


HC-12416R#show interfaces tunnel 223
Tunnel223 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.59.130)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 00:00:22, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
318 packets output, 18193 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

備      註   fast reroute 是可以 work 的
意      見 對此次測試發表建議       觀看建議

日    期

2004/03/20 (六)  /  2004/03/21 (日)
工作進度  測試 MPLS 的 fast-reroute 功能
結      果

  1. 首先由國網台南  TN-12416R 建一條 LSP tunnel 201 到 台北科技大樓 TP-12416R, 再建立第二條 LSP tunnel 202 經由新竹國網到台北科技大樓 TP-12416R, 此第二條 LSP tunnel 202 欲當成 LSP tunnel 201的backup lsp, 然後由中山的 sender PC 發送 packet 經由第一條 LSP tunnel 201 到達台北科技大樓, 在傳遞 packet 到台北的期間中, 將台北科技大樓的 interface POS 10/0 shutdown, 希望 packet 能夠由所建立的 backup path LSP tunnel 202 轉送到台北科技大樓, 其指令如下

TN-12416R(config)#ip explicit-path identifier 201 
TN-12416R(cfg-ip-expl-path)#next 211.79.60.54
Explicit Path identifier 201:
1: next-address 211.79.60.54
TN-12416R(cfg-ip-expl-path)#exit
TN-12416R(config)#ip explicit-path identifier 202 
TN-12416R(cfg-ip-expl-path)#next
TN-12416R(cfg-ip-expl-path)#next-address 211.79.59.185
Explicit Path identifier 202:
1: next-address 211.79.59.185
TN-12416R(cfg-ip-expl-path)#next-address 211.79.59.182
Explicit Path identifier 202:
1: next-address 211.79.59.185
2: next-address 211.79.59.182
TN-12416R(cfg-ip-expl-path)#exit
TN-12416R(config)#interface tunnel 201
TN-12416R(config-if)#ip unnumbered loopback 0
TN-12416R(config-if)#tunnel destination 211.79.59.2
TN-12416R(config-if)#tunnel mode mpls traffic-eng 
TN-12416R(config-if)#tunnel mpls traffic-eng priority 0 0
TN-12416R(config-if)#tunnel mpls traffic-eng bandwidth 1000
TN-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 201
TN-12416R(config-if)#exit
TN-12416R(config)#interface tunnel 202 
TN-12416R(config-if)#ip unnumbered loopback 0
TN-12416R(config-if)#tunnel destination 211.79.59.2
TN-12416R(config-if)#tunnel mode mpls traffic-eng 
TN-12416R(config-if)#tunnel mpls traffic-eng priority 0 0
TN-12416R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 202.
TN-12416R(config-if)#exit
TN-12416R(config)#interface POS 9/0
TN-12416R(config-if)#mpls traffic-eng tunnels 
TN-12416R(config-if)#mpls traffic-eng backup-path tunnel 202
TN-12416R(config-if)#ip rsvp bandwidth 10000 10000
TN-12416R(config-if)#exit

TN-12416R(config)#ip route 211.79.59.2 255.255.255.255 tunnel 201


中山 sender PC 

C:|\TWAREN\Iperf>iperf -c 211.79.59.2 -u -b 50m -l 1000 -t 400


TN-12416R#show mpls traffic-eng tunnels tunnel 201

Name: TN-12416R_t201 (Tunnel201) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type explicit 201 (Basis for Setup, path weight 10)

Config Parameters:
Bandwidth: 1000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 1000 bw-based
auto-bw: disabled

TN-12416R#show interfaces tunnel 201
Tunnel201 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.60.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 255/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 00:07:10, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 0 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 515000 bits/sec, 27 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
2821145 packets output, 2911268081 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out


在傳送 packet 的途中把台北科技大樓 TP-12416R 的 interface POS 10/0 shutdown 

TP-12416R#conf 
Configuring from terminal, memory, or network [terminal]? 
Enter configuration commands, one per line. End with CNTL/Z.
TP-12416R(config)#interface POS 10/0
TP-12416R(config-if)#shutdown 
TP-12416R(config-if)#


TN-12416R#show mpls traffic-eng tunnels tunnel 201

Name: TN-12416R_t201 (Tunnel201) Destination: 211.79.59.2
Status:
Admin: up Oper: down Path: not valid Signalling: Down
path option 1, type explicit 201

Config Parameters:
Bandwidth: 1000 kbps (Global) Priority: 0 0 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 1000 bw-based
auto-bw: disabled

TN-12416R#show interfaces tunnel 201 
Tunnel201 is up, line protocol is down 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.60.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 140/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 00:11:06, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 8 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 10513000 bits/sec, 1243 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
3393615 packets output, 3502031515 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

TN-12416R#show interfaces tunnel 202
Tunnel202 is up, line protocol is up 
Hardware is Tunnel
Interface is unnumbered. Using address of Loopback0 (211.79.60.2)
MTU 1514 bytes, BW 9 Kbit, DLY 500000 usec, rely 255/255, load 1/255
Encapsulation TUNNEL, loopback not set
Keepalive not set
Tunnel source 0.0.0.0, destination 211.79.59.2
Tunnel protocol/transport Label Switching, sequencing disabled
Key disabled
Checksumming of packets disabled
Last input never, output 00:12:15, output hang never
Last clearing of "show interface" counters never
Queueing strategy: fifo
Output queue 0/0, 10 drops; input queue 0/75, 0 drops
5 minute input rate 0 bits/sec, 0 packets/sec
5 minute output rate 0 bits/sec, 0 packets/sec
0 packets input, 0 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
66 packets output, 5270 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out

interface tunnel 202 所顯示出來的 66 packets output 為原本就有的數量,而此數量並沒有增加, 表示在 台北科技大樓 TP-12416R 把 interface POS 10/0 shutdown 後, 傳送的 packet 並沒有經過此 backup path, 而是繼續走 LSP tunnel 201, 即使 tunnel 201 的 line protocol 為 down

 

備      註 以上觀察可知, 當台北科技大樓 TP-12416R 的 interface POS 10/0 shutdown 後, packet 依然會由 LSP tunnel 201 傳送 , 而無法 reroute 到 LSP tunnel 202 , 因此把建立LSP的起始 node 與要 reroute 的 node 均設定在同一 node (TN-12416R) 是無法 reroute 成功的.

按照 CISCO 的建議 , 改由台中的 12416R 來建立兩條 LSP ,一條經由台南國網到達台北, 另一條 backup path 由台南國網經由新竹到達台北 ,此時的建立LSP的起始 node 為台中的 12416 , 而 reroute 的 node 為台南國網 TN-12416R , 把建立LSP的起始 node 與 reroute 的 node 分開在不同點 , 然後再測試看看 , 不過我發現到台中的 TC-12416R 與 台南的 TN-12416R 似乎沒有直接相連 , 而是要透過新竹的 HC-12416R , 這一點與我所得到的 Research Network (Physical) topology 不同 . 這點需要請教相關人員來確定 Research Network的 topology . 

TC-12416R#traceroute 211.79.60.2

Type escape sequence to abort.
Tracing the route to 211.79.60.2

1 211.79.59.213 0 msec 0 msec 4 msec
2 211.79.59.186 8 msec 4 msec * 

此次實驗的結論為當把建立LSP的起始 node 與要 reroute 的 node , 均設定在同一 node (TN-12416R) 時 , fast reroute 無法成功 

意      見 對此次測試發表建議       觀看建議

日    期

 2004/03/19 (五)
工作進度

 測試 MPLS preemption 功能

結     果

 1. 先建立一條 LSP tunnel 191 到台南, 並設定保留頻寬 600M, 它的 setup priority 與 holding priority 兩者均為 4 , 並確定它是 up 的, 接著再建立另外一條 LSP tunnel 192 到台南 , 一樣保留頻寬為 600M , 但它的 setup priority 與 holding priority 兩者均設為 2 , 使得 LSP tunnel 192 的 priority 比 LSP tunnel 191 高 , 之後發現 LSP tunnel 192 建立成功, 而原本建立成功的 LSP tunnel 191 會因為被搶奪頻寬而變成 down

NSYSU-7609R#conf

NSYSU-7609R(config)#ip explicit-path identifier 1

NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.58

NSYSU-7609R(cfg-ip-expl-path)#exit

NSYSU-7609R(config)#interface tunnel 191

NSYSU-7609R(config-if)#ip unnumbered loopback 0

NSYSU-7609R(config-if)#tunnel destination 211.79.60.2

NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng

NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 600000

NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 4 4

NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 1

NSYSU-7609R(config-if)#exit

NSYSU-7609R(config)#interface tunnel 192

NSYSU-7609R(config-if)#ip unnumbered loopback 0

NSYSU-7609R(config-if)#tunnel destination 211.79.60.2

NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng

NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 600000

NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 2 2

NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 1

NSYSU-7609R(config-if)#exit

NSYSU-7609R#show mpls traffic-eng tunnels tunnel 191

Name: NSYSU-7609R_t191 (Tunnel191) Destination: 211.79.60.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type explicit 1 (Basis for Setup, path weight 10)

Config Parameters:
Bandwidth: 600000 kbps (Global) Priority: 4 4 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 600000 bw-based
auto-bw: disabled

NSYSU-7609R#show mpls traffic-eng tunnels tunnel 192

Name: NSYSU-7609R_t192 (Tunnel192) Destination: 211.79.60.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type explicit 1 (Basis for Setup, path weight 10)

Config Parameters:
Bandwidth: 600000 kbps (Global) Priority: 2 2 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 600000 bw-based
auto-bw: disabled

NSYSU-7609R#show mpls traffic-eng tunnels tunnel 191

Name: NSYSU-7609R_t191 (Tunnel191) Destination: 211.79.60.2
Status:
Admin: up Oper: down Path: not valid Signalling: Down
path option 1, type explicit 1

Config Parameters:
Bandwidth: 600000 kbps (Global) Priority: 4 4 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 600000 bw-based
auto-bw: disabled


2. 如果此時把 LSP tunnel 192 shutdown , 原本因被強奪而 down 的 LSP tunnel 191 會改變成 up 的狀態

NSYSU-7609R#conf
Configuring from terminal, memory, or network [terminal]? 
Enter configuration commands, one per line. End with CNTL/Z.
NSYSU-7609R(config)#
interface tunnel 192
NSYSU-7609R(config-if)#
shutdown 
NSYSU-7609R(config-if)#exit
NSYSU-7609R(config)#exit
NSYSU-7609R#show mpls traffic-eng tunnels tunnel 191

Name: NSYSU-7609R_t191 (Tunnel191) Destination: 211.79.60.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type explicit 1 (Basis for Setup, path weight 10)

Config Parameters:
Bandwidth: 600000 kbps (Global) Priority: 4 4 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 600000 bw-based
auto-bw: disabled


3. 再建立一條 priority 比 LSP tunnel 191 更低的 LSP tunnel 193, 其 setup priority 與 holding priority 皆為6 , 此時會因為 setup priority 6 小於 LSP tunnel 191 的 holding priority 2, 所以 LSP tunnel 193 無法搶奪 LSP tunnel 191 的頻寬, 故其狀態為 down.

NSYSU-7609R(config)#interface tunnel 193
NSYSU-7609R(config-if)#ip unnumbered loopback 0
NSYSU-7609R(config-if)#tunnel destination 211.79.60.2
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 500000
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 6 6
NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 1 

NSYSU-7609R#show mpls traffic-eng tunnels tunnel 193

Name: NSYSU-7609R_t193 (Tunnel193) Destination: 211.79.60.2
Status:
Admin: up Oper: down Path: not valid Signalling: Down
path option 1, type explicit 1

Config Parameters:
Bandwidth: 500000 kbps (Global) Priority: 6 6 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 500000 bw-based
auto-bw: disabled

Shortest Unconstrained Path Info:
Path Weight: 10 (TE)
Explicit Route: 211.79.60.58 211.79.60.57 211.79.60.2 
History:
Tunnel:
Time since created: 1 minutes, 10 seconds
Path Option 1:
Last Error: PCALC:: Can't use link 211.79.60.58 on node 211.79.58.2


4. 再建立一條 priority 同 LSP tunnel 193 的 LSP tunnel 194, 因 LSP tunnel 194 僅要求頻寬 50 M , 故在不需要搶奪頻寬下, LSP tunnel 194 可以成功建立.

NSYSU-7609R#conf
Configuring from terminal, memory, or network [terminal]? 
Enter configuration commands, one per line. End with CNTL/Z.
NSYSU-7609R(config)#interface tunnel 194 
NSYSU-7609R(config-if)#ip unnumbered loopback 0 
NSYSU-7609R(config-if)#tunnel destination 211.79.60.2 
NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 50000 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 6 6 
NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 1

NSYSU-7609R#show mpls traffic-eng tunnels tunnel 194

Name: NSYSU-7609R_t194 (Tunnel194) Destination: 211.79.60.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type explicit 1 (Basis for Setup, path weight 10)

Config Parameters:
Bandwidth: 50000 kbps (Global) Priority: 6 6 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 50000 bw-based
auto-bw: disabled

備      註  preemption 的 signalling 是可以 work 的
意      見 對此次測試發表建議       觀看建議

日    期

 2004/03/18 (四)
工作進度 到國網中心參加 MPLS introduction 課程
結      果

 

備      註   
意      見 對此次測試發表建議       觀看建議

日    期

 2004/03/17 (三)
工作進度

 測試 Traffic generator 與 Auto bandwidth allocator 功能

結     果

 1. Traffic generator 速率最高可以發送 988Mbps , 此時透過 NSYSU-7609R 該 Gigabit ethernet 介面的 RSVP signaling 會受到影嚮 , 似乎沒有保障 RSVP signaling 的封包.

 2. 先建立 Tunnel 17 , 然後設定 Automatic bandwidth adjustment , 發現到該功能並沒有發揮作用 , 其設定指令如下所示.

NSYSU-7609R#conf

NSYSU-7609R(config)#ip explicit-path identifier 18

NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.57

NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.54

NSYSU-7609R(cfg-ip-expl-path)#exit

NSYSU-7609R(config)#interface tunnel 18

NSYSU-7609R(config-if)#ip unnumbered loopback 0

NSYSU-7609R(config-if)#tunnel destination 211.79.59.2

NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng

NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 100

NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 1 1

NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 18

NSYSU-7609R(config-if)#exit

NSYSU-7609R(config)#mpls traffic-eng auto-bw timers frequency 30

NSYSU-7609R(config)#interface tunnel 18

NSYSU-7609R(config-if)#tunnel mpls traffic-eng auto-bw max-bw 10000 min-bw 100

NSYSU-7609R(config-if)#tunnel mpls traffic-eng auto-bw max-bw 10000 min-bw 100

Name: NSYSU-7609R_t18 (Tunnel18) Destination: 211.79.59.2
Status:
Admin: up Oper: up Path: valid Signalling: connected

path option 1, type explicit 16 (Basis for Setup, path weight 20)

Config Parameters:
Bandwidth: 1000 kbps (Global) Priority: 1 1 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 1000 bw-based
auto-bw: (86400/85967) 110294 Bandwidth Last Collected: 0 

C:\TWAREN\Iperf>iperf -c 211.79.59.2 -u -b 50m -l 1000 -t 400

備      註  功能 Automatic bandwidth adjustment 並沒有發揮作用
意      見 對此次測試發表建議       觀看建議

日    期

 2004/03/16 (二)
工作進度

 測試 NSYSU-7609R 經由國網南科 TN-12416R 建立 tunnel 到其他節點

結     果

 1. 可由中山 NSYSU-7609R 經由國網南科成功建立 LSP tunnel 到台北科技大樓 TP-12416R

 


2. 在 TP-12416R 上的設定如下

TP-12416R#conf

Configuring from terminal, memory, or network [terminal]? 
Enter configuration commands, one per line. End with CNTL/Z.

TP-12416R(config)#router

TP-12416R(config)#router isis TWAREN

TP-12416R(config-router)#mpls traffic-eng router-id loopback 0

TP-12416R(config-router)#mpls traffic-eng level-2

TP-12416R(config-router)#exit 

TP-12416R(config)#ip cef distributed

TP-12416R(config)#mpls traffic-eng tunnels 

TP-12416R(config)#interface POS 10/0

TP-12416R(config-if)#ip rsvp bandwidth 500

TP-12416R(config-if)#mpls traffic-eng tunnels 


3. 在 NSYSU-7609R 上的設定如下

NSYSU-7609R#conf

NSYSU-7609R(config)#ip explicit-path identifier 16

NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.57

NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.54

NSYSU-7609R(cfg-ip-expl-path)#exit

NSYSU-7609R(config)#interface tunnel 16

NSYSU-7609R(config-if)#ip unnumbered loopback 0

NSYSU-7609R(config-if)#tunnel destination 211.79.59.2

NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng

NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 100

NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 1 1

NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 16

NSYSU-7609R(config-if)#exit

NSYSU-7609R(config)#ip route 211.79.59.2 255.255.255.255 tunnel 16


4. 在中山的 sender端 PC 上用 iperf 發送 udp traffic 的指令

C:\TWAREN\Iperf>iperf -c 211.79.59.2 -u -b 100m -l 1000
------------------------------------------------------------
Client connecting to 211.79.59.2, UDP port 5001
Sending 1000 byte datagrams
UDP buffer size: 8.00 KByte (default)
------------------------------------------------------------
[1952] local 192.168.20.21 port 4912 connected with 211.79.59.2 port 5001
[ ID] Interval Transfer Bandwidth
[1952] 0.0-10.0 sec 119 MBytes 99.8 Mbits/sec
[1952] WARNING: did not receive ack of last datagram after 10 tries.
[1952] Sent 125002 datagrams

備      註  在建立 LSP tunne 之前, 需注意要把 mpls 的 rsvp 功能啟動, 如 2 所示
意      見 對此次測試發表建議       觀看建議

日    期

 2004/03/15 (一)
工作進度

 測試 NSYSU-7609R 經由國網南科 TN-12416R 建立 tunnel 到其他節點

結     果

 1. 由中山 NSYSU-7609R 可成功建立 LSP tunnel 到國網南科, 但由國網南科無法建立 LSP tunnel 回到中山 NSYSU-7609R. 

2. 嘗試建立由NSYSU-7609R 經由國網南科 TN-12416RCCU-7609R LSP tunnel,依然無法成功建立

Name: TN-12416R_t1 (Tunnel1) Destination: 211.79.58.2
Status:
Admin: up Oper: down Path: not valid Signalling: Down
path option 1, type explicit 1

Config Parameters:
Bandwidth: 0 kbps (Global) Priority: 1 1 Affinity: 0x0/0xFFFF
Metric Type: TE (default)
AutoRoute: disabled LockDown: disabled Loadshare: 0 bw-based
auto-bw: disabled

History:
Tunnel:
Time since created: 1 hours, 33 minutes
Path Option 1:
Last Error: PCALC:: Explicit path has unknown address, 211.79.60.50

備      註 遇到困難 : 無法建立 LSP tunnel 由國網南科到其他節點. 
意      見 對此次測試發表建議       觀看建議

日    期

 2004/03/14 (日)
工作進度

 測試 interface 與 tunnel 的頻寬限制功能

結     果

在 NSYSU-7609R 的 GigabitEthernet 9/3 設定 speed , 發現在網址 

http://www.cisco.com/univercd/cc/td/doc/product/core/cis7600/software/122sx/swcg/intrface.htm#wp1020673

上面的Configuring Ethernet Interface Speed and Duplex Mode所記載的 speed 設定如下

To configure the port speed for a 10/100 or a 10/100/1000-Mbps Ethernet port, perform this task:

 
Command
Purpose

Step1

Router(config)# interface fastethernet slot/port

Selects the Ethernet port to be configured.

Step2

Router(config-if)# speed {10 | 100 | 1000 | {auto  [10 100 [1000 ]]}}

Configures the speed of the Ethernet interface.

Router(config-if)# no speed

Reverts to the default configuration (speed auto).

最後發現在 NSYSU-7609R 上並不能更改設定, 只能設定為 1000 Mbps,不能設定成 10/100 Mbps.

NSYSU-7609R(config)#interface GigabitEthernet 9/3
NSYSU-7609R(config-if)#speed ?
1000 Force 1000 Mbps operation
nonegotiate Do not negotiate speed

 

備      註 在 NSYSU-7609R 上並未提供設定 interface speed 成 10/100 Mbps 的功能
意      見 對此次測試發表建議       觀看建議

日    期

 2004/03/13 (六)
工作進度 由中山 7609R 建一條  LSP tunnel 到國網南科,研究如何 bind flow 到該 tunnel ,但由於找不到可直接 bind flow 到該 tunnel的指令, 所以換方向思考,改成設定 static route 將想要被 binding 的 flow 導入到該 tunnel, 整個過程如下

NSYSU-7609R#conf

NSYSU-7609R(config)#ip explicit-path identifier 1

NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.58

NSYSU-7609R(cfg-ip-expl-path)#exit

NSYSU-7609R(config)#interface tunnel 1

NSYSU-7609R(config-if)#ip unnumbered loopback 0

NSYSU-7609R(config-if)#tunnel destination 211.79.60.2

NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng

NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 100

NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 1 1

NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 1

NSYSU-7609R(config-if)#exit

NSYSU-7609R(config)#ip route 211.79.60.2 255.255.255.255 tunnel 1

 

結     果

可以把我們想要 binding 的 flow, 成功的導入到 tunnel 1 來傳送 

PC/:>iperf -c 211.79.60.2 -u -b 100m

NSYSU-7609R#show interfaces tunnel 1

TN-12416R#show interfaces GigabitEthernet 13/0

 

備      註 此方法可達到 binding flow 的效果, 但此方法不曉得是否為 CISCO 所定義的方法?
意      見 對此次測試發表建議       觀看建議

 

日    期

 2004/03/12 (五)
工作進度 由中山 7609R 建一條  LSP tunnel 到國網南科,研究如何 bind flow 到該 tunnel 
結     果

找不到如何 bind flow 到該 tunnel的指令 

備      註 遇到困難 : 找不到如何 bind flow 到該 tunnel的指令 
意      見 對此次測試發表建議       觀看建議

 

日    期

 2004/03/11 (四)
工作進度

由中山 7609R 建一條  LSP tunnel 到國網南科 , 並傳送 udp packet 由PC經中山 7609R 到國網南科12416R 

NSYSU-7609R#conf

NSYSU-7609R(config)#ip explicit-path identifier 1

NSYSU-7609R(cfg-ip-expl-path)#next-address 211.79.60.58

NSYSU-7609R(cfg-ip-expl-path)#exit

NSYSU-7609R(config)#interface tunnel 1

NSYSU-7609R(config-if)#ip unnumbered loopback 0

NSYSU-7609R(config-if)#tunnel destination 211.79.60.2

NSYSU-7609R(config-if)#tunnel mode mpls traffic-eng

NSYSU-7609R(config-if)#tunnel mpls traffic-eng bandwidth 100

NSYSU-7609R(config-if)#tunnel mpls traffic-eng priority 1 1

NSYSU-7609R(config-if)#tunnel mpls traffic-eng path-option 1 explicit identifier 1

NSYSU-7609R(config-if)#tunnel mpls traffic-eng autoroute announce

結     果

由 PC 可知道送出去的封包數,並在中山 7609R 觀察該 tunnel也有轉送封包, 國網南科TN12416R 也有收到封包 

PC/:>iperf -c 211.79.60.2 -u -b 100m

NSYSU-7609R#show interfaces GigabitEthernet 9/3

TN-12416R#show interfaces GigabitEthernet 13/0

備      註 遇到困難 : 找不到如何 bind flow 到該 tunnel的指令 
意      見 對此次測試發表建議       觀看建議

 

日    期

 2004/03/10 (三)
工作進度 可成功登入 NSYSU 7609 並將一PC連接到7609的 interface 9/11
結      果

Traffic 目前可由 PC 送到 NSYSU 的 7609

備      註  
意      見 對此次測試發表建議       觀看建議