OVHcloud Network Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
FS#4145 — gsw-4
Incident Report for Network & Infrastructure
Resolved
We have a routing problem on gsw-4

Update(s):

Date: 2010-04-29 18:21:02 UTC
OVH Comment - Thursday, 29th of April, 2010, 10:34

We have some strange logs on IP routers
that are used for the Global Switch routers.

Apr 29 10:29:38 20g.vss-3-6k.routers.chtix.eu 22890: Apr 29 09:29:23 GMT: %COMMON_FIB-6-FIB_RECURSION_VIA_SELF: 213.251.190.48/28 is found to resolve via itself during setting up switching info
Apr 29 10:29:38 20g.vss-3-6k.routers.chtix.eu 22891: Apr 29 09:29:23 GMT: %COMMON_FIB-SW1_DFC8-6-FIB_RECURSION_VIA_SELF: 213.251.190.48/28 is found to resolve via itself during setting up switching info
Apr 29 10:29:38 20g.vss-3-6k.routers.chtix.eu 22892: Apr 29 09:29:23 GMT: %COMMON_FIB-SW2_DFC9-6-FIB_RECURSION_VIA_SELF: 213.251.190.48/28 is found to resolve via itself during setting up switching info
Apr 29 10:29:38 20g.vss-3-6k.routers.chtix.eu 22893: Apr 29 09:29:23 GMT: %COMMON_FIB-SW1_DFC9-6-FIB_RECURSION_VIA_SELF: 213.251.190.48/28 is found to resolve via itself during setting up switching info
Apr 29 10:29:38 20g.vss-3-6k.routers.chtix.eu 22894: Apr 29 09:29:23 GMT: %COMMON_FIB-SW2_DFC8-6-FIB_RECURSION_VIA_SELF: 213.251.190.48/28 is found to resolve via itself during setting up switching info
Apr 29 10:29:38 20g.vss-3-6k.routers.chtix.eu 22895: Apr 29 09:29:23 GMT: %COMMON_FIB-SW2_SPSTBY-6-FIB_RECURSION_VIA_SELF: 213.251.190.48/28 is found to resolve via itself during setting up switching info
Apr 29 10:29:38 20g.vss-3-6k.routers.chtix.eu 22896: Apr 29 09:29:23 GMT: %COMMON_FIB-SW1_SP-6-FIB_RECURSION_VIA_SELF: 213.251.190.48/28 is found to resolve via itself during setting up switching info
Apr 29 10:29:38 20g.vss-3-6k.routers.chtix.eu 22897: Apr 29 09:29:23 GMT: %COMMON_FIB-SW1_DFC1-6-FIB_RECURSION_VIA_SELF: 213.251.190.48/28 is found to resolve via itself during setting up switching info


Apparently this morning routers do not support the announcement of 213.251.190.48/28
in OSPF and BGP.

We just remove the BGP advertisement. It just keeps OSPF.

A nice bug yet.


OVH Comment - Thursday, 29th of April, 2010, 10:41

The origin of the problem is probably due to emergency work
we performs this morning on Frankfurt on Decix.
http://travaux.ovh.com/?do=details&id=4131


And probably the shut down / no shut down of DECIX caused
a small overload on the VSS at the level of the BGP tables recalculation
This problem receiving overload VSS at the level of BGP will
resolved soon with the introduction of 2 ASR 1000 for the
collector roads in the entire network. Is is a router, specifically
designed for large BGP tables and many BGP operation.

OVH Comment - Thursday, 29th of April, 2010, 18:33

We have subject to an attack. It is now blocked, not necessarily in connection with this morning.
Posted Apr 29, 2010 - 17:57 UTC