Cisco Nexus 9000 as Hardware VTEP for NSX

Finally, after all the waiting and poking around there is now an official guide for using a Nexus 9300 as HW-VTEP for NSX. The recommended NX-OS release is: 7.0(3)I6(1) or later in same main release The supported VMware NSX release is: 6.3.3 and later on the same main release Here is the Link to the guide: https://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/white-paper-c11-740091.html#_Toc502975411 I hope i have some time in the coming days to deploy it in my lab and test it. But after a first overview the guide look pretty forward.

N5600 – Verify Switching Mode

Usually you don’t have to change the hardware forwarding mode on the Nexus 5600 from the standard cut through to  mode. But if you want to run VxLan on them, you have to. The syntax to change the forwarding mode is pretty forward:

But after the change you need to reload the switch! And here is the problem. If you don’t do the reload immediately, there is was no show command to verify in which switching mode the switch actually is. It seems this problem reached the NX-OS Developers and with…

ACI – Basic Object Workflow

Here’s something I was working on for the last weeks. I saw some examples of such a diagram, but so far non of them really did satisfy me so i made my own. But i had a lot of support from other enginners, even some Cisco SE’s who did take a look and gave me some hints. I can’t really tell all names now, but rest assured I’m very glad you all did look over it! So here it is. If you have comments, please leave a note or drop…

ACI – Preferred Groups

Since APIC Release 2.2(1n) Cisco enabled a feature called Preferred Groups. What does it and when do you need it? It allows defined EPGs in a VRF still to communicate with each other even when the Policy enforcement is enabled and there are no contract between those EPG’s. This can be, for example, really useful for migration scenarios. You can use them with all kind of EPG’s: EPG, uEPG or External EPG. But there are a few things you should be aware when you use it: You have to specify…

ACI – Access the Snapshots via CLI

When I planned to do a factory reset of my APIC in the Lab, I wanted to create a snapshot of the current configuration directly copy it down to my Laptop. Over the GUI, there is no way to do this. You can just create a local snapshot on the APIC or send it to a remote location which needs to be a FTP/SCP/SFTP Server. But you can’t simply download it.   After a bit of research, I figured out how to locate the file on the file system of the APIC and how…

ACI – Cleanup “leftovers” from Wizards

Sometimes it happens that there are config parts on the APIC left, that you can’t delete in the GUI since there is no delete option. Here is one example:   Those are the un-deletable objects: So to get rid of it you could factory reset the APIC (which is not really suitable), Call TAC, or just delete it yourself via the REST API or the CLI. I’ll go into detail for the last two ones.     Delete it via REST API Right-Click on the object and “save-as” When you open…

VxLAN BGP EVPN on Nexus 9000v – Part 1

Last Thursday i got a notification that there are new images out for the Nexus 9k. First thing i checked was if there is one too for the Nexus 9000v. And yes, there was it: 7.0(3)I6(1). Next thing to check was if Cisco integrated the highly anticipated feature VxLAN BGP EVPN. And after a bit of searching (since there were no release notes) i found it in the already updated NX-OSv 9000 Guide: Of course I immediately wanted to test it, but i had a real lab available over the weekend, so that had to…

Overview Multicast and VXLAN L2&L3 Support

It took me quite a while to find an official document where you have the chance to get an overview on whats supported on which platform. This week i got lucky 😉 Multicast Enabled Underlay:   VXLAN L2 and L3 Gateways:   The complete presentation with a lot more of VXLAN informations can be found here:  https://www.cisco.com/c/dam/m/sl_si/events/2016/cisco_dan_inovativnih_resitev/pdf/cisco_day_slovenia_2016_vxlan_marian_klas_final.pdf

VXLAN FLOOD&LEARN ON CSR1000v

After getting VXLAN F&L to work on the Nexus 9000v. I thought why not trying the “easier one”, which was already tested a lot of times over the last 1-2 years. And well, i works out of the box. How is it done? CSR1000v as Leafs IOU L3 Router (you can basically use any router that is capable of OSPF/ISIS/EIGRP and PIM) VPCS als clients to ping GNS3 to capture the Ethernet frames for a deeper understanding of what’s going on At first you need basic connectivity and dynamic routing in…

VXLan Flood&Learn on Nexus 9000v with GNS3 2.0

I had quite a lot of troubles with Nexus 9000v on GNS 1.5 with VXLAN. In fact, after finishing the config (with the same Layout used that you see above) it always ended up with the loopback source interface for the NVE Interfaces getting shutdown by the switch. I didn’t had the time to investigate it (beside the fact that i tried to get it work a lot of times …), but this week i upgraded the environment to GNS 2.0. And there was a very welcomed surprise -> It works 🙂 Update: Ariel…