Configure Amazon Web Services

Arista supports Amazon Web Services (AWS) configuration in Non SD-WAN Destination.

Configure the Amazon Web Services (AWS) as follows:
  1. Obtain Public IP, Inside IP, and PSK details from the Amazon Web Services website.
  2. Enter the details you obtained from the AWS website into the Non- SD-WAN Network Service in the Orchestrator.

Configure Edge for Amazon Web Services (AWS) Transit Gateway (TGW) Connect Service

VeloCloud Edges typically get deployed in a Transit VPC on Amazon Web Services (AWS). AWS introduced the support for AWS TGW (Transit Gateway) Connect Service for SD-WAN appliances to connect to the Transit Gateway. VeloCloud Edge now has a feature (BGP over GRE support on LAN), which enables support on the VeloCloud Edge to use the AWS TGW Connect Service for connectivity to the AWS Transit Gateway.

For the AWS TGW Connect Service, the Edge provisioned in the Transit VPC needs to use the LAN (routed, non-WAN) interface to set up the GRE tunnel. This effectively uses the Private IP configured on the Edge Intelligence (EI) to set up the GRE tunnel to the Transit Gateway.

To configure Amazon Web Services (AWS) Transit Gateway (TGW) Connect Service for Edges, perform the following steps:

Amazon Web Services (AWS) Configuration Procedure

  1. In the AWS portal, provision an AWS Transit Gateway in a particular region. This same region must have the Transit VPC, where the VeloCloud Edge is provisioned.
    Figure 1. Provision an AWS Transit Gateway
    Check for the Transit Gateway CIDR block to be configured, as shown in the following image.
    Note: An IP from this block is used for the GRE endpoint on the AWS TGW. The Amazon ASN is used later in the BGP configuration on the VeloCloud Edge.
    Figure 2. View Transit Gateway CIDR Block
  2. Create a VPC Attachment for the Transit VPC specifying the Subnets where the LAN interface of the Edge or EI resides.
    Figure 3. Create Transit Gateway Attachment

    After the VPC Attachment is created successfully, you can see Available as the status of the attachment under the State column.

    Figure 4. List of Transit Gateway Attachments
  3. Create a Connect Attachment using the VPC Attachment.
    Figure 5. Create Connect Attachment

    After the Connect Attachment is created successfully, you can see Available as the status of the attachment under the State column.

  4. Create a Connect peer, which will translate to a GRE Tunnel. Specify the following parameters: the Transit Gateway GRE Address, the Peer GRE Address, the BGP Inside CIDR block, and the Peer ASN.
    Note: The BGP Inside CIDR block and the Peer ASN must match what is configured on the VeloCloud Edge.
    Figure 6. Create Connect Peer
    In the above example:
    • 172.43.0.24 is the GRE Outside IP address on the AWS TGW, this IP is allocated from the Transit Gateway CIDR block.
    • 10.1.1.30 is the GRE Outside IP address on the VeloCloud Edge.
    • 169.254.31.0/29 is the Inside CIDR Block. The addresses from this block are used for the BGP neighbor.
    • 169.254.31.1 is the IP address on the VeloCloud Edge.
    • 169.254.31.2 and 169.254.31.3 are addresses used for the BGP on the AWS TGW.
    • 64512 is the BGP ASN configured on the AWS TGW.
    • 65000 is the BGP ASN configured on the VeloCloud Edge.

    After the Connect Peer is created successfully, you can see Available as the status of the connect peer under the State column.

    Figure 7. List of Connect Peers
  5. The VPC Resource Map for the Transit VPC lists the LAN side subnet with the Route table, as shown in the following screenshot.
    Figure 8. VPC Resource Map
  6. In the Transit VPC route table, add a route for the TGW CIDR block with Target or Next Hop as the VPC Attachment.
    Note: For example, 172.43.0.0/24 is the AWS TGW CIDR block.
    Figure 9. Edit Routes
  7. In the same route table, verify that the LAN EI subnet has an explicit Subnet association.
    Figure 10. Verify the LAN EI Subnet Association

VeloCloud Orchestrator Configuration Procedure

  1. In the VeloCloud Orchestrator, go to Network Services > Non SD-WAN Destinations via Edge and configure the GRE Tunnel with the AWS Transit Gateway Connect.
    Figure 11. Configure NSD via Edge GRE Tunnel
    Note: When configuring the GRE Tunnel with the AWS Transit Gateway Connect service, see the following important notes:
    • The only Tunnel Mode parameter that can be configured is Active/Active.
    • There are no Keepalive mechanisms for the GRE tunnel with the AWS Transit Gateway Service.
    • BGP will be configured by default for the GRE tunnels. BGP Keepalive(s) are used for the BGP neighbor status.
    • The Edge does not support ECMP across multiple tunnels. Therefore, only one GRE Tunnel will be used for egress Traffic.
    • The Tunnel Source interface must have a default gateway configured for the feature to work.
  2. Under Profile, enable CloudVPN and Non SD-WAN Destination via Edge, and choose the configured NSD via Edge GRE Tunnel to associate with the profile.
    Figure 12. Associate NSD via Edge GRE Tunnel with the Profile
  3. Under the Edge configuration in the Non SD-WAN Destinations via Edge, you can select the configured NSD and override the settings as needed.
    Figure 13. Override NSD via Edge GRE Tunnel Settings
  4. For the specific NSD, configure the following GRE tunnel parameters by selecting the + sign.
    • Tunnel Source as the LAN interface
    • Tunnel Source IP as the IP address configured on the LAN interface, if specified dynamically use Remote Diagnostics > Interface Stats to obtain the IP address
    • TGW ASN
    • The Primary Tunnel parameters can be configured by providing, Destination IP, the IP address provided on the TGW Connect Peer
    • The Internal Network/Mask must be the same as specified in the TGW Connect Peer Inside configuration.
    • The Secondary Tunnel parameters can be configured for the Destination IP and Internal Network/Mask.
    Figure 14. Configure GRE Tunnel Parameters
    Note: BGP will be enabled by default for this feature. Local ASN field will be pre-populated.

    The configured Non SD-WAN via Edge is displayed, as shown in the following image.

    Figure 15. List of NSDs via Edge
  5. The above configuration will automatically create the BGP configuration for the Neighbors. Each GRE Tunnel configuration towards the AWS Transit Gateway will automatically be created for two BGP Neighbors with information regarding the Link Name, Neighbor IP, Tunnel Type, and ASN.
    Figure 16. BGP Neighbors
    In Additional Options, the eBGP Max Hop is configured as 2, as this is a requirement for the TGW Connect Service. The additional parameters that are populated are Keepalive and Hold Timer based off the recommendation provided by AWS. The BGP Local IP is also pre-populated. These parameters cannot be modified.
    Figure 17. Additional Options Window
    Note:
    • Two NSD BGP Neighbors will be automatically added.
    • The Additional Options field will be modified for Max-Hop, Local IP, Keep Alive, and Hold Timer values.
  6. For the GRE tunnel endpoint, configure a static route on the VeloCloud Edge which specifies the Next-Hop to specify the Subnet Default Gateway and Interface as the LAN interface.
    Figure 18. Configure Static Route Settings

Obtain Amazon Web Services Configuration Details

Discusses how to obtain Amazon Web Services configuration details.

  1. From Amazon's Web Services, create VPC and VPN Connections. Refer to the instructions in Amazon's documentation: http://awsdocs.s3.amazonaws.com/VPC/latest/vpc-nag.pdf.
  2. Make note of the Gateways associated with the enterprise account in the Orchestrator that might be needed to create a virtual private gateway in the Amazon Web Services.
  3. Make a note of the Public IP, Inside IP and PSK details associated with the Virtual Private Gateway. You need to enter this information in the Orchestrator when you create a Non SD-WAN Destination.

Configure a Non SD-WAN Destination

After you obtain Public IP, Inside IP, and PSK information from the Amazon Web Services (AWS) website, you can configure a Non SD-WAN Destination.

AWS CloudWAN CNE Connect using Tunnel-less BGP

AWS has announced Tunnel-less Connect on Cloud WAN. This document discussesAWS components and how to configure for AWS and VeloCloud SD-WAN.

The new AWS CloudWAN CNE Connect using Tunnel-less BGP capability provides a simpler way to build a global SD-WAN network using AWS backbone as a middle-mile transport network. With this capability, VeloCloud SD-WAN appliances can natively peer with AWS Cloud WAN using BGP (Border Gateway Protocol) without requiring tunneling protocols like IPSec or GRE. This simplifies the integration of customer’s SD-WAN into AWS cloud and allows them to leverage the high bandwidth AWS backbone for branch-to-branch connectivity across different geographic regions. This feature also supports in-built network segmentation, enabling customers to build a secure SD-WAN at a global scale.

VeloCloud SD-WAN Virtual Edges (vEdges) are typically deployed in what AWS calls a “Transport” VPC. This Transport VPC may then peered with other VPCs, TGWs, or in this case, a CNE (Cloud Network Edge) in the Cloud WAN backbone to achieve connectivity with resources the customer has homed into AWS.

For Cloud WAN CNE Connect, the vEdges provisioned in the Transport VPC will use the LAN-facing (routed, non-WAN) interface to establish a native L3 (i.e. unencapsulated) BGP peering with the CNE.

AWS Components

There are 6 main components needed in AWS:
  • Cloud WAN Core Network
  • Policy definition
  • Core Network Edge (CNE)
  • Transport VPC
  • VPC Attachment
  • Connect Attachment

This assumes that the customer already has other resources in other AWS VPCs that use VPC peering to CNEs in Core Network. If not, the Core Network and CNEs must be defined, and attachments must be created to the customer’s existing workload VPCs.

AWS Configuration

  1. Using the AWS Virtual Edge Deployment Guide online documentation to create vEdges in an AWS VPC.
  2. On the AWS console, AWS Network Manager must be used to create a Global Network, if one does not already exist in the customer’s AWS deployment.
    Figure 19. Create Global Network
  3. Create a Policy version.
    1. A Policy version is where key details of the solution are defined and configured, as shown in the following image.
      Figure 20. Create a Policy Version
    2. Enter the BGP ASN ranges used by the CNEs.
      Figure 21. Configure ASN Ranges
    3. In the global "Inside CIDR blocks," the CNEs will get their respective Inside CIDR blocks defined. Enter the CIDR in the appropriate text box, as shown in the following image.
      Figure 22. Define CIDR
    4. Search for Edge locations in the appropriate text box, as shown in the following image. The CNE locations define the specific AWS AZ where a CNE will be instantiated.
      Figure 23. Define Edge Location
      Note: The ASN and Inside CIDR Blocks for each Edge location are defined within the range defined above for the Global Network.
    5. Search for Segments in the appropriate text box, as shown in the following image. Logical segments are defined using Tags. VPCs and Subnets may be tagged to define which segments they are a member of. In this example, the format is Key = “Segment”, Value = “SDWAN”, although the value is arbitrary.
      Figure 24. Define Segments
      Note: Whatever value is used must match the value defined in the policy.
    6. Attachment policies specify which Segments the VCP and Connect Attachments are a part of and what criteria are used. Search for the Attachment Policies in the appropriate text box, as shown in the following image. In this example, a “tag-value” condition defines membership in the “SDWAN” segment defined above. The “Condition Values” are the key-value pair also defined above. This key-value pair must be present in VPCs and/or subnets for them to become Segment members.
      Figure 25. Attach Policies to Segments
      Note: This is arguably the least intuitive and most error-prone part of the entire configuration. If you aren’t seeing routes from your remote workload VPCs, check this. Other configurations and conditions are possible, but this is what worked in lab testing.
  4. CNE Attachments: There are two types of attachments used, VPC Attachment and Connect Attachment.
    1. VPC Attachments: Each SD-WAN Transport VPC will have a VPC attachment to its respective CNE. At least one subnet within the VPC must be specified when the VPC Attachment is created. In this example, The CNE in the us-west-1 AZ peers with the SD-WAN Transport VPC’s private LAN subnet. A key-value pair defining Segment membership is also necessary.
      Figure 26. Create Attachment
      If the Policy has been configured correctly, the Attachment should show that it has been made part of the “SDWAN” Segment. The Attachment policy rule number being used will display, as shown in the following image.
      Figure 27. View Attachment Details
    2. Connect Attachments are where “Tunnel-less (No Encapsulation)” is configured. The Connect Attachment configuration must specify an existing VPC Attachment as the Transport Attachment ID, so the VPC Attachment must be configured first. As with the VPC Attachment, tags for Segment membership must be configured.
      Figure 28. Connect Attachment

       

      Figure 29. Add Tags
      If the Policy has been configured correctly, the Attachment should show that it has been made part of the “SDWAN” Segment. Note that the Attachment policy rule number being used is shown, as is “NO_ENCAP” for the Connect protocol.
      Figure 30. View Attachment Details
  5. Connect peers are created under the Connect Attachment. This is where the SD-WAN vEdge BGP peerings are defined in terms of the ASN and peer IP address.
    Figure 31. Create Connect Peer

Once created, the AWS Console will provide two Core Network BGP peer IP addresses to use on the SD-WAN side of the BGP neighborship. These IPs will be selected randomly from the “Inside CIDR range” defined in the “Edge Locations” portion of the Policy above.

VeloCloud SD-WAN Configuration

BGP neighbors must now be configured to point to the two IP addresses provided by the AWS console under Connect Peers. Since these BGP neighbor IPs are from the Inside CIDR range defined in the policy, static routes must be created on the Edge to point to the CNE neighbor IPs using the LAN-side routed interface (GE3).
Note: Each Connect peer will get different BGP Core Network Peer IP addresses, so the Static Route and BGP Neighbor configurations will be different for each vEdge in an AWS hub-cluster.
  1. Configure Static Route Settings, as shown in the following image.
    Figure 32. Configure Static Route Settings
  2. When creating the BGP neighbors, set “Max-Hop” to 2 or more under Additional Options.
    Figure 33. Additional BGP Neighbor Options
  3. Use Monitor > Routing > BGP Edge Neighbor State to verify that the BGP peer relationship has been established with the Neighbor IPs configured.
    Figure 34. Monitor BGP Edge Neighbor States