How to try out nested-pods locally (VLAN + trunk)

How to try out nested-pods locally (VLAN + trunk)

Following are the instructions for an all-in-one setup where Kubernetes will also be running inside the same Nova VM in which Kuryr-controller and Kuryr-cni will be running. 4GB memory and 2 vCPUs, is the minimum resource requirement for the VM:

  1. To install OpenStack services run devstack with devstack/local.conf.pod-in-vm.undercloud.sample. Ensure that “trunk” service plugin is enabled in /etc/neutron/neutron.conf:

    service_plugins =,
  2. Launch a VM with Neutron trunk port.. The next steps can be followed: Boot VM with a Trunk Port.

  1. Inside VM, install and setup Kubernetes along with Kuryr using devstack:
    • Since undercloud Neutron will be used by pods, Neutron services should be disabled in localrc.

    • Run devstack with devstack/local.conf.pod-in-vm.overcloud.sample. but first fill in the needed information:

      • Point to the undercloud deployment by setting:

      • Fill in the subnetpool id of the undercloud deployment, as well as the router where the new pod and service networks need to be connected:

      • Ensure the nested-vlan driver is going to be set by setting:

      • Optionally, the ports pool funcionality can be enabled by following: How to enable ports pool with devstack.

      • [OPTIONAL] If you want to enable the subport pools driver and the VIF Pool Manager you need to include:

  2. Once devstack is done and all services are up inside VM. Next steps are to configure the missing information at /etc/kuryr/kuryr.conf:

    • Configure worker VMs subnet:

      worker_nodes_subnet = <UNDERCLOUD_SUBNET_WORKER_NODES_UUID>
    • Configure binding section:

      driver = kuryr.lib.binding.drivers.vlan
      link_iface = <VM interface name eg. eth0>
    • Restart kuryr-k8s-controller:

      sudo systemctl restart devstack@kuryr-kubernetes.service
    • Restart kuryr-daemon:

      sudo systemctl restart devstack@kuryr-daemon.service

Now launch pods using kubectl, Undercloud Neutron will serve the networking.

Creative Commons Attribution 3.0 License

Except where otherwise noted, this document is licensed under Creative Commons Attribution 3.0 License. See all OpenStack Legal Documents.