IPIP Mesh/MikroTik RouterOS 7 Container

Setting up a gateway in a ROS7 Mikrotik router running in a container on arm and arm64 models and x86-64 CHR

This is an experimental software build for the 'enthusiasts' out there.

Info

These are the steps for setting up a fully functional AMPR gateway on an arm/arm64 Mikrotik router Tested and found working on CRS2116 and RB3011 for now.

NOTE: THE SETUP SCRIPT DOES NOT SECURE YOUR ROUTER. YOU NEED TO SET UP FIREWALL RULES YOURSELF.

General concept

Mikrotik routers running ROS 7 (7.15.3 being current at the time of writing) based on arm and arm64 processor, as well as CHR setups are able to run software containers (similar to docker). This opens the possibility to host a virtualized gateway in such a container, allowing a simple and efficient setup on modern systems.

The gateway will be hosted in a VRF on the router, providing gateway services using policy routing.

As a concept, the container has a single VETH interface which will decapsulate all incoming IPIP traffic from the tunnels, and encapsulate all outgoing traffic towards them. The container itself is isolated behind a bridge and offers some basic filtering function (e.g. restrict access from internet hosts). It will receive the RIPv2 broadcasts from the AMPR gateway and provide the obtained routes as RIP broadcasts to the router itself inside the mentioned VRF.

The container does not save anything to disk (which would be a bad idea on the router's flash memory), so the AMPR routes are lost on container or router restart, and you need to wait the now classical 5 minutes. But this should be no problem on a 24/7 on router.

Initial steps

The steps to be taken depend on the fact if you set up a new router or want to add the container to an existing running one.

Limitations

The router does not forward multicast frames at all, nor does it send out broadcasts. Incoming broadcasts are accepted and forwarded to the local VRF.

The container itself needs to sit behind a bridge due to a kernel bug in the version used by Mikrotik which sends out "Port unreachable" ICMP messages on incoming IPIP traffic if it is handled in user space (The same thing causing the need of a kernel filter in amprd. This is fixed in newer kernel releases but it will take a while for it to make its way into ROS). Bridge filtering is used to mask those messages.

New router set up

Please hold your horses - changing the script for default config

On a brand new router, clear its configuration completely...

For a new router setup, please download the automatic setup script depending go your router architecture.

First you need to enable container support according to the info provided by Mikrotik:

Enable container mode In a console type in:

/system/device-mode/update container=yes

The device will ask you to reset it by hand (you can not do this remotely). Next step is to install the container package for your firmware verion by downloading the complete package from Mikrotik, unpack it and upload the package called gontainer and reboot the router.

Next, get the appropiate install script for your architecture:

ARM32 - http://yo2loj.ro/containers/ampr_arm32.rsc
ARM64 - http://yo2loj.ro/containers/ampr_arm64.rsc
CHRx86 - http://yo2loj.ro/containers/ampr-x86-64.tar

Unfortunately, containers are not available on Mips, Tile or PowerPC devices.

After clearing your router config (no default configuration), drag and drop the file to your file window. Open a console and execute the command, using the proper file name downloaded above:

[admin@MikroTik] > import file-name=ampr_arm32.rsc

The system should state that the script was successfully executed. Now set up an internet connection (the router being blank, like e.g. add a dhcp client to eth1, and wait for it to get an IP address. With your internet connection working, navigate to /system scripts and execute the script 'install_ampr_container':

[admin@MikroTik] /system/script> run install_ampr_container

This step will download the binary container to your local storage (you need some 1-2 MB of free space on the device) depending on your system architecture and set it up. If the script fails for some reason, please just run it again.

After the container is created, open your log and then start your container by selecting it and pressing the 'Start' button in your Winbox. It should switch from "stopped" to "running" and stay running. Now you have the container installed, stop it for now, and it is time to configure it.

Container configuration parameters

You need to adapt the pre-existing container environment variables to your particular gateway before starting it again. The following ENV parameters are preset in Container-> Envs:

AMPR_SUBNETS - holds your local subnets as defined in the portal, as comma separated list of <SUBNET>/<MASK> tupples, e.g. "44.128.0.0/24,44.128.1.0/24"
ALL_VIA_AMPRGW - enables forwarding of all AMPR destinations via AMPRGW, values are "0" or "1"
FORWARD_INTERNET - enables forward of traffic from/to internet hosts, values are "0" or "1"
IGNORED_SUBNETS - allows you to ignore specific subnets provided by RIP, by <SUBNET>/<MASK> or gateway address e.g. "44.128.0.0/16"
CALL_HOME - the classic string, <CALLSIGN>@<LOCATOR> to show up on the map. You will get a yellow dot. e.g. "YO2LOJ@KN05OR". Leaving the field empty disables call home.

Please note that the provided default will allow you to play around, but will not provide a working set up.

After finishing the configuration, add your internet interface to the interface list called "Internet":

/interface list member add interface=ether1 list=Internet

Now edit the Route->filter rip-ampr-in to point to your preferred source address (your router's AMPR IP address:

(Winbox is your friend)

...and enable the 2 disabled routing rules under Routing->Rule:

[admin@MikroTik] /routing/rule> set 0 disabled=no
[admin@MikroTik] /routing/rule> set 1 disabled=no

This should do it... Start the container, sit back and wait 5 minutes for the routes to show up in your vrf.

Of course you need to set up firewall rules & stuff, but if you do not enable internet forward, you should be pretty safe.

Configuration on an existing working router

Basically you need to do 6 steps by snooping around in the provided rsc files:

1 - Bridge, VETH and VRF setup: http://yo2loj.ro/containers/1_ampr_bridge_vrf.rsc
2 - RIP setup: http://yo2loj.ro/containers/2_rip.rsc
3 - Firewall rules, Filter, NAT and Mangle: http://yo2loj.ro/containers/3_firewall.rsc
4 - Container environment setup: http://yo2loj.ro/containers/4_container_env.rsc
5 - Container installation, architecture dependent. Files hold the download and update script:
 ARM32:  http://yo2loj.ro/containers/5_container_arm32.rsc
 ARM64:  http://yo2loj.ro/containers/5_container_arm64.rsc
 x86_64: http://yo2loj.ro/containers/5_container_x86_64.rsc
6 - final routing rules: http://yo2loj.ro/containers/6_rules.rsc

All available files are here: http://yo2loj.ro/containers/

(Details are coming...)

Rip Rip Hurray! de YO2LOJ