Xen on CentOS Host running FreeBSD GuestJuly 5, 2007
Recently i’ve been investigating Xen. In short, Xen is open source virtualisation software that provides you with the ability to split a physical hardware server (host or dom0) into multiple virtual servers (guest or domU).
What makes Xen so special above the rest is that it offers such a wide span of guest operating systems.
I am a big fan of CentOS so I have chosen this as my host, but Xen as a host will pretty much run on any Linux based OS, NetBSD, or even Solaris.
Just as a side note, the system I will be running this on is P4 3.0 CPU with 2GB ram.
To begin with I tried Xen 3.1 (32 bit PAE SMP) on CentOS 4, during this time I came across the following resources…
- Xen on CentOS-4
- How to Install Windows on Xen
- GettingStarted (XenSource Wiki)
- CentOS Xen Wiki Documents
- CentOS 5 Virtualization Guide
- RedHat Virtualization
- Installing Xen On CentOS 5.0 (i386)
I soon discovered that CentOS 5 had far better native support for Xen than CentOS 4.
Therefore, CentOS 5 was to be used, once installed you could simply do “yum groupinstall Virtualization”, and it would install Xen for you ready to use out of the box. More or less.
So this is great right? Xen installs on CentOS 5 via the virtualisation group pretty much hassle free, which means we have the dom0 setup.
The next step is to create a guest or DomU. There are plenty to choose from (Many Linux Distros, NetBSD, FreeBSD, OpenBSD, Solaris, and even Windows XP & 2003 Server), but we want FreeBSD. This is where the fun begins! We find the following resources:
- FreeBSD 5.3 Xen DomU Install HOWTO – Outdated (For Xen 2.2 not Xen 3.0)
- How to install FreeBSD as domU
- Status of FreeBSD xen guest
- FreeBSD as DomU/Guest HOWTO
Okay, fine no problem. Right?
Yes, until you get an error like this:
ERROR: Non PAE-kernel on PAE host.
Which effectively means that the CentOS 5 Dom0 (Host) is running a PAE kernel, yet what we’re trying to install as a domU (Guest) is a non PAE kernel.
So, what is PAE? basically it gives your system the ability to handle 4GB of RAM or more (max 64GB RAM) , if you have less than 4GB, you don’t really need it. It’s primarily a fix for x86 processors, providing they support it, 64-bit processors don’t need it.
So how do we fix this problem? I investigated and found the following resources:
- 32-bit, 64-bit, and PAE, oh my! (Xen Wiki)
- FreeBSD as domU (YUAN Jue’s Group)
- FreeBSD under Xen (xen-users mail list)
- FreeBSD/xen (rink.nu)
In conclusion there are two options:
- Recompile the CentOS 5 dom0 (Host) with a non-PAE kernel with Xen.
- Recompile the FreeBSD domU (Guest) with a PAE kernel.
So what are the problems?
Option 1 would mean moving away from the native kernel, meaning that each time a new update comes up the kernel would have to be rebuilt manually. Although building the kernel without PAE will decrease overheads, building the kernel manually may lose performance. Considering this is the host, it’s vital that it is stable, therefore this is lesser of an option.
Option 2 is apparently really easy to do, practially a flick of a switch, providing you understand what you are doing with FreeBSD and Xen. Unfortunately, my skills in this area are limited.
Where do we go from here?
Well, considering option 1 is the least favourable option, as it seems, the only way to go is to contact the people who know with regards to running FreeBSD as a DomU…
Any feedback or comments will be greatfully received.