Fwd: FreeBSD 11.1 xen trying to create linux domU instance

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

Fwd: FreeBSD 11.1 xen trying to create linux domU instance

James E. Pace
Hi,

I have a couple questions about running xen with FreeBSD 11.1 (amd64) as
Dom0.  I am pretty new to this whole concept, so it is very likely I am not
understanding something.

First, each time I boot the (physical) system, I have to tell the FreeBSD
boot loader to turn on xen.  (That is, hit 6 to set options, then 7 to
enable xen, then 1 to return to the main menu, then 1 to boot).  Is there a
way to make this the default behavior?


Second, I want to create a Linux domU instance.  I have been successful in
getting a FreeBSD 11.1 domU running, but changing that config file to use a
Linux CD doesn't boot (or crashes on boot?).  I've tried a couple linux
distributions with similar results.

Here's my xen config file:

builder = "hvm"
name = "xen-ubuntu"
memory = 1024
vcpus = 1
vif = [ 'bridge=bridge0' ]
disk = [
    '/dev/zvol/pool/xen-ubuntu,,hda,rw',
    '/pool/Downloads/ubuntu-15.10-desktop-amd64.iso,raw,hdc:cdrom,r'
    ]
vnc = 1
vnclisten = "0.0.0.0"
serial = "pty"

I created the backing filesystem with:
zfs create -V20G -o volmode=dev pool/xen-ubuntu

"xl create foo.cfg" returns fine, and "xl list" shows the instance, but the
running instance (via vncviewer) eventually spits out:

4.130084] vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632
4.130956] vbd vbd-5632: failed to write error node for device
device/vbd/5632 (19 xenbus_dev_probe on device/vbd/5632)

I suspect the linux kernel isn't booting because it can't figure out
something about the zfs volume.  But I'm not sure, and I don't know how to
work around it.


Third, on my DomU FreeBSD guest, I'm trying to set up X / Gnome3.  The
mouse pointer and the little dot are far apart; that is, the mouse isn't
tracking my movements well.  I found several suggestions to add
"usbdevice=tablet" to the config file, but that caused it to not respond to
my mouse at all.  Suggestions?

Thanks for help, tips, or pointers to info!

James
--
James E. Pace
_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: FreeBSD 11.1 xen trying to create linux domU instance

Sydney Meyer
You can change the default kernel by adding "kernel=newkernel", or perhaps "kernel=xen" in your case, to the /boot/loader.conf.local file.

Is there perhaps a "raw" missing in your linux guest cfg at the line where you define the zvol?

Also, can you try putting the tablet in the line "usbdevice=tablet" in quotes like "usbdevice = "tablet""..

Sydney
 

> On 21. Aug 2017, at 19:56, James E. Pace <[hidden email]> wrote:
>
> Hi,
>
> I have a couple questions about running xen with FreeBSD 11.1 (amd64) as
> Dom0.  I am pretty new to this whole concept, so it is very likely I am not
> understanding something.
>
> First, each time I boot the (physical) system, I have to tell the FreeBSD
> boot loader to turn on xen.  (That is, hit 6 to set options, then 7 to
> enable xen, then 1 to return to the main menu, then 1 to boot).  Is there a
> way to make this the default behavior?
>
>
> Second, I want to create a Linux domU instance.  I have been successful in
> getting a FreeBSD 11.1 domU running, but changing that config file to use a
> Linux CD doesn't boot (or crashes on boot?).  I've tried a couple linux
> distributions with similar results.
>
> Here's my xen config file:
>
> builder = "hvm"
> name = "xen-ubuntu"
> memory = 1024
> vcpus = 1
> vif = [ 'bridge=bridge0' ]
> disk = [
>    '/dev/zvol/pool/xen-ubuntu,,hda,rw',
>    '/pool/Downloads/ubuntu-15.10-desktop-amd64.iso,raw,hdc:cdrom,r'
>    ]
> vnc = 1
> vnclisten = "0.0.0.0"
> serial = "pty"
>
> I created the backing filesystem with:
> zfs create -V20G -o volmode=dev pool/xen-ubuntu
>
> "xl create foo.cfg" returns fine, and "xl list" shows the instance, but the
> running instance (via vncviewer) eventually spits out:
>
> 4.130084] vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632
> 4.130956] vbd vbd-5632: failed to write error node for device
> device/vbd/5632 (19 xenbus_dev_probe on device/vbd/5632)
>
> I suspect the linux kernel isn't booting because it can't figure out
> something about the zfs volume.  But I'm not sure, and I don't know how to
> work around it.
>
>
> Third, on my DomU FreeBSD guest, I'm trying to set up X / Gnome3.  The
> mouse pointer and the little dot are far apart; that is, the mouse isn't
> tracking my movements well.  I found several suggestions to add
> "usbdevice=tablet" to the config file, but that caused it to not respond to
> my mouse at all.  Suggestions?
>
> Thanks for help, tips, or pointers to info!
>
> James
> --
> James E. Pace
> _______________________________________________
> [hidden email] mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-xen
> To unsubscribe, send any mail to "[hidden email]"

_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: Fwd: FreeBSD 11.1 xen trying to create linux domU instance

Roger Pau Monné
In reply to this post by James E. Pace
On Mon, Aug 21, 2017 at 10:56:33AM -0700, James E. Pace wrote:

> Hi,
>
> I have a couple questions about running xen with FreeBSD 11.1 (amd64) as
> Dom0.  I am pretty new to this whole concept, so it is very likely I am not
> understanding something.
>
> First, each time I boot the (physical) system, I have to tell the FreeBSD
> boot loader to turn on xen.  (That is, hit 6 to set options, then 7 to
> enable xen, then 1 to return to the main menu, then 1 to boot).  Is there a
> way to make this the default behavior?

Yes, you need to add the following to /boot/loader.conf:

xen_kernel="/boot/xen"

You can also set xen_cmdline if you want/need to pass any extra
command line arguments to Xen.

>
> Second, I want to create a Linux domU instance.  I have been successful in
> getting a FreeBSD 11.1 domU running, but changing that config file to use a
> Linux CD doesn't boot (or crashes on boot?).  I've tried a couple linux
> distributions with similar results.
>
> Here's my xen config file:
>
> builder = "hvm"
> name = "xen-ubuntu"
> memory = 1024
> vcpus = 1
> vif = [ 'bridge=bridge0' ]
> disk = [
>     '/dev/zvol/pool/xen-ubuntu,,hda,rw',
                                 ^ try adding raw here.

>     '/pool/Downloads/ubuntu-15.10-desktop-amd64.iso,raw,hdc:cdrom,r'
>     ]
> vnc = 1
> vnclisten = "0.0.0.0"
> serial = "pty"
>
> I created the backing filesystem with:
> zfs create -V20G -o volmode=dev pool/xen-ubuntu
>
> "xl create foo.cfg" returns fine, and "xl list" shows the instance, but the
> running instance (via vncviewer) eventually spits out:
>
> 4.130084] vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632
> 4.130956] vbd vbd-5632: failed to write error node for device
> device/vbd/5632 (19 xenbus_dev_probe on device/vbd/5632)

It seems like the disk is failing to attach AFAICT. Try adding raw as
suggested above.

>
> I suspect the linux kernel isn't booting because it can't figure out
> something about the zfs volume.  But I'm not sure, and I don't know how to
> work around it.
>
>
> Third, on my DomU FreeBSD guest, I'm trying to set up X / Gnome3.  The
> mouse pointer and the little dot are far apart; that is, the mouse isn't
> tracking my movements well.  I found several suggestions to add
> "usbdevice=tablet" to the config file, but that caused it to not respond to
> my mouse at all.  Suggestions?

This should be:

usbdevice=['tablet']

Roger.
_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: Fwd: FreeBSD 11.1 xen trying to create linux domU instance

James E. Pace
Thank you for the responses; I appreciate the help.

On Tue, Aug 22, 2017 at 1:11 AM, Roger Pau Monné <[hidden email]>
> wrote:
>
>> On Mon, Aug 21, 2017 at 10:56:33AM -0700, James E. Pace wrote:
>>
>

> > First, each time I boot the (physical) system, I have to tell the FreeBSD
>> > boot loader to turn on xen.  (That is, hit 6 to set options, then 7 to
>> > enable xen, then 1 to return to the main menu, then 1 to boot).  Is
>> there a
>> > way to make this the default behavior?
>>
>> Yes, you need to add the following to /boot/loader.conf:
>>
>> xen_kernel="/boot/xen"
>>
>
I have already added this to loader.conf, as suggested in the FreeBSD
handbook section on Xen, which I followed.    I figure this allows the
possibility of booting xen, but doesn't make it the default?

[Deleted info about not booting Linux.  I added 'raw' for the zfs
filesystem as hda and that didn't change anything.  However, after leaving
it for hours, it appears that the domU got further in the boot process.
Investigation continues.]


> > Third, on my DomU FreeBSD guest, I'm trying to set up X / Gnome3.  The
>> > mouse pointer and the little dot are far apart; that is, the mouse isn't
>> > tracking my movements well.  I found several suggestions to add
>> > "usbdevice=tablet" to the config file, but that caused it to not
>> respond to
>> > my mouse at all.  Suggestions?
>>
>> This should be:
>>
>> usbdevice=['tablet']
>>
>
This didn't change the behavior; mouse still does not move.  Any other
thoughts?

Thank you,

James
--
James E. Pace
_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: Fwd: FreeBSD 11.1 xen trying to create linux domU instance

Roger Pau Monné
On Tue, Aug 22, 2017 at 09:51:47AM -0700, James E. Pace wrote:

> Thank you for the responses; I appreciate the help.
>
> On Tue, Aug 22, 2017 at 1:11 AM, Roger Pau Monné <[hidden email]>
> > wrote:
> >
> >> On Mon, Aug 21, 2017 at 10:56:33AM -0700, James E. Pace wrote:
> >>
> >
>
> > > First, each time I boot the (physical) system, I have to tell the FreeBSD
> >> > boot loader to turn on xen.  (That is, hit 6 to set options, then 7 to
> >> > enable xen, then 1 to return to the main menu, then 1 to boot).  Is
> >> there a
> >> > way to make this the default behavior?
> >>
> >> Yes, you need to add the following to /boot/loader.conf:
> >>
> >> xen_kernel="/boot/xen"
> >>
> >
> I have already added this to loader.conf, as suggested in the FreeBSD
> handbook section on Xen, which I followed.    I figure this allows the
> possibility of booting xen, but doesn't make it the default?

That makes it the default, you don't need to press any key.

> [Deleted info about not booting Linux.  I added 'raw' for the zfs
> filesystem as hda and that didn't change anything.  However, after leaving
> it for hours, it appears that the domU got further in the boot process.
> Investigation continues.]

If you paste your guest config file + the serial output I might be
able to give you some clues.

>
> > > Third, on my DomU FreeBSD guest, I'm trying to set up X / Gnome3.  The
> >> > mouse pointer and the little dot are far apart; that is, the mouse isn't
> >> > tracking my movements well.  I found several suggestions to add
> >> > "usbdevice=tablet" to the config file, but that caused it to not
> >> respond to
> >> > my mouse at all.  Suggestions?
> >>
> >> This should be:
> >>
> >> usbdevice=['tablet']
> >>
> >
> This didn't change the behavior; mouse still does not move.  Any other
> thoughts?

It works for me, weird.

Roger.
_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: Fwd: FreeBSD 11.1 xen trying to create linux domU instance

Roger Pau Monné
On Wed, Aug 23, 2017 at 03:49:09PM +0100, Roger Pau Monné wrote:
> On Tue, Aug 22, 2017 at 09:51:47AM -0700, James E. Pace wrote:
> > >> usbdevice=['tablet']
> > >>
> > >
> > This didn't change the behavior; mouse still does not move.  Any other
> > thoughts?
>
> It works for me, weird.

Forgot to mention, I use tiger-vnc [0] on OS X as the client.

Roger

[0] http://tigervnc.org/
_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: Fwd: FreeBSD 11.1 xen trying to create linux domU instance

Marcin Cieslak-3
In reply to this post by James E. Pace
On Mon, 21 Aug 2017, James E. Pace wrote:

> Hi,
>
> builder = "hvm"
> name = "xen-ubuntu"
> memory = 1024
> vcpus = 1
> vif = [ 'bridge=bridge0' ]
> disk = [
>     '/dev/zvol/pool/xen-ubuntu,,hda,rw',
>     '/pool/Downloads/ubuntu-15.10-desktop-amd64.iso,raw,hdc:cdrom,r'
>     ]
> vnc = 1
> vnclisten = "0.0.0.0"
> serial = "pty"
>
> I created the backing filesystem with:
> zfs create -V20G -o volmode=dev pool/xen-ubuntu
>
> "xl create foo.cfg" returns fine, and "xl list" shows the instance, but the
> running instance (via vncviewer) eventually spits out:
>
> 4.130084] vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632
> 4.130956] vbd vbd-5632: failed to write error node for device
> device/vbd/5632 (19 xenbus_dev_probe on device/vbd/5632)
>
> I suspect the linux kernel isn't booting because it can't figure out
> something about the zfs volume.  But I'm not sure, and I don't know how to
> work around it.
I'am using 11.1-STABLE (r321629) as Xen dom0, running under
Xen kernel 4.7.2_3.

I have sucessfully started appliances built on oldish RedHat kernels
(2.6.32-573.18.1.el6.x86_64) without any problems.
For Fedora 25 (4.10.8-200.fc25.x86_64) I had to add

xen_platform_pci=0

to the config file to get it running.
This still seems to be needed.

My disk definition for fedora and the RedHats
looks like this:

'/dev/zvol/zroot/fedora0,raw,hda,w'

(xvda seems to work well in place of "hda" for RHEL and Fedora
as well)

Marcin


smime.p7s (4K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Fwd: FreeBSD 11.1 xen trying to create linux domU instance

James E. Pace
Marcin, thank you so much for the "xen_platform_pci=0" config line!  That,
and using a file instead of a ZFS device, got me up and running.

For my future reference, I wrote down the steps I took to getting Linux
Mint running as a domU:

http://blog.pacehouse.com/2017/08/how-to-run-linux-under-freebsd-111.html

I welcome feedback on things I have wrong.

JEP


--
James E. Pace


On Wed, Aug 23, 2017 at 12:51 PM, Marcin Cieslak <[hidden email]> wrote:

> On Mon, 21 Aug 2017, James E. Pace wrote:
>
> > Hi,
> >
> > builder = "hvm"
> > name = "xen-ubuntu"
> > memory = 1024
> > vcpus = 1
> > vif = [ 'bridge=bridge0' ]
> > disk = [
> >     '/dev/zvol/pool/xen-ubuntu,,hda,rw',
> >     '/pool/Downloads/ubuntu-15.10-desktop-amd64.iso,raw,hdc:cdrom,r'
> >     ]
> > vnc = 1
> > vnclisten = "0.0.0.0"
> > serial = "pty"
> >
> > I created the backing filesystem with:
> > zfs create -V20G -o volmode=dev pool/xen-ubuntu
> >
> > "xl create foo.cfg" returns fine, and "xl list" shows the instance, but
> the
> > running instance (via vncviewer) eventually spits out:
> >
> > 4.130084] vbd vbd-5632: 19 xenbus_dev_probe on device/vbd/5632
> > 4.130956] vbd vbd-5632: failed to write error node for device
> > device/vbd/5632 (19 xenbus_dev_probe on device/vbd/5632)
> >
> > I suspect the linux kernel isn't booting because it can't figure out
> > something about the zfs volume.  But I'm not sure, and I don't know how
> to
> > work around it.
>
> I'am using 11.1-STABLE (r321629) as Xen dom0, running under
> Xen kernel 4.7.2_3.
>
> I have sucessfully started appliances built on oldish RedHat kernels
> (2.6.32-573.18.1.el6.x86_64) without any problems.
> For Fedora 25 (4.10.8-200.fc25.x86_64) I had to add
>
> xen_platform_pci=0
>
> to the config file to get it running.
> This still seems to be needed.
>
> My disk definition for fedora and the RedHats
> looks like this:
>
> '/dev/zvol/zroot/fedora0,raw,hda,w'
>
> (xvda seems to work well in place of "hda" for RHEL and Fedora
> as well)
>
> Marcin
>
>
_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: Fwd: FreeBSD 11.1 xen trying to create linux domU instance

Marcin Cieslak-3
In reply to this post by James E. Pace
On Mon, 21 Aug 2017, James E. Pace wrote:

> zfs create -V20G -o volmode=dev pool/xen-ubuntu

This is correct.

> disk = [
>     '/dev/zvol/pool/xen-ubuntu,,hda,rw',
>     '/pool/Downloads/ubuntu-15.10-desktop-amd64.iso,raw,hdc:cdrom,r'
>     ]

Can you try adding "raw" between commas?

http://xenbits.xen.org/docs/unstable/man/xl-disk-configuration.5.html

says "raw" is the default, though, so it shouldn't matter.

Here is my complete configuration file, sans some comments:

builder = "hvm"
name = "fedora"
disk = [
        '/dev/zvol/zroot/fedora0,raw,xvda,w'
#       '/root/xen/Fedora-Server-netinst-x86_64-25-1.3.iso,raw,hdc:cdrom,r'
]
boot = "c"
bios = "ovmf"
usbdevice = 'tablet'
vnc = 1
vif = ['bridge=bridge1,mac=00:02:04:08:99:f0']
memory=2048
vcpus=2
vga = "stdvga"
videoram = 16
xen_platform_pci=0
]

As you can see I am using OVMF for booting (this currently requires
modification to the port's Makefile and recompiling, see the
archives), but I think this shouldn't matter to that type of error
you are having.

This works very well with zvols. There should be no need to
create image files. (I am using zvols for FreeBSD, fedora, RHEL
and Solaris 11.3 guests).

Marcin

smime.p7s (4K) Download Attachment