Setting up Oracle VM Manager 3.0.1

Steps to Setup OVM Environment

High Level Tasks

1. Reinstall VMManager software / restore VM Manager DB
2. Do ab-initio setup of vmserver
3. Load templates
4. Setup test VMs and shake out

Setup VM Manager

See Installing Oracle VM Manager

Setup VM server for Server Pool and VM template Storage

  i)  Run the installation process using the Oracle VM Server 3.0.x 

        Variations:

          - Don't forget to attach the balance of the boot disk as /u01 and set FS type to 'oscfs' (?)
          - 

  ii) Once setup run through the fllowing to finalize the instance in preparation for configuring the VM manager

         - Export Server Pool partition

           $ echo "/u01/serverpool \*(rw,no_root_squash)" > /etc/exports cat /etc/exports cd /u01 ls -ld .
           $ cd /u01
           $ chmod 777 .
           $ mkdir serverpool
           $ chmod 777 serverpool
           $ ls -l
           $ exportfs -av
           $ exportfs -v

         - Start NFS and configure to start on boot

           $ service nfs status
           $ service nfs start
           $ chkconfig nfs on
       
           and check:

           $ mount -t nfs vmserver:/u01/serverpool /mnt
           $ mount
           $ umount /mnt mount

         - Check firewall is diabled

           $ service iptables status
           $ service ip6tables status

Configuring the VM Manager

Steps transcribed from Console record:

       * Discover Server 192.168.100.151
       * Edit Server vmserver.pha.com.au
       * Register File Server OvmNfsServer
       * Refresh File System nfs:/u01/serverpool (Failed - ???
      
         So attempte3d recovery

         ~ Delete nfs:/u01/serverpool
         ~ Delete OvmNfsServer

       * Register File Server OvnNfsServer
       * Refresh File Server OvnNfsServer
       * Refresh File System nfs:/u01/serverpool

       Attempted to use the QNAP as iSCSI - don't know how yet!

       * Refresh Storage Array - Unmanaged iSCSI Storage Array (Failed - did not know what to do...)

       * Refresh File System nfs:/u01/serverpool
       * Edit Physical Disk SATA_ST31000340AS_9QJ1CNFX (Make it sharable!)
       * Create Server Pool OvmServerPool
       * Add Server vmserver.pha.com.au to Server Pool OvmServerPool	(Failed)

       ...backtrack...

       * Delete OvmServerPool
       * Rescan Physical Disks on Server vmserver.pha.com.au. Use this command when storage array disks have been added or removed from a server.	
       * Edit Physical Disk SATA_ST31000340AS_9QJ1CNFX (Make it sharable)
       * Refresh File System nfs:/u01/serverpool
       * Rescan Physical Disks on Server vmserver.pha.com.au. Use this command when stor
       * Refresh File System nfs:/u01/serverpool
       * Add Server vmserver.pha.com.au to Server Pool  (Aborted)

       * Create Server Pool OvmServerPool
       * Edit Server Pool OvmServerPool
       * Add Server vmserver.pha.com.au to Server Pool OvmServerPool (Failed)

           DNS issue - vmserver.pha.com.au was mapped to 127.0.0.1 in hosts file -
           removed this and it worked on the next attempt

       * Add Server vmserver.pha.com.au to Server Pool OvmServerPool (Worked this time)
       * Create Repository OvmRepository
       * Edit Server Pool OvmServerPool
       * Discover Repository
       * Present Repository OvmRepository to Server vmserver.pha.com.au

       * Import Template OvmRepository (Failed)

         - had http://localhost/... and not http://vmmanager.pha.com.au/... in URL for template source [changed and it worked]

       > Refresh Repository OvmRepository (does this automatically after import)
       * Import Template OvmRepository - Unpacking Template 1/1, 27,717 MB/? MB	[11G]
       > Refresh Repository OvmRepository
       * Import Template OvmRepository - Unpacking Template 1/1, 26,954 MB/? MB	[10G]
       > Refresh Repository OvmRepository
       * Import Template OvmRepository - Unpacking Template 1/1, 2,466 MB/? MB	[Linux]
       > Refresh Repository OvmRepository

       *DONE*

     Missing steps in above sequence:

       * Set up NIC MAC addresses
       * Extend network to be used for Data and VMs themselves 

     Test it:

       * Clone Ora11G from OVM_EL5U2_X86_64_ORACLE11G_PVM.tgz (Appeared to work - but failed to start/run)
       * Create Virtual Machine Oracle11G (Appeared to work - but failed to start/run)
       * Edit Virtual Machine Ora11G
       * Start Virtual Machine Ora11G (Failed)

Error Messages

Start - Failed

  (09/23/2011 12:27:50:391 AM) OVMAPI_4010E Attempt to s
	
  Job Construction Phase
  ----------------------
  begin()
  Appended operation 'Virtual Machine Start' to object '0004fb0000060000f6fd26bb00d0df85 (Ora11G)'.
  commit()
  Completed Step: COMMIT

  Objects and Operations
  ----------------------
  Object (IN_USE): [Vnic] 0004fb0000070000c58dfcf4c80cfdc6 (00:21:f6:00:00:01)
  Object (IN_USE): [VirtualMachine] 0004fb0000060000f6fd26bb00d0df85 (Ora11G)
  Operation: Virtual Machine Start
  Object (IN_USE): [VmDiskMapping] 0004fb00001300003741c869ac1a196c
  Object (IN_USE): [VirtualDisk] 0004fb0000120000675bbd66264d8277.img
  Object (IN_USE): [VmDiskMapping] 0004fb00001300005c59a249b51b8b0a
  Object (IN_USE): [VirtualDisk] 0004fb00001200002e5d46bac7b36d88.img

  Job Running Phase at 00:27 on Fri, Sep 23, 2011
  ----------------------------------------------
  Job Participants: [40:cc:00:1e:8c:00:00:1d:ff:b1:00:1e:8c:88:a8:07 (vmserver.pha.com.au)]

  Actioner
  --------
  Starting operation 'Virtual Machine Start' on object '0004fb0000060000f6fd26bb00d0df85 (Ora11G)'
  Job Internal Error (Operation)com.oracle.ovm.mgr.api.exception.FailedOperationException:
  OVMAPI_4010E Attempt to send command: dispatch to server: vmserver.pha.com.au   failed.
  OVMAPI_4004E Server Failed Command: dispatch https://?uname?:?pwd?@192.168.100.151:8899/api/1 
    start_vm 0004fb000003000048bebf45f41e4b33 0004fb0000060000f6fd26bb00d0df85,
    Status: org.apache.xmlrpc.XmlRpcException: exceptions.RuntimeError:Command: ['xm', 'create', 
    '/OVS/Repositories/0004fb000003000048bebf45f41e4b33/VirtualMachines/0004fb0000060000f6fd26bb00d0df85/vm.cfg']
  failed (1): Error: Device 0 (vif) could not be connected. Could not find bridge, and none was specified

Note: Network is not properly set up! I missed the point where one needs to put in IP range for VMs to use (192.168.100.160 - 169)!

Did not manage to work out where to do this.

A rough draft - though I would use this as a starting point for the next pass!