Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

 

Section
Column
Panel
In this section:

Table of Contents
maxLevel2

To install SBC on a virtual machine (VM) with PCI pass-through device, you must first create a VM and allocate its resources (for example CPU, memory, and NICs), as well as configure a datastore to contain the SBC operating system and application software.

...

Info
titleNote:
  • The instance is created on Linux Vanilla flavor version 7.0, and the screens listed here may vary in the latest Linux Vanilla flavor versions.
  • Intel I350 Ethernet adapter is recommended for configuring as PCI pass-through device.

 

Configuring Host With PCI Pass-Through Device

You must configure the host system with PCI pass-through device before creating a new SBC SWe instance. 

...

Info
titleNote:

...

You must follow the BIOS settings recommendations for the particular server.  Refer to BIOS Settings Recommendations section for guidance.

To configure the host:

  1. Log onto the host system.
  2. Navigate to the following directory path:

    Code Block
    languagenone
    cd /etc/default/

...

  1. Open the grub file in vi editor.

...

  1. Search for GRUB_CMDLINE_LINUX  or linuxefi/vmlinuz and append the following:

    Code Block
    languagenone
    intel_iommu=on vfio_iommu_type1.allow_unsafe_interrupts=1 pci=realloc
     
    For example:
    GRUB_CMDLINE_LINUX="vconsole.keymap=us crashkernel=auto vconsole.font=latarcyrheb-sun16 rhgb quiet intel_iommu=on vfio_iommu_type1.allow_unsafe_interrupts=1 pci=realloc"
    GRUB_DISABLE_RECOVERY="true"
  2. Save and exit the file.
  3. Enter the following command to update the grub.cfg file:

    Code Block
    languagenone
    grub2-mkconfig --output=/boot/<DIR_PATH>/grub.cfg

...

  1. Info
    titleNote:

    Based on your BIOS settings <DIR_PATH> can either be /efi/EFI/redhat/ or /grub2/. 

      

  2. Enter the following command to reboot the host system.

    Code Block
    languagenone
     reboot
  3. Log onto the host system after reboot.

  4. Enter the following command to verify the grub update:

    Code Block
    # cat /proc/cmdline
     
    - BOOT_IMAGE=/vmlinuz-3.10.0-123.el7.x86_64 root=UUID=9ab5f45b-8b74-4620-ae67-4d48eea55273 ro vconsole.keymap=us crashkernel=auto vconsole.font=latarcyrheb-sun16 rhgb quiet intel_iommu=on vfio_iommu_type1.allow_unsafe_interrupts=1 pci=realloc
  5. Enter the following command to enable VFIO.

    Code Block
    languagenone
     modprobe vfio-pci
  6. Enter the following command to list IOMMU groups with the interfaces.

    Code Block
    languagenone
     find /sys/kernel/iommu_groups/ -type l

    The command executes with the list of IOMMU groups.

    Code Block
    languagenone
    /sys/kernel/iommu_groups/15/devices/0000:0a:00.0
    /sys/kernel/iommu_groups/15/devices/0000:0a:00.1
    /sys/kernel/iommu_groups/16/devices/0000:00:1d.0
    /sys/kernel/iommu_groups/17/devices/0000:00:1e.0
    /sys/kernel/iommu_groups/18/devices/0000:00:1f.0
    /sys/kernel/iommu_groups/18/devices/0000:00:1f.2
    /sys/kernel/iommu_groups/19/devices/0000:02:00.0
    /sys/kernel/iommu_groups/20/devices/0000:03:00.0
    /sys/kernel/iommu_groups/20/devices/0000:03:00.1
  7. Anchor
    step10
    step10
    Enter the following command to list interfaces.

    Code Block
    languagenone
     lspci | grep -i ether

    The command executes listing the interfaces.

    Code Block
    languagenone
    03:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
    03:00.1 Ethernet controller: Broadcom Corporation NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
    03:00.2 Ethernet controller: Broadcom Corporation NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
    03:00.3 Ethernet controller: Broadcom Corporation NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
    0a:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
    0a:00.1 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)

...

  1. Info
    titleNote:

...

  1. Only Intel I350 Ethernet adapter is supported for configuring as PCI pass-through device. 

      

  2. Enter the following command to know the PCI ID of the interface.

    Code Block
    languagenone
    lspci -n -s 0000:<interface_id>
     
    For example, lspci -n -s 0000:0a:00.0

    The command executes to list the PCI ID.

    Code Block
    languagenone
     0a:00.0 0200: 8086:1521 (rev 01)
  3. Anchor
    step12
    step12
    Enter the following command to unbind the interface.

    Code Block
    languagenone
    echo 0000:0a:00.0 >/sys/bus/pci/devices/0000\:0a\:00.0/driver/unbind 
  4. Enter the following command to add this new interface to the VFIO-PCI list.

    Code Block
    languagenone
    echo 8086 1521 > /sys/bus/pci/drivers/vfio-pci/new_id
  5. Repeat steps 10 through 12 to add another interface to the VFIO-PCI list.

Creating an SBC SWe Instance with PCI Pass-Through Device

To install SBC on a virtual machine (VM), first create a VM and allocate resources (such as CPU, memory, and NICs), as well as configure a datastore that contains SBC operating system and application software.

To create a new SBC SWe KVM instance:

...

Info
titleNote:

...

The instance is created on Linux Vanilla flavor version 7.0, and the screens listed here may vary in the latest Linux Vanilla flavor versions. 

 

  1. Perform the following to export the display on your desktop if you are remotely accessing the KVM host system.

    1. Log onto KVM host system through SSH and telnet client such as PuTTY.

       

    2. Enter the following command to export the display:

      Code Block
      languagenone
      export DISPLAY=<system_IP>:0.0

      where <system_IP> is the system IP address where GUI is exported for display.

       

    3. Enter the following command to launch the virtual machine manager (virt manager) on your system.

      Code Block
      languagenone
      virt-manager

...

    1. Info
      titleNote:

      Ensure Xserver is running on the host system to import the display on your desktop. 

...

    1.  The Virtual Machine Manager window displays.

  1. Click New to create a new VM.

    Caption
    0Figure
    1Virtual Machine Manager

    Image Modified


    The Create a new virtual machine window displays.

...

  1. Include Page
    Screenshot_disclaimer
    Screenshot_disclaimer

...

  1. In Step 1 of Create a new virtual machine window:
    1. Enter the name for the virtual machine

...

    1. in the  Name field.

    2. Select Local install media (ISO image or CDROM).
    3. Click Forward.

      Caption
      0Figure
      1Create New Virtual Machine

      Image Modified


      The locate your install media window displays.

       

  1. In Step 2

...

  1. of the Create a new virtual machine window:

    1. Select Use ISO image and click Browse.

      Caption
      0Figure
      1Locate Install Media

      Image Modified


      The Locate ISO media volume window displays.

       

    2. Click Browse Local.

      Caption
      0Figure
      1Locate ISO media volume

      Image Modified


      The Locate ISO media window displays.

       

    3. Navigate to the folder containing the media file; select the ISO file and click Open.

      Caption
      0Figure
      1Locate ISO Media

      Image Modified


      The directory path of the selected ISO is displayed in Use ISO image field.

       

  2. In Step 2

...

  1. of the Create a new virtual machine window: 
    1. Click the OS type drop-down list and select Linux.
    2. Click the Version drop-down list and select Debian Jessie.
    3. Click Forward.

      Caption
      0Figure
      1OS Selection

      Image Modified


      The memory and CPU settings window displays.

       

  2. In Step 3

...

  1. of the Create a new virtual machine window:
    1. In the Memory (RAM) field, enter 17408 MB as the RAM size.
    2. In the CPUs field, enter 4 as the number of vCPUs.
    3. Click Forward.

      Caption
      0Figure
      1Memory and CPU Settings

      Image Modified

      The storage details window displays.

       

  2. In Step 4

...

  1. of the Create a new virtual machine window:
    1. Select the Enable storage for this virtual machine option.

    2. Select the Create a disk image on the computer's hard drive option and enter 100 GB as the hard drive space.

    3. Select the Allocate entire disk now checkbox.
    4. Click Forward.

      Caption
      0Figure
      1VM Storage Information

      Image Modified


      The ready to begin installation window displays.

       

  2. In Step 5

...

  1. of the Create a new virtual machine window:

    1. Select the Customize configuration before install checkbox.

    2. Click Finish.

      Caption
      0Figure
      1VM Installation Information

      Image Modified


      The VM configuration screen displays.

...

    1. Include Page
      Screenshot_disclaimer
      Screenshot_disclaimer

  1. Perform the following steps to configure the VM settings:
    1. In the left pane, click Processor. The corresponding processor options displays.

      1. Click Configuration to expand the section.
      2. Click Copy host CPU configuration.

        Info

        The Model field displays the host CPU configuration running on the host system

...

      1. .

      2. Click Topology to expand the section.
      3. Select Manually set CPU topology checkbox.
      4. In the Sockets field, enter 1 as number of sockets required for the instance.
      5. In the Cores field, enter 

...

      1. 2 as the number of cores required for the instance.
      2. In the Threads field, enter 

...

      1. 2 as the number of threads required for the instance.

      2. Click Apply

        Caption
        0Figure
        1VM Configuration Screen

        Image Modified

...

Note

Minimum four cores are required to load SBC SWe, for more information on CPU pining, see Performance Tuning the VM Instance.

      1. Info
        titleNote:

        Refer to table 5 on For KVM Hypervisor for minimum configuration requirements.  

          

    1. In the left pane, click Disk 1. The corresponding disk options displays.
      1. Click Advanced options to expand the section and select the IDE from the drop-down list as the Disk bus value.

      2. Click Apply.

        Caption
        0Figure
        1Disk Options Information

        Image Modified

    2. In the left pane, click NIC. The corresponding network interface options displays.

      1. Click Source device drop-down list and select a device for MGT interface.

      2. Click Device Model drop-down list and select virtio.
      3. Click Apply.

      4. Click Add Hardware to add a NIC for HA interface.

        Caption
        0Figure
        1Virtual Network Interface

        Image Modified

        The Add New Virtual Hardware window displays.

      5. In the left pane, click Network.
      6. Click the Host device drop-down list and select a device for HA interface.

        Info

        By default, the MAC address for the selected host device is displayed in the MAC address field. Do not uncheck the MAC address checkbox.

      7. Click Device Model drop-down list and select virtio.
      8. Click Finish.

        Caption
        0Figure
        1Adding Networks

        Image Modified

        The new NIC is listed in the left pane. 

      9. Select the new NIC.

      10. Click Source mode drop-down list and select Bridge.

      11. Click Apply.

        Caption
        0Figure
        1Assigning Source Mode

        Image Modified

    3. In the left pane, click Processor. The corresponding processor options displays.
      1. Anchor
        stepdi
        stepdi
        Click Add Hardware.
        Add New Virtual Hardware window displays.
      2. In the left pane, click PCI Host Device. The PCI host devices options displays.
      3. Scroll through the list and select the interface added to the PCI list.
      4. Anchor
        stepdiv
        stepdiv
        Click Finish.

        Caption
        0Figure
        1PCI Device

        Image Modified

        The added PCI device for PKT0 is listed in the left pane.

        Caption
        0Figure
        1Added PCI Device

        Image Modified

      5. Repeat steps 9 (d) [i] through 9 (d) [iv] to add another PCI device for PKT1.

    4. Configure the VM for CPU pinning to optimize performance. Complete the following steps:

      1. Force off the instance.
      2. Complete the CPU pinning procedure
      3. Return to the VM Configuration screen and select Boot Options in the left pane. 

        Caption
        0Figure
        1Boot Options

        Image Added

      4. Update the Boot device order so that IDE CDROM1 is first, followed by VirtIO Disk 1.

      5. Click Apply.

    5. Click Begin Installation.

      Caption
      0Figure
      1Begin SBC SWe Installation

      Image Modified

      The ConnexIP Installer Boot Menu displays.