Linux Installation on Intel® Fibre Channel Over Ethernet (FCoE)

SLES 11 FCoE Installation

RHEL 6 FCoE Installation

SLES 11 FCoE Installation

Select FCoE During OS Installation

  1. In Installation Settings, select FCoE Package
  2. Click Details to enter a new window. Select additional installation package
  3. Enter Search tab
  4. In Search box, type "fcoe" and click "Search"
  5. Select Open-fcoe package and click Accept
  6. Click OK for questions to get back to "Installation Settings"

Using Yast

NOTE: If FCoE is installed during OS installation, then this is not required.
  1. Select  Software in the left pane
  2. Select Software Management in the right pane
  3. Type "fcoe" in the search box, then click Search button
  4. "open-fcoe" package will show in right pane
  5. Select "open-fcoe" package, then click Accept
  6. Verify "Automatic Changes" and click OK
  7. Click Install to install OS

Install FCoE Package

Setting up Network Interfaces

After SLES 11 SP1 is operational, perform the following:

  1. Ensure proper enumeration of network interfaces by editing

    /etc/udev/rules.d/70-persistent-net.rules
    (search for "SLES 11 udev rules" for relevant documentation, if needed)

Changes in this file will not take effect until you reboot your system or shutdown all network interfaces and run a udevadm trigger

  1. Verify proper configuration with

ifconfig -a

Configuring LLDPad

Run commands:

service lldpad start
chkconfig lldpad on

Adjust DCB settings on the physical interface to be used for FCoE with these commands:

dcbtool sc ethx dcb on
dcbtool sc ethx app:0 e:1
dcbtool sc ethx pfc e:1 a:1 w:1

Configuring FCoE

Create a configuration file for the VLAN interface. To copy cfg file, run command:

cp /etc/fcoe/cfg-ethx /etc/fcoe/cfg-eth1

Run commands:

service fcoe start
chkconfig fcoe on

FCoE is now installed and ready to use.

  1. Check that vlan interface can obtain FC-ID. Run command

fcoeadm -i

Basic commands

NOTE: "XYZ" is the VLAN ID used in your FCoE switch. The following example uses VLAN 101.

create fcoe interface: fcoeadm -c ethx.XYZ-fcoe
delete fcoe interface: fcoeadm -d ethx.XYZ-fcoe
show interface info: fcoeadm -i
show targets: fcoeadm -t
show LUNs: fcoeadm -l
show help: fcoeadm -h

Manually Create VLAN

Create ifcfg-vlanXYZ script in /etc/sysconfig/network

NOTE: Manually configuring a VLAN is no longer necessary, but the FCoE interface must be "up" so that fcoemon can discover the VLAN on which to pass FCoE traffic. The user can bring the interface "up" manually with ifconfig eth1 up or set the system to bring the interface up during boot by configuring a static address or DHCP.

The following example uses Yast for creating the vlan:

  1. Open YaST and enter Network Devices in the left pane and Network Settings in the right pane
  2. Configure the base adapter on the interface where you intend to set-up your VLAN. Set an IP address or configure the interface for DHCP.
  3. Click "Add", under "Device Type," and select VLAN
  4. Under Configuration Name, enter Vlan name, e.g., 0eth1.101 (101 is VLAN ID). This will create the vlan interface named "vlan0eth1.101"
  5. In next window, under Real Interface for VLAN, ensure that you select the CORRECT interface
  6. You can follow the defaults to completion
A new config file will be generated in /etc/sysconfig/network/. The file name is ifcfg-vlan0eth1.101 in above example.
NOTE: The fipvlan tool (included in the open-fcoe rpm package) can determine what VLANs are visible.
    eg.,

    # fipvlan -a
    Fibre Channel Forwarders Discovered
    interface | VLAN | FCF MAC
    ------------------------------------
    eth1      | 101  | 00:0d:ec:a3:39:00

    Indicates that VLAN 101 is visible on interface eth1. This interface is connected to a Fiber Channel Forwarder whose MAC address is 00:0d:ec:a3:39:00.

    Use fipvlan --help for more details.

RHEL 6 FCoE Installation

In order to install and boot RHEL 6.0 from a remote FCoE LUN the following components are required:

To install RHEL 6.0 to a remote LUN, perform the following:

  1. Configure the Intel FCoE Option ROM.
    NOTE: Option Rom Setup information can be found here.
  2. Start the install from the RHEL 6.0 DVD.
  3. Choose Specialized Storage Devices in the Anaconda menu.
  4. Choose Add Advanced Target, and Add FCoE SAN.
  5. Select the Intel® 82599-based adapter that was configured in step 1.
  6. Wait for the remote LUN list to be populated by Anaconda under the Other SAN devices tab.
  7. Choose the LUN to install to from the Other SAN devices tab.
  8. Proceed with the installation and reboot the system when prompted.

To boot RHEL 6.0 from a remote LUN, do the following:

  1. Configure the Intel FCoE Option Rom to connect to the remote LUN.
  2. Choose the Intel® FCoE Boot option from the BIOS boot menu to be the first in the boot order and reboot the system.
NOTE: Option Rom Setup information can be found here.