HP OpenVMS Systems Documentation
OpenVMS Alpha Partitioning and Galaxy Guide
3.6 System Dump Analyzer (SDA) Support for RADs
The following System Dump Analyzer (SDA) commands have been enhanced to include RAD support.
3.6.1 SHOW RAD
The SDA command SHOW RAD displays:
This command is useful only on hardware platforms that support RADs (for example, AlphaServer GS160 systems). By default, the SHOW RAD command displays the settings of the RAD_SUPPORT system parameter fields.
Displays information on CPUs and memory for the specified RAD.
Displays settings of the RAD_SUPPORT parameter fields and all
Example 1 shows the settings of the RAD_SUPPORT system parameter fields.
Example 2 shows information about the CPUs and memory for RAD 2.
3.6.3 SHOW RMD (Reserved Memory Descriptor)
The SDA command SHOW RMD has been enhanced to indicate the RAD from
which reserved memory has been allocated. If a RAD was not specified
when the reserved memory was allocated, then SDA displays ANY.
The SDA command SHOW PFD has been enhanced to include the /RAD
qualifier. It is analogous to the existing /COLOR qualifier.
On a system that supports RADs, the set of CPUs to which you affinitize a process should be in the same RAD. For example, on an AlphaServer GS160 with CPUs 0,1,2,3 in RAD 0 and with CPUs 4,5,6,7 in RAD 1, SET=2,3,4,5 would not be a good choice because half of the time you could be executing off your home RAD.
When you have the firmware, you can:
This chapter describes how to create an OpenVMS Galaxy computing
environment on an AlphaServer 8400.
5.1 Step 1: Choose a Configuration and Determine Hardware Requirements
9 slots for:
I/O modules (of type KFTIA or KFTHA)
Processor modules (2 CPUs per module)
Console line for each partition:
Standard UART for first partition
KFE72-DA for each additional partition
Must have an I/O module per partition.
Maximum of 3 I/O modules.
Must have at least one CPU module per partition.
2 partitions, 8 CPUs, 12 GB memory
9 slots allocated as follows:2 I/O modules
4 Processor modules (2 CPUs each)
3 Memory modules (4 GB each)
3 partitions, 8 CPUs, 8 GB memory
9 slots allocated as follows:3 I/O modules
4 Processor modules (2 CPUs each)
2 Memory modules (4 GB each)
5.2 Step 2: Set Up Hardware
When you have acquired the necessary hardware for your configuration,
follow the procedures in this section to assemble it.
5.2.1 Overview of KFE72-DA Console Subsystem Hardware
The AlphaServer 8400 provides a standard built-in UART, which is used as the console line for the primary Galaxy instance. The console for each additional instance requires a KFE72-DA console subsystem, which is the set of EISA-bus modules that establishes an additional console port.
Note that the AlphaServer 8400 supports a maximum of three I/O modules. Attempting to configure more than three is unsupported.
Each separate KFE72-DA subsystem must be installed in a separate DWLPB card cage with a hose connecting it to a separate I/O module of type KFTIA or KFTHA.
All KFTIA I/O modules must be installed first, starting at slot 8. Any KFTHA I/O modules must follow the KFTIA modules, using the consecutively lower-numbered slots.
You can use any combination of these two I/O modules as long as you follow this slot assignment rule.
When configuring a console subsystem, the I/O hose connecting the I/O module and DWLPB card cage must be plugged into the lowest hose port. Not just the lowest available hose port, but the absolute first hose port; the one closest to the top of the module.
The KFE72-DA contains three EISA modules that provide:
To install these modules, follow the procedures in Section 126.96.36.199 to
Section 188.8.131.52, which supplement the installation procedures for KFE72-DA
modules in Chapter 5 of the KFE72 Installation Guide.
184.108.40.206 Slide the PCI Card Cage Out
Follow procedures in Section 5.2.1 in the KFE72 Installation
220.127.116.11 Insert Modules and Connect Ribbon Cables
When installing PCI modules, be sure the option bulkheads mate with the EMI gasket on the PCI card cage.
KFE72-DA modules must occupy slots 0, 1, and 2 of the DWLPB card cage.
To insert the modules in the PCI card cages and connect the appropriate ribbon cables, refer to Figure 5-1 and perform the following steps:
Figure 5-1 Attaching Ribbon Cables
To connect the console terminal and additional devices, refer to Figure 5-2 and connect the console serial line (H8571-J connector) to COM1.
Figure 5-2 Connectors
To return the card cage, follow steps 2 through 9 in the procedure in
Section 5.2.3 of the KFE72 Installation Guide.
5.2.4 Using a Terminal Server
You may want to bring your console lines together using a terminal
server. For example, use a DECserver200 to allow reverse-LAT access to
each console over the network. While this is not strictly required, it
greatly simplifies OpenVMS Galaxy configuration management. Refer to
the appropriate product documentation for details about configuring a
LAT Server or other terminal concentrator.
5.2.5 Installing EISA Devices
Run the ECU as follows:
P00>>> SET ARC_ENABLE ON P00>>> INITIALIZE P00>>> RUN ECU
There are two versions of the ECU, one that runs on a graphics terminal and another that runs on character-cell terminals. Both versions are on the diskette, and the console determines which one to run. For OpenVMS Galaxy systems, the primary console will always be a serial device with a character cell terminal.
If the ECU is not run, OpenVMS will display the following message:
%SYSTEM-I-NOCONFIGDATA, IRQ Configuration data for EISA slot xxx was not found, please run the ECU and reboot.
If you ignore this message, the system will boot, but the plug-in EISA devices will be ignored.
Once you have configured and set up the OpenVMS Galaxy hardware as
described in the previous sections, perform the following steps to
install and boot OpenVMS Galaxy instances.
5.3 Step 3: Create System Disk
A new SECURITY.EXE is required for all cluster members running a
version prior to OpenVMS Version 7.1-2 that share the same
VMS$OBJECTS.DAT file with Galaxy instances.
5.4 Step 4: Install OpenVMS Alpha Version 7.3
No special installation procedures are required to run OpenVMS Galaxy software. Galaxy functionality is included in the base operating system and can be enabled or disabled using the console command and system parameter values described later in this chapter.
For more information about installing the OpenVMS Alpha operating
system, see the OpenVMS Alpha Version 7.3 Upgrade and Installation Manual.
5.4.1 OpenVMS Galaxy Licensing Information
See OpenVMS License Management Utility Manual.
5.5 Step 5: Upgrade the Firmware
Creating an OpenVMS Galaxy environment on an AlphaServer 8400 requires a firmware upgrade to each processor module. If you use these modules again in a non-Galaxy configuration, you will need to reinstall the previous firmware. It is a good practice to have a current firmware CD on hand.
It saves some time if you install ALL processor modules you intend to use and update them at the same time. The AlphaServer 8400 requires that you use the same firmware on all processor boards. If you need to upgrade a board at a later time, you must:
To upgrade your firmware, the system must be powered on, running in non-Galaxy mode (that is, the lp_count console environment variable---if you have established it---must be set to zero).
To set the console environment variable, use the following commands:
P00>>> SET LP_COUNT 0 P00>>> INIT
To upgrade the firmware, use the standard console firmware update
available from AlphaServers Engineering.
5.6 Step 6: Set Environment Variables
When you have upgraded the firmware on all of your processor modules, you can create the Galaxy-specific environment variables as shown in the following example. This example assumes you are configuring a 2-instance, 8 CPU, 1 GB OpenVMS Galaxy computing environment.
P00>>> create -nv lp_count 2 P00>>> create -nv lp_cpu_mask0 1 P00>>> create -nv lp_cpu_mask1 fe P00>>> create -nv lp_io_mask0 100 P00>>> create -nv lp_io_mask1 80 P00>>> create -nv lp_mem_size0 10000000 P00>>> create -nv lp_mem_size1 10000000 P00>>> create -nv lp_shared_mem_size 20000000 P00>>> init
Once you create these variables, you can use console SET commands to manipulate them. These variables need only be created on processor 0.
The following descriptions give detailed information about each environment variable.
If set to zero, the system will boot a traditional SMP configuration only. Galaxy console mode is OFF.
If set to a nonzero value, the Galaxy features will be used, and the Galaxy variables will be interpreted. The exact value of LP_COUNT represents the number of Galaxy partitions the console should expect. Currently, this number must be 0, 2, or 3.
Note that if you assign resources for three partitions and set this variable to two, the remaining resources will be left unassigned. Unassigned CPUs will be assigned to partition 0. You may also create the variables for the maximum number of partitions ahead of time and simply not assign resources to them (set them to nonzero values) until needed.
This bit-mask determines which CPUs are to be initially assigned to the specified Galaxy partition number. The AlphaServer 8400 console chooses the first even-numbered CPU in a partition as its primary CPU, beginning with CPU 0 for the initial instance. Keep this in mind when assigning the resources. (In other words, do not assign only an odd-numbered CPU to a partition.)
These variables assign I/O modules by slot number to each instance:
These are the only valid assignments for the AlphaServer 8400.
You can assign more than one I/O module to an instance using these masks, but each Galaxy instance requires at least one I/O module.
These variables allocate a specific amount of private memory for the specified instance. It is imperative that you create these variables using proper values for the amount of memory in your system and the desired assignments for each instance. Refer to Table B-1 for common values.
See also the shared memory variable on the following line.
This variable allocates memory for use as shared memory. Refer to Appendix B for common values.
Shared memory must be assigned in multiples of 8 MB and all values are expressed in hexadecimal bytes.
You can define only the amount of shared memory to use, and leave the other LP_MEM_SIZE variables undefined. This will cause the console to allocate the shared memory from the high address space, and to split the remaining memory equally among the number of partitions specified by the LP_COUNT variable. If you also explicitly assign memory to a specific partition using a LP_MEM_SIZE variable, but you leave other partition memory assignments undefined, the console will again assign the memory fragments for shared memory and any partitions with explicit assignments, and will then split and assign the remaining memory to any remaining partitions not having explicit memory assignments.
You should set these variables on each of your Galaxy consoles prior to booting to ensure that AUTOGEN reboots correctly when it needs to reboot the system after an initial installation and after a system failure or operator-requested reboot.
P00>>> SHOW LP* lp_count 2 lp_shared_mem_size 20000000 (512 MB) lp_mem_size0 10000000 (256 MB) lp_mem_size1 10000000 (256 MB) lp_cpu_mask0 1 (CPU 0) lp_cpu_mask1 fe (CPUs 1-7) lp_io_mask0 100 (I/O module in slot 8) lp_io_mask1 80 (I/O module in slot 7) P00>>
If the KFE72-DA was ever configured for Windows NT, it probably expects to find the video board and will hang if one is not present. This is a common occurrence when configuring an OpenVMS Galaxy. A console command can be used to set the mode of operation as follows:
P00>>> SET CONSOLE SERIAL
When you issue this command to the primary console prior to initializing the secondary consoles, the setting will be propagated to the secondary console hardware.
If you decide to use the Ethernet port, you may need to inform the console of which media type and connection you intend to use: AUI, UDP, or Twisted Pair. The console and operating system will determine which to use, but you can assign a specific media type using the following commands:
P00>>> SHOW NETWORK P00>>> SET EWA0_MODE TWISTED
The first command displays a list of available network devices. The second command establishes the default media type for the specified device (EWA0 in this example). This should be done for all Ethernet devices prior to initializing the secondary consoles.
Once you have set your console mode and network media types (if used) you should reinitialize the system to ensure that the current settings are saved. If you have already defined your Galaxy partitions, you can initialize now. If you have not defined your Galaxy partitions, you should defer initialization until later.
If you are ready to initialize the system, enter:
You should see the primary console respond with its usual power-up self-test (POST) report. This could take up to 2 minutes. If you have properly defined the Galaxy partitions, only the I/O devices associated with the primary partition will be visible.
To verify that partitioning has occurred, enter:
P00>>> SHOW DEVICE or P00>>> SHOW NETWORK
To initialize the secondary console, enter:
The console displays the following:
Partition 0: Primary CPU = 0 Partition 1: Primary CPU = 2 Partition 0: Memory Base = 000000000 Size = 010000000 Partition 1: Memory Base = 010000000 Size = 010000000 Shared Memory Base = 020000000 Size = 010000000 LP Configuration Tree = 12c000 starting cpu 1 in Partition 1 at address 01000c001 starting cpu 2 in Partition 1 at address 01000c001 starting cpu 3 in Partition 1 at address 01000c001 starting cpu 4 in Partition 1 at address 01000c001 starting cpu 5 in Partition 1 at address 01000c001 starting cpu 6 in Partition 1 at address 01000c001 starting cpu 7 in Partition 1 at address 01000c001 P00>>>
This command must be entered from the primary Galaxy console. If the Galaxy partitions have been properly defined, and hardware resources have been properly configured, you should see the primary console start the processors assigned to each secondary partition. Each of the secondary consoles should initialize within about 2 minutes.
If one or more consoles fails to initialize, you should double-check your hardware installation, Galaxy partition definitions, and hardware assignments.
For more information about OpenVMS console restrictions and hints, see Chapter 11.