Linux on System z

History of IBM mainframe operating systems

On early mainframe computers: GM OS & GM-NAA I/O 1955 BESYS 1957 UMES 1958 SOS 1959 IBSYS 1960 CTSS 1961 On S/360 and successors: BOS/360 1965 TOS/360 1965 TSS/360 1967 MTS 1967 ORVYL 1967 MUSIC 1972 MUSIC/SP 1985

DOS/360 and successors 1966 DOS/VS 1972 DOS/VSE 1980s VSE/SP late 1980s VSE/ESA 1991 z/VSE 2005

OS/360 and successors 1966 MFT 1966 MFT II 1968 OS/VS1 1972 OS/VS1 BPE MVT 1967 65MP OS/VS2R1 (SVS) 1972 MVS (OS/VS2R2 and later) 1974 MVS/SE 1978 MVS/SE 2 1979 MVS/SP Version 1 1980 MVS/XA 1983 MVS/ESA 1988 OS/390 1995 z/OS 2000

VM line CP-40/CMS 1967 CP-67/CMS 1967 VP/CSS 1968 VM/370 1972 VM/BSE (BSEPP) VM/SE (SEPP) VM/SP 1980 VM/XA MA 1984 VM/XA SF 1985 VM/XA SP 1988 VM/ESA 1990 z/VM 2000

TPF line ACP 1967 TPF 1979 z/TPF 2005

UNIX and Unix-like UTS 1981 AIX/370 1990 AIX/ESA 1991 Linux 1999 OpenSolaris 2008 z/OS UNIX System Services

This box: view · talk · edit

Linux on System z is the collective term for the Linux operating system compiled to run on IBM mainframes, especially System z machines. Other terms with the same meaning include Linux on zEnterprise 196, Linux on System z10, Linux on System z9, Linux on zSeries, Linux/390, zLinux, z/Linux, etc.

History

Linux on System z originated as two separate efforts to port Linux to IBM's largest servers. The first effort, the "Bigfoot" project, developed by Linas Vepstas in late 1998 through early 1999, was an independent distribution and has since been abandoned. IBM published a collection of patches and additions to the Linux 2.2.13 kernel on December 18, 1999, to start today's mainline Linux on System z. Formal product announcements quickly followed in 2000, including the Integrated Facility for Linux (IFL) engines. Think Blue Linux was an early mainframe distribution consisting mainly of Red Hat packages added to the IBM kernel. Commercial Linux distributors introduced mainframe editions very quickly after the initial kernel work, and these mainframe versions have now been available for several years.

At the start of IBM's involvement, Linux patches for System z included some object code only (OCO) modules, without source code. However, currently Linux on System z is completely free software under the GNU General Public License.

Market outlook

In their 2005 "hype" report, IT industry analyst firm Gartner cited Linux on System z as arguably the leading driver of Linux's adoption among businesses and governments.^{[citation needed]} The expansion of Linux to the mainframe market has given Linux increased market credibility.

IBM announced in May 2006, that over 1,700 customers run Linux on their mainframes — which is a considerable number in the mainframe market.^{[citation needed]}

IBM currently supports two Linux distributions, Red Hat and Novell SuSE. Other notable Linux on System z distributions are Debian, Gentoo, Slackware, CentOS and Fedora. The Linux kernel architecture designation is "s390" for 31-bit kernels and "s390x" for 64-bit kernels.

Virtualization

Linux is not emulated on a mainframe. It runs as a complete native operating system, like other mainframe operating systems, at full speed using mainframe processor instructions. Thus, in its simplest configuration, a single instance of Linux can technically occupy a whole mainframe. This configuration is uncommon and not often economically sensible. IBM System z servers can run mixed workloads, including numerous other operating systems, through the use of virtualization. Both hardware and software co-evolved over decades to support these workloads.

System z mainframes are capable of multiple levels of virtualization. In the first level of virtualization, a single machine can be divided into as many as 60 logical partitions (LPARs), and each LPAR is a separate virtual machine running a separate operating system (OS). LPARs are implemented in hardware using a feature called PR/SM which can (optionally, typically) dynamically adjust LPAR boundaries according to real-time demands. This hardware feature is always active in modern mainframes, even in the simplest configuration with a single LPAR spanning the entire machine.

Most Linux on System z customers take advantage of an additional virtualization level, z/VM. This is a mainframe OS with a long history, and one of its main functions is a hypervisor, a provider and manager of virtual machines. Operating systems, such as Linux, that run within a z/VM virtual machine are called guests or images. z/VM virtualizes not only processors and memory but also mainframe (ESCON or FICON) disk storage, networking, cryptographic accelerators, and other mainframe resources.

z/VM operates inside an LPAR, like any other mainframe OS. This provides two levels of Linux virtualization: based on hardware, and based on a hardware-assisted hypervisor. Moreover, z/VM can also be a guest of z/VM, creating nested levels of virtualization at any number of levels deep. Nested virtualization has extra overhead, so running z/VM as a guest is primarily used for testing purposes.

Hardware

IFLs (Integrated Facility for Linux) are mainframe processors dedicated to running Linux, either natively or under z/VM. Microcode restricts IFLs from running "traditional" workloads, such as z/OS; they are otherwise identical to other System z processors. z/OS software vendors do not typically charge for IFL capacity, and IFLs are less expensive than general purpose engines (Central Processors, or CPs). Consequently businesses and governments can easily expand their mainframe Linux installations without affecting most of their software license charges. Although Linux can technically operate on both CPs and IFLs, IFLs simply cost less.

Linux on System z is available in both 31-bit and 64-bit versions, with the 31-bit versions rapidly losing favor as z/Architecture mainframes become more prevalent than the earlier ESA/390 generation. The 64-bit distributions can still run 31-bit applications. The Linux 2.6.x kernel added substantial support for mainframe hardware, such as ESCON, FICON, SCSI-attached storage devices, and System z cryptographic accelerators. Also several vendor distributions backported 2.6.x patches to the Linux 2.4.x kernel.

Advantages

Linux on System z gives the flexibility of running Linux with the advantages of mainframe hardware. Using virtualization, numerous smaller servers can be combined onto one mainframe, gaining some benefits of centralization, but allowing specialized servers thanks to virtualization support, which can lower operating costs. IBM mainframes allow transparent use of redundant processor execution steps and integrity checking, which is necessary in the financial services industries. Mainframes typically allow hot-swapping of hardware, such as processors and memory. This swapping is typically transparent to the operating system, allowing routine repairs to be performed without shutting down the system.

When Linux applications access mainframe-based data and applications in CICS, IBM DB2, IMS, and other mainframe subsystems, running on the same physical mainframe, they can utilize HiperSockets – fast, memory-only TCP/IP connections. As compared to TCP/IP over standard network interface cards (NICs, in the mainframe world called Open System Adapters, OSAs), HiperSockets can improve end-user responsiveness (reduce network latency and processing overhead), security (since there's no network connection to intercept), and reliability (since there's no network connection to lose).

Pricing and costs

Linux on System z is not appropriate for small businesses that would have fewer than about 10 distributed Linux servers, although some expensive per-processor licensed software can quickly reduce that rule of thumb. Most software vendors, including IBM, treat the highly virtualized IFLs just like non-virtualized processors on other platforms for licensing purposes. In other words, a single IFL running scores of Linux instances still counts as one "ordinary" CPU, at the same CPU price, for software licensing. Test, development, quality assurance, training, and redundant production server instances can all run on one IFL (or more IFLs, but only if needed for peak demand performance capacity). Thus, beyond some minimum threshold, Linux on System z can quickly become cost-advantageous when factoring in labor and software costs.

The cost equation for Linux on System z is not always well understood and is controversial, and many businesses and governments have difficulty measuring, much less basing decisions on, software, labor, and other costs (such as the costs of outage and security breaches). Acquisition costs are often more visible, and small, non-scalable servers are "cheap." Nonetheless, non-acquisition costs are no less real and are usually far greater than hardware acquisition prices. Also, individual users and departments within larger businesses and governments sometimes have difficulty sharing computing infrastructure (or any other resources, for that matter), citing a loss of control. Server centralization, as Linux on System z provides, might reward cooperation with better service and lower costs, but that's not to say that cooperation is always easily accomplished within a corporate bureaucracy.

Linux on System z also supports less expensive disk storage devices than z/OS because Linux does not require FICON or ESCON attachment, although z/OS may use disk space more efficiently due to hardware-assisted database compression on z/OS. This compression effect is somewhat variable and may be somewhat reduced due to the minimum space allocation requirements for z/OS data sets (a full disk track).

Appropriate workloads

Mainframe characteristics are designed for such business workloads as transaction processing or large database management. Mainframe design emphasizes input/output performance, implemented via channel I/O. Historically, the principle is to offload I/O activities from the CPU as much as possible, and the z/Architecture additionally offloads cryptographic calculations. Mainframes can scale to numerous processors in a single frame, i.e. up to 64 processors in the case of the System z10 EC Model E64, which gives as much as 28.000 MIPS.

On the other hand, mainframes in general, and Linux on System z in particular, do not perform well for single task computations. Examples include most scientific simulations, weather forecasting, and molecular modeling. Supercomputers, including Linux-based supercomputers, excel at these workloads. This distinction has blurred since the introduction of the System z10, a machine based on quad-core 4.4 GHz processors with hardware decimal floating point. In this regard, the System z10 more resembles a supercomputer processor than previous mainframes.

Mainframes do not provide graphics or sound adapters, and are as such ill-suited for digital media editing or computer-aided design (CAD) except perhaps in support roles (e.g. content storage, parts inventories, etc.)

Support

Like all other versions of Linux, Linux on System z is governed by the GPL free software license. Complete Linux on System z source code is available from numerous groups on a free and equal basis, and architectural support is now part of the main Linux kernel effort. IBM assigns several of its programmers to the community effort, but IBM is by no means the only participant.

Most Linux on System z customers, particularly those with business-critical production workloads, purchase a software support contract from commercial Linux vendors such as Novell SuSE or Red Hat. IBM Global Services also offers support contracts, including 24x7 coverage. Some standard Linux software applications are readily available pre-compiled, including popular closed-source enterprise software packages such as WebSphere, DB2 and Oracle databases and applications, SAP R/3, and IBM's Java Developer's Kit (JDK), to name only a few. Nearly every free or open-source software package available for Linux generally is available for Linux on System z, including Apache HTTP Server, Samba software, JBoss, PostgreSQL, MySQL, PHP, Python programming language, Concurrent Versions System (CVS), GNU Compiler Collection (GCC), and Perl, among many others.

Developer resources

Linux software developers certified for System z can appeal to large enterprises and open up additional market opportunity for their products. There are few barriers to doing so as IBM offers a no-charge 30-day Linux on System z "test drive", allowing Linux developers of any size access to a live mainframe Linux guest running under z/VM for compiling and testing software. IBM also offers its Chiphopper program to help developers write and publish cross-platform Linux software. Siebel (now Oracle), for example, used the Chiphopper program to bring its Java-based CRM software to both Linux on System z and z/OS. The official IBM Chiphopper website provides more details about the program. Developers of open source software can make use of a community development system provided by IBM.

The developer resources can be particularly helpful for performance tuning. Performance tuning is particularly important in mainframe environments with large numbers of users. Mainframe customers tend to expect applications which can scale to high numbers of users and transactions, because that's how they use their systems every day. Sloppy programming is less tolerated, although the mainframe operating environment will keep any such programming from degrading other OS instance's performance. Some Linux application programmers do not expect this exceptional focus on code quality that the mainframe culture and mainframe operating environment demand.^{[citation needed]} However, most developers quickly understand and appreciate this phenomenon, and there's a great deal of professional pride among the growing community of developers with Linux on System z experience.^{[citation needed]}

Linux on System z supports Unicode and ASCII just like any other Linux distribution—it is not an EBCDIC-based operating system. There is nothing inherent in z/Architecture that requires EBCDIC. Linux is able to read kernel parameters in EBCDIC, this ability is used in z/VM installations. Even z/OS, for that matter, supports Unicode, ASCII, and EBCDIC. Moving Linux applications to Linux on System z almost always involves just simple recompilation of the source code. The few exceptions might include source code which assumes a particular "endian" byte order or inline machine instructions for a specific processor, although these issues are not unique to Linux on System z, usually easily remedied, and quite rare.

Although programs can be easily cross compiled to z/Architecture binaries on non-mainframe Linux system, at some point such binary is usually tested either on a real mainframe, or at least on an emulated one.

Emulators

There are at least three software-based System z mainframe emulators. FLEX-ES from Fundamental Software is a commercially offered option. The open source Hercules emulator supports Linux on System z (and can even run on Linux on System z itself), but IBM does not license other operating systems such as z/OS to run on Hercules. In 2010, IBM introduced the Rational Developer for System z Unit Test Feature [1] which provides a restricted use execution environment that can run on X86 hardware. IBM's license terms limit use of the Unit Test Feature to certain application development tasks, not including final pre-production compiling or pre-production testing (such as stress testing). The Unit Test Feature includes z/OS (with common middleware) and is also compatible with Linux on System z.

See also

• Comparison of Linux distributions
• OpenSolaris for System z
• Linux on Power
• UNIX System Services
• zIIP
• zAAP
• z/TPF
• z/VSE

References

External links

• Linux on System z
• Linux on z/VM
• Linux on System z developer site
• Linux for S/390 and zSeries community wiki
• linux-390, users mailing list.
• linux-s390, kernel devel mailing list.
• IBM Software for Linux
• IBM Redbooks for Linux on System z technical know-how
• IBM Redbook z/VM and Linux on IBM System z: The Virtualization Cookbook for SLES 11 SP1
• IBM Redbook z/VM and Linux on IBM System z: The Virtualization Cookbook for Red Hat Enterprise Linux 6.0
• Linux Technology Center at IBM
• Porting GCC to the IBM S/390 platform