Software lockout

In multiprocessor computer systems, software lockout is the issue of performance degradation due to the idle wait times spent by the CPUs in kernel-level critical sections. Software lockout is the major cause of scalability degradation in a multiprocessor system, posing a limit on the maximum useful number of processors. To mitigate the phenomenon, the kernel must be designed to have its critical sections as short as possible, therefore decomposing each data structure in smaller substructures.

Kernel-level critical sections

In most multiprocessor systems, each processor schedules and controls itself, therefore there's no "supervisor" processor, and kernel data structures are globally shared critical sections. This design choice is made to improve scaling, reliability and modularity. Examples of such kernel data structure are ready list and communication channels.

A "conflict" happens when more than one processor is trying to access the same resource (a memory portion) at the same time. To prevent critical races and inconsistency, only one processor (CPU) at a given time is allowed to access a particular data structure (a memory portion), while other CPUs trying to access at the same time are locked-out, waiting in idle status.Madnick 1968, p.19] [Saltzer, Jerome " [http://stinet.dtic.mil/oai/oai?&verb=getRecord&metadataPrefix=html&identifier=AD0635966 Traffic control in a multiplexed computer system] " MIT Project MAC MAC-TR-30 June 1966]

Three cases can be distinguished when this idle wait is (1) necessary (2) convenient and (3) not convenient. The idle wait is necessary when the access is to a ready list for a low level scheduling operation. The idle wait is not necessary but convenient in the case of a critical section for a synchronization/IPC operations, which require less time than a context switch (executing another process to avoid idle wait). Idle wait is instead not convenient in case of a kernel critical section for device management, present in monolithic kernels only. A microkernel instead falls on just the first two of the above cases.

In a multiprocessor system, most of the conflicts are kernel-level conflicts, due to the access to the kernel level critical sections, and thus the idle wait periods generated by them have a major impact in performance degradation. This idle wait time decrease the average number of idle processors and thus scalability and relative efficiency.

Analytical studies

Taking as parameters the average time interval spent by a processor in kernel level critical sections ("L", for time in locked state), and the average time interval spent by a processor in tasks outside critical sections ("E"), the ratio "L/E" is crucial in evaluating software lockout.

Typical values for "L/E" range from 0.01 to 0.1. In a system with a "L/E" ratio of 0.05, for instance, if there are 15 CPUs, it is expected that on average 1 CPU will always be idle.Madnick 1968, p.20] ; with 21 CPUs, 2.8 will be idle;Raynor 76, p.62] with 40 CPUs, 19 will be idle; with 41 CPUs, 20 will be idle. Therefore adding more than 40 CPUs to that system would be useless. In general, for each "L/E" value, there's a threshold for the maximum number of useful CPUs.

oftware lockout mitigation

To reduce the performance degradation of software lockout to reasonable levels ("L/E" between 0.05 and 0.1), the kernel and/or the operating system must be designed accordingly. Conceptually, the most valid solution is to decompose each kernel data structure in smaller independent substructures, having each a shorter elaboration time. This allows more than one CPU to access the original data structure.

Many uniprocessor systems with hierarchical protection domains, have been estimated to spend up to 50% of the time performing "supervisor mode" operations. If such systems were adapted for multiprocessing by setting a lock at any access to "supervisor state", "L/E" would easily be greater than 1, resulting in a system with the same bandwidth of the uniprocessor despite the number of CPUs.

Notes

Bibliography

* [http://web.mit.edu/smadnick/www/Resume/Publications.htm Madnick, Stuart Elliot] [http://www.lecgcp.com/resources/documents/Madnick_LECG_CV_08_2006.pdf] (1968) " [http://doi.acm.org/10.1145/800186.810561 Multi-processor software lockout] " [http://web.mit.edu/smadnick/www/papers/P001.pdf] Proceedings of the 1968 23rd ACM national conference, pp. 19 - 24
*M Dubois, F Briggs " [http://doi.ieeecomputersociety.org/10.1109/12.102830 The run-time efficiency of parallel asynchronous algorithms] " IEEE Transactions on Computers, November 1991 (Vol. 40, No. 11) pp. 1260-1266
*Randy J. Raynor, John M. Gwynn, Jr." [http://doi.acm.org/10.1145/1013610.807300 Minimization of supervisor conflict for multiprocessor computer systems] " ACM SIGSIM Simulation Digest. Volume 7 , Issue 4 (July 1976). pp.61 - 69

Further reading:
*Rodgers, David P. (1985) " [http://portal.acm.org/citation.cfm?id=327215 Improvements in multiprocessor system design] " ACM SIGARCH Computer Architecture News archive Volume 13 , Issue 3 (June 1985) table of contents Special Issue: Proceedings of the 12th annual International Symposium on Computer Architecture (ISCA '85) Pages: 225 - 231 Year of Publication: 1985 ISSN:0163-5964. Also published in International Symposium on Computer Architecture, Proceedings of the 12th annual international symposium on Computer architecture, 1985 , Boston, Massachusetts, United States

ee also

*Amdahl's law
*Dependency issues on Superscalar architectures
*Lockout (telecommunication)
*Concurrency control#Concurrency_control_mechanism
*Schedule (computer_science)#Serializable
*Serializability

External links

*J. Cordsen, W. Schroder-Preikschat " [ftp://ftp.gmd.de/GMD/peace/ScalableOSDesign.ps.gz Towards a Scalable Kernel Architecture] " [http://66.102.1.104/scholar?hl=en&lr=&safe=off&q=cache:lhotESB32V0J:ftp://ftp.gmd.de/GMD/peace/ScalableOSDesign.ps.gz+compilation+kernel+architecture] In Proceedings of the Autumn 1992 Openforum Technical Conference. pp. 15{33, Utrecht, The Netherlands, November 23{27, 1992.