Experiences with Locking in a NUMA Multiprocessor Operating System Kernel

We describe the locking architecture of a new operating system, HURRICANE, designed for large scale shared-memory multiprocessors. Many papers already describe kernel locking techniques, andsome of the techniques we use have been previously described by others. However, our work is novel in the particular combination of techniques used, as well as several of the individual techniques themselves. Moreover, it is the way the techniques work together that is the source of our performance advantages and scalability. Briefly, we use: ffl a hybrid coarse-grain/fine-grain locking strategy that has the low latency and space overhead of a coarsegrain locking strategy while having the high concurrency of a fine-grain locking strategy; ffl replication of data structures to increase access bandwidth and improve concurrency; ffl a clustered kernel that bounds the number of processors that can compete for a lock so as to reduce second order effects such as memory and interconnect contention; ff..