Scalable online index construction with multi-core cpus

Inverted index is a core element of current text re-trieval systems. They can be dynamically constructed using online indexing approaches in the environment which even a small delay in timeliness cannot be tol-erated, and the index must always be queryable and up to date. Recently, efficient online index construc-tion schemes have been proposed, however, previous works have not focused on scalability with the mod-ern commodity hardware resources such as multi-core CPUs. In this paper, we propose a scalable online index construction method that better utilizes multi-core CPUs. Using experiments on 30 GB of web data, we demonstrate the efficiency of our method in prac-tice, showing that it dramatically reduces online in-dex construction time without sacrificing query per-formance