In this paper we continue to explore identification of nonlinear systems using the previously proposed concept of model-on-demand. The idea is to estimate the process dynamics locally and on-line using process data stored in a database, and has in earlier contributions proven to be capable to produce results comparable to (or better than) other nonlinear black-box approaches. The modeling part of the method is based on local polynomial modeling ideas. This has several implications on the choice of model structure, which is discussed at length in the paper. It is concluded that the NARX structure should be considered as the default choice in the local polynomial context. Furthermore, it is shown that the predictions in some situations can be...