Croatian web harvesting: architecture of the harvesting system and experiences gained during harvesting process

U okviru suradnje u izgradnji i održavanju Hrvatskoga arhiva weba (HAW; http://haw.nsk.hr) tijekom srpnja i kolovoza 2011. godine Nacionalna i sveučilišna knjižnica (NSK) i Sveučilišni računski centar Sveučilišta u Zagrebu (Srce) proveli su prvo harvestiranje vršne .hr internetske domene. U ovom radu prezentiramo arhitekturu sustava koji je korišten za harvestiranje kao i iskustva stečena tijekom planiranja, provođenja i analize rezultata harvestiranja. Poseban naglasak stavljen je na tehničke izazove s kojima je zajednički tim Srca i NSK bio suočen.As a part of the joined project on development and maintenance of the Croatian Web Archive (HAW; http://haw.nsk.hr) National and university library (NUL) and University computing centre, University of Zagreb (SRCE) have perfomed first harvesting of the Croatian top level internet domain .hr during July and August 2011. In this paper we present the architecture of the harvesting system which has been used and experiences gained through the process of planning, execution and analisys of the results of the harvesting. We put an emphasis on the technical challengnes our team was confronted with