Crowdsourcing Formal Decision Making Using Generalized Semantic Games

We are after a Wikipedia for formal scientific knowledge; a crowdsourcing system where the crowd decides whether formal science claims hold. Formal science claims (a.k.a. claims) are expressed as logical statements interpreted in a “rich ” computable structure where several predicates and functions are implemented in a programming language that is more expressive than the logic used for describing the claims. The purpose is to bring formal science knowledge to an ac-tive, objectively refutable form on the web. We call our sys-tem the Scientific Community Game (SCG). Our approach is to use a class of logical game called the Se-mantic Games (SGs, a.k.a. quantifier games, Tarski games or Hintikka games) to ensure that user decisions are well justi-fied. Users must justify their decisions by winning an SG. We describe several configurations for our system but more importantly we describe a novel approach, based on synthetic users, to assess different configurations of our crowdsourcing system