This paper provides practical operationalizations of criteria for evaluating scientific theories, such as the consistency and falsifiability of theories and the soundness of inferences, that take into account definitions. The precise formulation of these criteria is tailored to the use of automated theorem provers and automated model generators-generic tools from the field of automated reasoning. The use of these criteria is illustrated by applying them to a first order logic representation of a classic organization theory, Thompson's Organizations in Action.