Category Openabm

Sort Publications By:


Journal Articles

The Practice of Archiving Model Code of Agent-Based Models

Janssen, M.A.

2017 Journal of Artificial Societies and Social Simulation 20 (1) 2.

 Abstract

To evaluate the concern over the reproducibility of computational science, we reviewed 2367 journal articles on agent-based models published between 1990 and 2014 and documented the public availability of source code. The percentage of publications that make the model code available is about 10%. The percentages are similar for publications that are reportedly dependent on public funding. There are big differences among journals in the public availability of model code and software used. This suggests that the varying social norms and practical convenience around sharing code may explain some of the differences among different sectors of the scientific community.


 

A computational Model Library for publishing model documentation and code

Rollins, N.D., C.M. Barton, S. Bergin, M.A. Janssen and A. Lee

2014  Environmental Modelling and Software 61: 59-64.

 Abstract

We present a repository for disseminating the computational models associated with publications in the social and life sciences. The number of research projects using computational models has been steadily increasing but the resulting publications often lack model code and documentation which hinders replication, verification of results and accumulation of knowledge. We have developed an open repository, the CoMSES Net Computational Model Library, to address this problem. Submissions to the library can be original models accompanying publications or replications of previous studies. Researchers can request that their models undergo a certification process that verifies that the model code successfully compiles and runs and that it follows documentation best practices. Models that pass the certification process are assigned persistent URLs and identifiers. We present the basic components of our repository, discuss our initial experiences with the library, and elaborate on future steps in the development of this cyberinfrastructure.

Keywords: Model archive; Open source; Computational modeling; Documentation; Agent-based modeling


 

Predicting Behavior in New Behavioral Experiments: Outcomes of a Modeling Competition

Janssen, M.A. and N.D. Rollins

2012 Journal of Artificial Societies and Social Simulation 15 (3) 5.

 Abstract

This paper reports the results of the inaugural modeling competition sponsored by the Network for Computational SocioEcological Sciences (CoMSES Network). Competition participants were provided with a dataset collected from human-subjects experiments and were asked to develop an agent-based model that replicated behavioral patterns reflected in the data with the goal of using the model to predict behavioral changes in a slightly modified experimental treatment. The data were collected in a resource foraging experiment in which human subjects moved avatars on a computer screen to harvest tokens in a common pool resource. In the original experiments, on which the competition participants based their models, the subjects possessed full information about the state of the resource and the actions of the other group members sharing the resource. The competition challenged participants to predict what would happen if the experimental subjects had limited vision. Using only the data from the original experiment, participants had to design a model that would predict the behavioral changes that would be observed in the new experiment treatment. We compared the models on their assumptions about speed, direction, and harvesting decisions agents make. All the submitted models underestimated the amount of resources harvested. The best performing model was the simplest model submitted and had the best fit with the original dataset provided.

Keywords: Pattern-Oriented Modeling, Competition, Calibration, Empirical Data, Behavioral Experiments


 

Towards a Community Framework for Agent-based Modeling

Janssen, M.A., C.M. Barton, L.N. Alessa, S. Bergin, and A. Lee

2008 Journal of Artificial Societies and Social Simulation 11: 2(6).

 Abstract

Agent-based modelling has become an increasingly important tool for scholars studying social and social-ecological systems, but there are no community standards on describing, implementing, testing and teaching these tools. This paper reports on the establishment of the Open Agent-Based Modelling Consortium, www.openabm.org, a community effort to foster the agent-based modelling development, communication, and dissemination for research, practice and education.

Keywords: Replication, Documentation Protocol, Software Development, Standardization, Test Beds, Education, Primitives


 

Sort Publications: