DeclareDesign: a tool to characterize research designs
Graeme Blair, Jasper Cooper, Alexander Coppock and Macartan Humphreys are developing an R package that provides tools to formally characterize research designs, assess their properties, and register them. The key inputs required are an abstract statement of the estimands and estimators as well as the data structure. The outputs include dummy datasets, dummy analyses, and reports on properties of the design such as the power, the expected bias, and the coverage properties of estimators. These in turn can be used to select a design and generate a preregistration design document.
You might be surprised using it to see how simple designs may have fundamental flaws.
Lots more on the DeclareDesign alpha version here, to be be released publicly soon.