The Common Workflow Language (CWL) is an informal, multi-vendor working group consisting of various organizations and individuals that have an interest in portability of data analysis workflows. Our goal is to create specifications that enable data scientists to describe analysis tools and workflows that are powerful, easy to use, portable, and support reproducibility.
CWL builds on technologies such as JSON-LD
for data modeling and Docker for portable runtime
environments.
CWL is designed to express workflows for data-intensive science, such as Bioinformatics, Medical Imaging, Chemistry, Physics, and Astronomy.
User guide for the current stable specification (v1.0), provides a gentle introduction to writing CWL command line tool and workflow descriptions.
The current stable specification is v1.0:
Older drafts: draft-1, draft-2, draft-3
Please cite https://dx.doi.org/10.6084/m9.figshare.3115156.v2
Some of the software supporting running Common Workflow Language tools or workflows:
- cwltool (reference implementation), cwltool wiki page
- Rabix, Rabix wiki page
- Arvados, Arvados wiki page
- Galaxy, Galaxy wiki page
- Parallel Recipes, Parallel Recipes wiki page
- Toil, Toil wiki page
- CancerCollaboratory, CancerCollaboratory wiki page
- Airflow (SciDAP), Airflow wiki page
- cwl2script, cwl2script page
- Apache Taverna, Apache Taverna wiki page
We continuously run the CWL conformance tests on several implementations:
Github repository of example tools and workflows.
The best place to ask a question about all things CWL is on Biostars.
There is a Jenkins server maintained by Curoverse that runs tests for the reference implementation, builds and uploads packages, and builds and uploads Docker images:
https://ci.curoverse.com/job/common-workflow-language/
Current build status:
If you are interested in learning more or contributing ideas or code, come chat with us on Gitter, check out #CommonWL on Twitter, join the mailing list common-workflow-language on Google Groups or fork the repository and send a pull request!
Your CWL Community Engineer, Michael R. Crusoe, publishes a blog about his work with updates at http://mrc.commonwl.org.
The CWL Project is dedicated to providing a harassment-free experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, age, race, or religion. We do not tolerate harassment of participants in any form.
This code of conduct applies to all CWL Project spaces, including the Google Group, the Gitter chat room, the Google Hangouts chats, both online and off. Anyone who violates this code of conduct may be sanctioned or expelled from these spaces at the discretion of the leadership team.
For more details, see our Code of Conduct
- Curoverse
- Seven Bridges Genomics
- Galaxy Project
- Apache Taverna
- Institut Pasteur
- Wellcome Trust Sanger Institute
- University of California Santa Cruz
- Harvard Chan School of Public Health
- Cincinnati Children's Hospital Medical Center
- Broad Institute
- BioDatomics
- Wolfson Wohl Cancer Research Centre
(Alphabetical)
- Peter Amstutz [email protected]
- Robin Andeer [email protected]
- Brad Chapman [email protected]
- John Chilton [email protected]
- Michael R. Crusoe [email protected]
- Roman Valls Guimerà [email protected]
- Guillermo Carrasco Hernandez [email protected]
- Sinisa Ivkovic [email protected]
- Andrey Kartashov [email protected]
- John Kern [email protected]
- Dan Leehr [email protected]
- Hervé Ménager [email protected]
- Maxim Mikheev [email protected]
- Tim Pierce [email protected]
- Josh Randall [email protected]
- Stian Soiland-Reyes [email protected]
- Luka Stojanovic [email protected]
- Nebojša Tijanić [email protected]