The ENCODE Uniform Analysis Pipelines
- Creators
- Hitz, Benjamin C.
- Lee, Jin-Wook
- Jolanki, Otto
- Kagda, Meenakshi S.
- Graham, Keenan
- Sud, Paul
- Gabdank, Idan
- Strattan, J. Seth
- Sloan, Cricket A.
- Dreszer, Timothy
- Rowe, Laurence D.
- Podduturi, Nikhil R.
- Malladi, Venkat S.
- Chan, Esther T.
- Davidson, Jean M.
- Ho, Marcus
- Miyasato, Stuart
- Simison, Matt
- Tanaka, Forrest
- Luo, Yunhai
- Whaling, Ian
- Hong, Eurie L.
- Lee, Brian T.
- Sandstrom, Richard
- Rynes, Eric
- Nelson, Jemma
- Nishida, Andrew
- Ingersoll, Alyssa
- Buckley, Michael
- Frerker, Mark
- Kim, Daniel S.
- Boley, Nathan
- Trout, Diane
- Dobin, Alex
- Rahmanian, Sorena
- Wyman, Dana
- Balderrama-Gutierrez, Gabriela
- Reese, Fairlie
- Durand, Neva C.
- Dudchenko, Olga
- Weisz, David
- Rao, Suhas S. P.
- Blackburn, Alyssa
- Gkountaroulis, Dimos
- Sadr, Mahdi
- Olshansky, Moshe
- Eliaz, Yossi
- Nguyen, Dat
- Bochkov, Ivan
- Shamim, Muhammad Saad
- Mahajan, Ragini
- Aiden, Erez
- Gingeras, Tom
- Heath, Simon
- Hirst, Martin
- James Kent, W.
- Kundaje, Anshul
- Mortazavi, Ali
- Wold, Barbara
- Cherry, J. Michael
Abstract
The Encyclopedia of DNA elements (ENCODE) project is a collaborative effort to create a comprehensive catalog of functional elements in the human genome. The current database comprises more than 19000 functional genomics experiments across more than 1000 cell lines and tissues using a wide array of experimental techniques to study the chromatin structure, regulatory and transcriptional landscape of theHomo sapiensandMus musculusgenomes. All experimental data, metadata, and associated computational analyses created by the ENCODE consortium are submitted to the Data Coordination Center (DCC) for validation, tracking, storage, and distribution to community resources and the scientific community. The ENCODE project has engineered and distributed uniform processing pipelines in order to promote data provenance and reproducibility as well as allow interoperability between genomic resources and other consortia. All data files, reference genome versions, software versions, and parameters used by the pipelines are captured and availableviathe ENCODE Portal. The pipeline code, developed using Docker and Workflow Description Language (WDL;https://openwdl.org/) is publicly available in GitHub, with images available on Dockerhub (https://hub.docker.com), enabling access to a diverse range of biomedical researchers. ENCODE pipelines maintained and used by the DCC can be installed to run on personal computers, local HPC clusters, or in cloud computing environmentsviaCromwell. Access to the pipelines and dataviathe cloud allows small labs the ability to use the data or software without access to institutional compute clusters. Standardization of the computational methodologies for analysis and quality control leads to comparable results from different ENCODE collections - a prerequisite for successful integrative analyses. Database URL: https://www.encodeproject.org/
Additional Information
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license. We wish to thank all participants in the ENCODE Consortium for collaborations that have enhanced the metadata definitions, and the ENCODE Portal users for their useful feedback. Research reported in this publication was supported by the National Human Genome Research Institute of the National Institutes of Health under grant number U24-HG009397. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. All ENCODE primary and processed data are distributed for free via the Amazon Web Services (AWS; https://registry.opendata.aws/encode-project) and the ENCODE portal, https://www.encodeproject.org (a mirror of the data corpus also exists on the Microsoft Azure (https://learn.microsoft.com/en-us/azure/open-datasets/dataset-encode) cloud, courtesy of Microsoft and Terra. The authors have declared no competing interest.Attached Files
Submitted - nihpp-2023.04.04.535623v1.pdf
Supplemental Material - media-1.pdf
Supplemental Material - media-2.pdf
Supplemental Material - media-3.pdf
Supplemental Material - media-4.pdf
Supplemental Material - media-6.pdf
Supplemental Material - media-7.pdf
Updated - media-5.pdf
Files
Name | Size | Download all |
---|---|---|
md5:50073295206bfa3754f9beda820281f2
|
66.5 kB | Preview Download |
md5:89aed15d89927f4c0a42dcd6430c7869
|
56.6 kB | Preview Download |
md5:d6b983989c8a174fbff2b8f4846b266a
|
1.4 MB | Preview Download |
md5:762bea866449f6330a0853475856bcfe
|
51.6 kB | Preview Download |
md5:455dc878f3290150f842e0e517b5a8ee
|
74.9 kB | Preview Download |
md5:9ac21439cf4d57af4601dd2c160dbb7b
|
56.0 kB | Preview Download |
md5:984797e711e18b3d1eecb8dec5764049
|
55.6 kB | Preview Download |
md5:0d40666527dd76d3c55992ec47c1384f
|
44.5 kB | Preview Download |
Additional details
- NIH
- U24 HG009397
- Created
-
2023-07-01Created from EPrint's datestamp field
- Updated
-
2023-07-01Created from EPrint's last_modified field
- Caltech groups
- Division of Biology and Biological Engineering