Explore Workflows

https://github.com/NCBI-Hackathons/Epigenomics_CWL.git

Path: cwl/tools/preprocess.cwl

Branch/Commit ID: master

https://github.com/andurill/ACCESS-Pipeline.git

Path: workflows/QC/qc_workflow.cwl

Branch/Commit ID: master

https://github.com/uc-cdis/genomel_pipelines.git

Path: genomel/cwl/workflows/variant_calling/aws_freebayes.cwl

Branch/Commit ID: master

https://github.com/EBI-Metagenomics/pipeline-v5.git

Path: workflows/subworkflows/assembly/change_formats_and_names.cwl

Branch/Commit ID: master

PCAWG GATK Co-cleaning workflow is developed by the Broad Institute (https://www.broadinstitute.org), it consists of two pre-processing steps for tumor/normal BAM files: indel realignment and base quality score recalibration (BQSR). The workflow has been dockerized and packaged using CWL workflow language, the source code is available on GitHub at: https://github.com/ICGC-TCGA-PanCancer/pcawg-gatk-cocleaning. ## Run the workflow with your own data ### Prepare compute environment and install software packages The workflow has been tested in Ubuntu 16.04 Linux environment with the following hardware and software settings. #### Hardware requirement (assuming 30X coverage whole genome sequence) - CPU core: 16 - Memory: 64GB - Disk space: 1TB #### Software installation - Docker (1.12.6): follow instructions to install Docker https://docs.docker.com/engine/installation - CWL tool ``` pip install cwltool==1.0.20170217172322 ``` ### Prepare input data #### Input aligned tumor / normal BAM files The workflow uses a pair of aligned BAM files as input, one BAM for tumor, the other for normal, both from the same donor. Here we assume file names are *tumor_sample.bam* and *normal_sample.bam*, and are under *bams* subfolder. #### Reference data files The workflow also uses the following files as reference, they can be downloaded from the ICGC Data Portal: - Under https://dcc.icgc.org/releases/PCAWG/reference_data/pcawg-bwa-mem - genome.fa.gz - genome.dict - Under https://dcc.icgc.org/releases/PCAWG/reference_data/pcawg-gatk-cocleaning - 1000G_phase1.indels.hg19.sites.fixed.vcf.gz - Mills_and_1000G_gold_standard.indels.hg19.sites.fixed.vcf.gz - dbsnp_132_b37.leftAligned.vcf.gz We assume the reference files are under *reference* subfolder. #### Job JSON file for CWL Finally, we need to prepare a JSON file with input, reference files specified. Please replace the *tumor_bam* and *normal_bam* parameters with your real BAM files. Name the JSON file: *pcawg-gatk-cocleaning.job.json* ``` { \"tumor_bam\": { \"class\": \"File\", \"location\": \"bams/tumor_sample.bam\" }, \"normal_bam\": { \"class\": \"File\", \"location\": \"bams/normal_sample.bam\" }, \"reference\": { \"class\": \"File\", \"location\": \"reference/genome.fa\" }, \"knownIndels\": [ { \"class\": \"File\", \"location\": \"reference/1000G_phase1.indels.hg19.sites.fixed.vcf.gz\" }, { \"class\": \"File\", \"location\": \"reference/Mills_and_1000G_gold_standard.indels.hg19.sites.fixed.vcf.gz\" } ], \"knownSites\": [ { \"class\": \"File\", \"location\": \"reference/dbsnp_132_b37.leftAligned.vcf.gz\" } ] } ``` ### Run the workflow #### Option 1: Run with CWL tool - Download CWL workflow definition files ``` wget https://github.com/ICGC-TCGA-PanCancer/pcawg-gatk-cocleaning/archive/0.1.1.tar.gz tar xvf pcawg-gatk-cocleaning-0.1.1.tar.gz ``` - Run `cwltool` to execute the workflow ``` nohup cwltool --debug --non-strict pcawg-gatk-cocleaning-0.1.1/gatk-cocleaning-workflow.cwl pcawg-gatk-cocleaning.job.json > pcawg-gatk-cocleaning.log 2>&1 & ``` #### Option 2: Run with the Dockstore CLI See the *Launch with* section below for details.

https://github.com/ICGC-TCGA-PanCancer/pcawg-gatk-cocleaning.git

Path: gatk-cocleaning-workflow.cwl

Branch/Commit ID: 0.1.1

https://github.com/ProteinsWebTeam/ebi-metagenomics-cwl.git

Path: tools/collate_unique_SSU_headers.cwl

Branch/Commit ID: a8abd0e

https://github.com/Marco-Salvi/dtc61.git

Path: WF6101.cwl

Branch/Commit ID: main

\"This workflow performs diamond protein alignment process for predicted protein sequences. It executes 2 processes: diamond index creation and diamond alignment. related CWL file: ./Tools/09_diamond_index.cwl ./Tools/11_diamond_uniprot_alignment.cwl ./Tools/11_diamond_uniprot_filter1.cwl ./Tools/11_diamond_uniprot_filter2.cwl\"

https://github.com/RyoMameda/workflow_cwl.git

Path: Workflow/diamond_protein_ssw.cwl

Branch/Commit ID: main

ATAC-seq 03 mapping - reads: SE

https://github.com/Duke-GCB/GGR-cwl.git

Path: v1.0/ATAC-seq_pipeline/03-map-se.cwl

Branch/Commit ID: v1.0.0

https://github.com/fgomez02/analysis-workflows.git

Path: definitions/subworkflows/pindel_cat.cwl

Branch/Commit ID: No_filters_detect_variants