Skip to main content

FilterBatch

WDL source code

Filters poor quality variants and outlier samples. This workflow can be run all at once with the top-level WDL, or it can be run in two steps to enable tuning of outlier filtration cutoffs. The two subworkflows are:

  1. FilterBatchSites: Per-batch variant filtration. Visualize filtered SV counts per sample per type to help choose an IQR cutoff for outlier sample filtering, and preview outlier samples for a given cutoff.

  2. FilterBatchSamples: Per-batch outlier sample filtration; provide an appropriate outlier_cutoff_nIQR based on the SV count plots and outlier previews from step 2. Note that not removing high outliers can result in increased compute cost and a higher false positive rate in later steps.

The following diagram illustrates the recommended invocation order:

Inputs​

batch​

An identifier for the batch. Should match the name used in GatherBatchEvidence.

*_vcf​

Clustered VCFs from ClusterBatch

evidence_metrics​

Metrics table GenerateBatchMetrics

evidence_metrics_common​

Common variant metrics table GenerateBatchMetrics

outlier_cutoff_nIQR​

Defines outlier sample cutoffs based on variant counts. Samples deviating from the batch median count by more than the given multiple of the interquartile range are hard filtered from the VCF. Recommended range is between 3 and 9 depending on desired sensitivity (higher is less stringent), or disable with 10000.

Optional outlier_cutoff_table​

A cutoff table to set permissible nIQR ranges for each SVTYPE. If provided, overrides outlier_cutoff_nIQR. Expected columns are: algorithm, svtype, lower_cuff, higher_cff. See the outlier_cutoff_table resource in this json for an example table.

Outputs​

filtered_depth_vcf​

Depth-based CNV caller VCFs after variant and sample filtering.

filtered_pesr_vcf​

PE/SR (non-depth) caller VCFs after variant and sample filtering.

cutoffs​

Variant metric cutoffs for genotyping.

sv_counts​

Array of TSVs containing SV counts for each sample, i.e. sample-svtype-count triplets. Each file corresponds to a different SV caller.

sv_count_plots​

Array of images plotting SV counts stratified by SV type. Each file corresponds to a different SV caller.

outlier_samples_excluded​

Array of sample IDs excluded by outlier analysis.

outlier_samples_excluded_file​

Text file of sample IDs excluded by outlier analysis.

batch_samples_postOutlierExclusion​

Array of remaining sample IDs after outlier exclusion.

batch_samples_postOutlierExclusion_file​

Text file of remaining sample IDs after outlier exclusion.