User Tools

Site Tools


data_overview:2015:hiseq_sw018_s1

SW018_S1

Sequencing data

Library Run Location Notes
SW018_S1 HiSeq /campusdata/BME235/Spring2015Data/ 2×100, insert size: 597 +/- 93

Files

File Size
SW018_S1_L007_R1_001.fastq 34G
SW018_S1_L007_R2_001.fastq 34G
Undetermined_S0_L007_R1_001.fastq 3.1G
Undetermined_S0_L007_R2_001.fastq 3.1G
bams/SW018_S1_L007_001.bam 21G
adapterAndPCRFreeFiles/SW018_adapterTrimmed_dupRemoved_150424_R1.fastq 33 G
adapterAndPCRFreeFiles/SW018_adapterTrimmed_dupRemoved_150424_R2.fastq 33 G
ErrorCorrected/SW018_seqprep_dupRemoved_ec_R1.fastq 38G
ErrorCorrected/SW018_seqprep_dupRemoved_ec_R2.fastq 38G

Fastqc results

For SW018:

For forward reads: sw018_s1_l007_r1_001.fastq.pdf

For reverse reads: sw018_s1_l007_r2_001.fastq.pdf

Comments

Fastqc indicated several issues with the raw reads: a) the per base sequence content, b) there are overrepresented sequences, which it detects may be the Illumina single end PCR primer 1, and c) there is abnormal k-mer content at the start of many reads.

Preqc (SGA preprocessing) results

Comments

Remarks from Stefan:

The genome size (estimates to be 2.29Gb) is more like what we expected after Kevin's prediction in one of the last courses (2.3159 Gb).

Also the de Bruijn graph stats look reasonable. Apart from the absence of different kmers… which is odd. [I will check why that is so] The graphs usually follow a trend, so if the estimates based on the two kmers plotted are indeed correct, then it looks like there will be low heterozygosity (variant branches in k-de Bruijn graph), a high repeat content (repeat branches in k-de Bruijn graph) - which is expected given the genome size, and a low sequencing error rate (error branches in k-de Bruijn graph).

The “Simulated contig lengths vs k” is very low, as we expect, since this analysis didn't include long insert mate-pair libraries. This statistic will go up once MP's are included.

There seems to be low duplication levels.

The “Mean quality score by position” and the “Fraction of bases at least Q30” show that the reads are pretty high quality. And the “k-mer position of first error” and the “Per-position error rate” show that errors are very infrequent and again, as expected, increase in frequency at the end of the reads

The “Estimated Fragment Size Histogram” estimates one library to around 350bp and the other to around 450bp fragment length.

The “51-mer count distribution” estimates the current coverage to slightly more than 10x, but this statistic often underestimates the real coverage. Based on the number of reads it's probably closer to 20x.

“GC Bias” indicates some bias in the data.

So, overall, it tells us that the genome is quite big (maybe around 2.3Gb), that we definitely need more data (but remember we didn't include all data in this analysis and that there is more data coming) and that the assembly will be very tricky (mostly because of a high repeat content). If you remember my lecture, the presence of many long repeats makes de-novo assembly much harder.

Skewer adapter removal

Fri Apr 17

These data with the adapters removed are located at

/campusdata/BME235/S15_assemblies/SOAPdenovo2/adapterRemovalTask/skewer_run/SW018_S1_L007_better/SW018_S1_L007-trimmed-pair1.fastq

/campusdata/BME235/S15_assemblies/SOAPdenovo2/adapterRemovalTask/skewer_run/SW018_S1_L007_better/SW018_S1_L007-trimmed-pair2.fastq

Fastq to bam

The fastq to bam conversion was performed using the picard toolset. Specifically the fastqToSam.jar file was used to prepare the bam files.

FastqToSam commands

Raw fastq adapter presence analysis

This section contains various notes made when doing a second pass in analyzing the presence of potential adapter sequences in the raw .fastq datasets.

For forward (R1) strands:

  1. SW018_s1_l007_r1_001.fastq fastqc file indicates an overrepresented sequence where a majority of its substring represents the adapter sequence of Oligo ID BO3.P7.part1.F as indicated within the library rep protocol (https://banana-slug.soe.ucsc.edu/_media/meyer_kircher.pdf). A substring of this sequence also overlaps with Ed Greens statement on what the adapter sequence at the end of the forward (R1) reads are (AGATCGGAAGAGCACACGTCTGAACTCCAGTC).
  2. For kmer content, all biased kmers followed certain sequence patters when spliced together as they are ordered in the fastqc plot:
    1. AGATCGGAAGAGC: Resembles multiple adapter sequences of Oligo IDs IS3_adapter.P5+P7, beginning of BO2.P5.R or beginning of BO3.P7.part1.F.
    2. TCTTCCGATCT: Resembles multiple adapter sequences of Oligo IDs at the end of IS1_adapter.P5, the end of IS2_adapter.P7, the end of BO1.P5.F or at the end of BO4.P7.part1.R.

For reverse (R2) strands:

  1. SW018_s1_l007_r2_001.fastq fastqc file indicates an overrepresented sequence where a majority of its substring represents the adapter sequence of Oligo ID BO2.P5.R as indicated within the library rep protocol (https://banana-slug.soe.ucsc.edu/_media/meyer_kircher.pdf). A substring of this sequence also overlaps with Ed Greens statement on what the adapter sequence at the end of the reverse (R2) reads are (AGATCGGAAGAGCGTCGTGTAGGGAAAGAGTG).
  2. For kmer content, all biased kmers followed certain sequence patters when spliced together as they are ordered in the fastqc plot:
    1. AGATCGGAAGAGCGT: Resembles an adapter sequence of Oligo ID at the start of BO2.P5.R.
    2. CTTCCGATCT: Resembles multiple adapter sequences of Oligo IDs at the end of IS1_adapter.P5, the end of IS2_adapter.P7, the end of BO1.P5.F or at the end of BO4.P7.part1.R.
    3. ATCGGAAG: Resembles part of IS3_adapter.P5+P7 or part of BO2.P5.R or part of BO3.P7.part1.F

SeqPrep results

The data files were trimmed using SeqPrep, both with and without merging. The output for the run without merging is in /campusdata/BME235/Spring2015Data/adapter_trimming/SeqPrep and the output for the run with merging is in /campusdata/BME235/Spring2015Data/merging/SeqPrep. For some reason the trimmed R1 and R2 files for the run with merging are strangely small.

The adapters used for both runs were AGATCGGAAGAGCACACGTCTGAACTCCAG (-A option) and AGATCGGAAGAGCGTCGTGTAGGGAAAGAG (-B option).

Merged SW018 Libraries

All SW018 data sets that had been adapter trimmed using Seqprep were merged with Fastuniq to remove duplicates and then error corrected using Musket

You could leave a comment if you were logged in.
data_overview/2015/hiseq_sw018_s1.txt · Last modified: 2015/09/11 20:47 by 68.180.230.228