This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
contributors:team_4_page [2015/05/11 08:31] emfeal [Running ABySS] |
contributors:team_4_page [2015/05/11 09:01] emfeal [Running ABySS] |
||
---|---|---|---|
Line 81: | Line 81: | ||
=====Running ABySS===== | =====Running ABySS===== | ||
- | Running an assembly on the campusrocks cluster, which runs on SGE, requires the use of the qsub command. The use of a shell script allows a convenient and concise way to wrap useful qsub options, environmental variable manipulations, and the executable (abyss-pe) itself in a single executable script. An example script which runs | + | Running an assembly on the campusrocks cluster, which runs on SGE, requires the use of the qsub command. The use of a shell script allows a convenient and concise way to wrap useful qsub options, environmental variable manipulations, and the executable (abyss-pe) itself in a single script. An example script which runs |
- | the parallel-version of ABySS is shown below. | + | the parallel-version of ABySS on the cluster is shown below. |
<code> | <code> | ||
#!/bin/sh | #!/bin/sh | ||
- | # | ||
#$ -N team4 | #$ -N team4 | ||
#$ -cwd | #$ -cwd | ||
Line 93: | Line 92: | ||
#$ -V | #$ -V | ||
#$ -l mem_free=15g | #$ -l mem_free=15g | ||
- | # | ||
ABYSSRUNDIR=/campusdata/BME235/bin | ABYSSRUNDIR=/campusdata/BME235/bin | ||
- | |||
export PATH=$PATH:/opt/openmpi/bin:/campusdata/BME235/bin/ | export PATH=$PATH:/opt/openmpi/bin:/campusdata/BME235/bin/ | ||
export LD_LIBRARY_PATH=/opt/openmpi/lib/:$LD_LIBRARY_PATH | export LD_LIBRARY_PATH=/opt/openmpi/lib/:$LD_LIBRARY_PATH | ||
- | |||
ABYSSRUN=$ABYSSRUNDIR/abyss-pe | ABYSSRUN=$ABYSSRUNDIR/abyss-pe | ||
- | |||
$ABYSSRUN np=10 k=21 name=ecoli in='/campusdata/BME235/programs/abyss-1.5.2/JARED/test-data/reads1.fastq /campusdata/BME235/programs/abyss-1.5.2/JARED/test-data/reads2.fastq' | $ABYSSRUN np=10 k=21 name=ecoli in='/campusdata/BME235/programs/abyss-1.5.2/JARED/test-data/reads1.fastq /campusdata/BME235/programs/abyss-1.5.2/JARED/test-data/reads2.fastq' | ||
</code> | </code> | ||
- | A qsub option of import which is vital to successfully run a parallel ABySS job on the cluster is the use of a parallel environment. The PE designated in the script above: | + | Note that the parallel version of ABySS requires two things in particular: |
+ | * **(1)** The use of a parallel environment which can be selected using a qsub option. | ||
+ | * **(2)** The //np// option of abyss-pe. The number of processes here must reflect the number included in the parallel environment option. | ||
+ | The parallel environment option in the script above: | ||
<code> | <code> | ||
#$ -pe mpi 10 | #$ -pe mpi 10 | ||
</code> | </code> | ||
- | The //-pe// designates the parallel environment qsub option. The //mpi// designates the choice of a parallel environment that is installed on the system. The 10 indicates the number of processes you wish the job to be parallelized over. To see which PE's are installed on the system, use the command: | + | The //mpi// designates the choice of a parallel environment that is installed on the system and the 10 indicates the number of processes over which to run the job. To see which PE's are installed on the system, use the command: |
<code> | <code> | ||
qconf -spl | qconf -spl | ||
</code> | </code> | ||
+ | |||
abyss-pe is a driver script implemented as a Makefile. Any option of make may be used with abyss-pe. Particularly useful options are: | abyss-pe is a driver script implemented as a Makefile. Any option of make may be used with abyss-pe. Particularly useful options are: | ||
<code> | <code> | ||
Line 168: | Line 167: | ||
* konnector: fill the gaps between paired-end reads by building a Bloom filter de Bruijn graph and searching for paths between paired-end reads within the graph | * konnector: fill the gaps between paired-end reads by building a Bloom filter de Bruijn graph and searching for paths between paired-end reads within the graph | ||
* abyss-bloom: construct reusable bloom filter files for input to Konnector | * abyss-bloom: construct reusable bloom filter files for input to Konnector | ||
- | |||
=====ABySS pipeline===== | =====ABySS pipeline===== | ||