bash - Linux for loop for 2 inputs and 4 outputs -

-

i need write for loop.

input: file01_r1.fastq, file01_r2.fastq. have 100 files e.g., file02_r1.fastq, file02_r2.fastq , on.

output: file01_r1_pe.fastq, file01_r1_se.fastq, file01_r2_pe.fastq, file01_r2_se.fastq

i need write loop can run executable 100 files. please!

i assume given file 

file01_r1.fastq

you want run:

trimmomatic file01_r1.fastq file01_r2.fastq -o file01_r1_pe.fastq file01_r1_se.fastq file01_r2_pe.fastq file01_r2_se.fastq

using gnu parallel looks this:

parallel trimmomatic {} {= s/_r1/_r2/ =} -o {= s/_r1/_r1_pe/ =} {= s/_r1/_r1_se/ =} {= s/_r1/_r2_pe/ =} {= s/_r1/_r2_se/ =} ::: *_r1.fastq

gnu parallel general parallelizer , makes easy run jobs in parallel on same machine or on multiple machines have ssh access to.

if have 32 different jobs want run on 4 cpus, straight forward way parallelize run 8 jobs on each cpu:

simple scheduling

gnu parallel instead spawns new process when 1 finishes - keeping cpus active , saving time:

gnu parallel scheduling

installation

if gnu parallel not packaged distribution, can personal installation, not require root access. can done in 10 seconds doing this:

(wget -o - pi.dk/3 || curl pi.dk/3/ || fetch -o - http://pi.dk/3) | bash

for other installation options see http://git.savannah.gnu.org/cgit/parallel.git/tree/readme

learn more

see more examples: http://www.gnu.org/software/parallel/man.html

watch intro videos: https://www.youtube.com/playlist?list=pl284c9ff2488bc6d1

walk through tutorial: http://www.gnu.org/software/parallel/parallel_tutorial.html

sign email list support: https://lists.gnu.org/mailman/listinfo/parallel


Comments

Post a Comment

Popular posts from this blog

PHP DOM loadHTML() method unusual warning -

-
i had following code works fine on localhost: $document = new domdocument(); $document->loadhtml($p_result); $form = $document->getelementsbytagname('form')->item(0); // code continues using $form variable after same code updated on outside server, loadhtml() failed , issued warning. warning: domdocument::loadhtml() expects parameter 1 valid path, string given in path/name/to/script.php returned null instead of object code pretty gets fatal error. note contents of $p_result absolutely same on outside server , on localhost. but why displays kind of warning , why not work? doesn't loadhtml() expects argument 1 string in first place? why method expects parameter 1 valid path ? just make clear i'm not calling loadhtmlfile() , i'm calling loadhtml() . thanks. you're affected one of php bugs . issue present in php 5.6.8 , 5.6.9. have affected php version on server, , bug-free version on localhost. the bug forbids null
Read more

python - How to create jsonb index using GIN on SQLAlchemy? -

-
here's current code creating index jsonb. index("mytable_data_idx_id_key", mytable.data['id'].astext, postgresql_using='gin') but got error. sqlalchemy.exc.programmingerror: (psycopg2.programmingerror) data type text has no default operator class access method "gin" hint: must specify operator class index or define default operator class data type. [sql: "create index event_data_idx_id_key on event using gin ((data ->> 'id'))"] is there way create index on sqlalchemy? the postgresql specific sqlalchemy docs @ http://docs.sqlalchemy.org/en/latest/dialects/postgresql.html#operator-classes mention postgresql_ops dictionary provide "operator class" used postgresql, , provide example illustrating use: index('my_index', my_table.c.id, my_table.c.data, postgresql_ops={ 'data': 'text_pattern_ops',
Read more

c# - TransactionScope not rolling back although no complete() is called -

-
i'm using transactionscope rollback transaction fail bool errorreported = false; action<importerrorlog> newerrorcallback = e => { errorreported = true; errorcallback(e); }; using (var transaction = new transactionscope()) { foreach (importtaskdefinition task in taskdefinition) { loader.load(streamfile, newerrorcallback, task.destinationtable, processingtaskid); } if (!errorreported) transaction.complete(); } i'm sure there no transactionscope started ahead or after code. i'm using entity framework insert in db. regardless state of errorreported transaction never rolled in case of error. what missing ? transactionscope sets transaction.current . that's does. wants transacted must @ property. i believe ef each time connection opened reason. probably, connection open when scope installed. open connection inside of scope or enlist manually. ef has nasty "design decision": default opens
Read more