bash - Grep string between two html comments in pages -

-

i have report on how many times css class appears in content of our pages (over 10k pages). trouble is, header , footer contains class, grep returns every single page. (not useful)

so, how grep content?

i have <!-- main content --> , <!-- end content --> comment on every page.

so how grep (do grep?) between comments?

this hosted on linux server, , have access grep, awk , sed.

ideally, report (.txt or .csv) pages , line numbers class shows up, list of pages suffice.

thanks!

the following script performs requested: print files , line numbers css class name occurs:

#!/bin/sh pattern="class=\"([a-za-z0-9_-]* )*$1( [a-za-z0-9_-]*)*\""  awk -v pat="$pattern" '    /<!-- main content -->/ {y=1}    /<!-- end content -->/ {y=0}    y && $0 ~ pat {f[filename] = f[filename]" "fnr;}    end {for (k in f) printf "%s\tlines:%s\n", k,f[k];} ' *.html

save class_find.sh use this:

class_find.sh 'my_class'

where my_class class name want search for.

output:

2.html  lines: 7 9 1.html  lines: 5

some explanation:

  • pattern="class=\"([a-za-z0-9_-]* )*$1( [a-za-z0-9_-]*)*\"" : search class="my_class" or class="others my_class" or class="my_class others"
  • /<!-- main content -->/ {y=1} : when string found, set flag y true, /<!-- end content -->/ {y=0} : set flag y false
  • y && $0 ~ pat {f[filename] = f[filename]" "fnr;} : if flag y true , match class found in current line ($0), save line number associative array f key filename.
  • end {for (k in f) printf "%s\tlines:%s\n", k,f[k];} : after reading files print results in nice format
  • *.html : operate on html files found in current directory

Comments

Post a Comment

Popular posts from this blog

python - How to create jsonb index using GIN on SQLAlchemy? -

-
here's current code creating index jsonb. index("mytable_data_idx_id_key", mytable.data['id'].astext, postgresql_using='gin') but got error. sqlalchemy.exc.programmingerror: (psycopg2.programmingerror) data type text has no default operator class access method "gin" hint: must specify operator class index or define default operator class data type. [sql: "create index event_data_idx_id_key on event using gin ((data ->> 'id'))"] is there way create index on sqlalchemy? the postgresql specific sqlalchemy docs @ http://docs.sqlalchemy.org/en/latest/dialects/postgresql.html#operator-classes mention postgresql_ops dictionary provide "operator class" used postgresql, , provide example illustrating use: index('my_index', my_table.c.id, my_table.c.data, postgresql_ops={ 'data': 'text_pattern_ops', ...
Read more

PHP DOM loadHTML() method unusual warning -

-
i had following code works fine on localhost: $document = new domdocument(); $document->loadhtml($p_result); $form = $document->getelementsbytagname('form')->item(0); // code continues using $form variable after same code updated on outside server, loadhtml() failed , issued warning. warning: domdocument::loadhtml() expects parameter 1 valid path, string given in path/name/to/script.php returned null instead of object code pretty gets fatal error. note contents of $p_result absolutely same on outside server , on localhost. but why displays kind of warning , why not work? doesn't loadhtml() expects argument 1 string in first place? why method expects parameter 1 valid path ? just make clear i'm not calling loadhtmlfile() , i'm calling loadhtml() . thanks. you're affected one of php bugs . issue present in php 5.6.8 , 5.6.9. have affected php version on server, , bug-free version on localhost. the bug forbids null ...
Read more

c# - TransactionScope not rolling back although no complete() is called -

-
i'm using transactionscope rollback transaction fail bool errorreported = false; action<importerrorlog> newerrorcallback = e => { errorreported = true; errorcallback(e); }; using (var transaction = new transactionscope()) { foreach (importtaskdefinition task in taskdefinition) { loader.load(streamfile, newerrorcallback, task.destinationtable, processingtaskid); } if (!errorreported) transaction.complete(); } i'm sure there no transactionscope started ahead or after code. i'm using entity framework insert in db. regardless state of errorreported transaction never rolled in case of error. what missing ? transactionscope sets transaction.current . that's does. wants transacted must @ property. i believe ef each time connection opened reason. probably, connection open when scope installed. open connection inside of scope or enlist manually. ef has nasty "design decision": default opens ...
Read more