python - Checking the language of extracted trends from twitter -

-

i extracting top hashtags twitter using tweepy module in python. there 1 major problem face, wish check if tag in english or not. tags not in english should removed.

example:

tags=['askorange','charlestonshooting','replytoasong','uberlive','otecmatkasyn']

should not have otecmatkasyn.

what need use language detector api. 1 one offered google, not free. option language detection api.

after choose best api you, you'd need parse text makes sense sentence. example, tag 'askorange' must split read 'ask orange'. can iterate on each character of string, check if uppercase , insert space there:

new_tags = [] tag in tags:     new_word = tag     uppercases = 0 # in case sentence has several uppercases     in xrange(1, len(tag)):         if tag[i].istitle():             new_word = new_word[:i+uppercases] + ' ' + new_word[i+uppercases:]             uppercases = uppercases + 1     new_tags.append(new_word)

finally, send list of new_tags api detect language.


Comments

Post a Comment

Popular posts from this blog

swift - How to change text of a button with a segmented controller? -

-
i have button links view control. trying change text of button segmented control. using jared davidson tutorial on segmented controls changing text of labels . how change text of button? also, when attempted japanese characters, got error on line: "invalid character in source file". thank you! you can change button title japanese characters way: yourbutton.settitle("ボタンのタイトル", forstate: uicontrolstate.normal)
Read more

python - How to create jsonb index using GIN on SQLAlchemy? -

-
here's current code creating index jsonb. index("mytable_data_idx_id_key", mytable.data['id'].astext, postgresql_using='gin') but got error. sqlalchemy.exc.programmingerror: (psycopg2.programmingerror) data type text has no default operator class access method "gin" hint: must specify operator class index or define default operator class data type. [sql: "create index event_data_idx_id_key on event using gin ((data ->> 'id'))"] is there way create index on sqlalchemy? the postgresql specific sqlalchemy docs @ http://docs.sqlalchemy.org/en/latest/dialects/postgresql.html#operator-classes mention postgresql_ops dictionary provide "operator class" used postgresql, , provide example illustrating use: index('my_index', my_table.c.id, my_table.c.data, postgresql_ops={ 'data': 'text_pattern_ops', ...
Read more

PHP DOM loadHTML() method unusual warning -

-
i had following code works fine on localhost: $document = new domdocument(); $document->loadhtml($p_result); $form = $document->getelementsbytagname('form')->item(0); // code continues using $form variable after same code updated on outside server, loadhtml() failed , issued warning. warning: domdocument::loadhtml() expects parameter 1 valid path, string given in path/name/to/script.php returned null instead of object code pretty gets fatal error. note contents of $p_result absolutely same on outside server , on localhost. but why displays kind of warning , why not work? doesn't loadhtml() expects argument 1 string in first place? why method expects parameter 1 valid path ? just make clear i'm not calling loadhtmlfile() , i'm calling loadhtml() . thanks. you're affected one of php bugs . issue present in php 5.6.8 , 5.6.9. have affected php version on server, , bug-free version on localhost. the bug forbids null ...
Read more