python - ValueError: invalid literal for float(): when inserted substring from "2015-05-21T18:11:55" into dataframe -

-

i have key value pair in json-derived dictionary looks this:

u'local_start_time': u'2015-05-21t18:11:55.000z'

when try insert portion of string dataframe error:

  file "fix_runs_prepare.py", line 63, in <module>     df.set_value(i, name, str(g[name])[0:19])   file "/usr/local/lib/python2.7/dist-packages/pandas/core/frame.py", line 1679, in set_value     engine.set_value(series.values, index, value)   file "pandas/index.pyx", line 118, in pandas.index.indexengine.set_value (pandas/index.c:3382)   file "pandas/index.pyx", line 132, in pandas.index.indexengine.set_value (pandas/index.c:3264)   file "pandas/src/util.pxd", line 60, in util.set_value_at (pandas/index.c:15472) valueerror: invalid literal float(): 2015-05-21t18:11:55

this when inserting using call:

run_info = df['run_info'] in range(len(df['run_info'])):     g = run_info[i]         name in name_list:         if g.get(name):             if name 'local_start_time':                 df.set_value(i, name, str(g[name])[0:19])             else:                 df.set_value(i, name, g[name])

i same error if don't first cast string:

                df.set_value(i, name, g[name][0:19])

on other hand if insert string literal "baloney" not error. think funky going on because string using begins number . that's why tried explicitly casting str() since didn't work i'm out of ideas. else should try?

**addendum here df.head()

                        _id country      id_2  location_fail  no_location  \ 0  55721992afe58716147ed3e8     nan    212508            nan            1 1  55721992afe58716147ed3e9     nan    212508            nan          nan 2  55721992afe58716147ed3ea     nan    212508            nan          nan 3  55721992afe58716147ed3ec     nan    400134              1            1 4  557219d4afe58716147edbd4  poland    513751            nan          nan           run                                           run_info  gender  \ 0  526956965  {u'tagged_users': [], u'hashtags': [], u'feed_...     nan 1  512136570  {u'tagged_users': [], u'hashtags': [], u'feed_...     nan 2  510056284  {u'distance': 0.0, u'playlist': [], u'author':...     nan 3  525398093  {u'motivation': {u'duration': 1.5, u'distance'...     nan 4  477634373  {u'tagged_users': [], u'hashtags': [], u'speed...     nan     weight  height  ...   descent  calories  heart_rate  heart_rate_max  steps  \ 0     nan     nan  ...       nan       nan         nan             nan    nan 1     nan     nan  ...       nan       nan         nan             nan    nan 2     nan     nan  ...       nan       nan         nan             nan    nan 3     nan     nan  ...       nan       nan         nan             nan    nan 4     nan     nan  ...       nan       nan         nan             nan    nan     notes  speed_avg  heart_rate_avg  speed_max  local_start_time 0    nan        nan             nan        nan   nan 1    nan        nan             nan        nan   nan 2    nan        nan             nan        nan   nan 3    nan        nan             nan        nan   nan 4    nan        nan             nan        nan   nan

the problem pandas.dataframe treats datatype of cells object , try infer datatype if don't specify explicitly.

to avoid that, explicitly set datatype of columns want to, using dataframe.astype:

df[[name]] = df[[name]].astype(str) # or df[[name]] = df[[name]].astype(float)

Comments

Post a Comment

Popular posts from this blog

PHP DOM loadHTML() method unusual warning -

-
i had following code works fine on localhost: $document = new domdocument(); $document->loadhtml($p_result); $form = $document->getelementsbytagname('form')->item(0); // code continues using $form variable after same code updated on outside server, loadhtml() failed , issued warning. warning: domdocument::loadhtml() expects parameter 1 valid path, string given in path/name/to/script.php returned null instead of object code pretty gets fatal error. note contents of $p_result absolutely same on outside server , on localhost. but why displays kind of warning , why not work? doesn't loadhtml() expects argument 1 string in first place? why method expects parameter 1 valid path ? just make clear i'm not calling loadhtmlfile() , i'm calling loadhtml() . thanks. you're affected one of php bugs . issue present in php 5.6.8 , 5.6.9. have affected php version on server, , bug-free version on localhost. the bug forbids null
Read more

python - How to create jsonb index using GIN on SQLAlchemy? -

-
here's current code creating index jsonb. index("mytable_data_idx_id_key", mytable.data['id'].astext, postgresql_using='gin') but got error. sqlalchemy.exc.programmingerror: (psycopg2.programmingerror) data type text has no default operator class access method "gin" hint: must specify operator class index or define default operator class data type. [sql: "create index event_data_idx_id_key on event using gin ((data ->> 'id'))"] is there way create index on sqlalchemy? the postgresql specific sqlalchemy docs @ http://docs.sqlalchemy.org/en/latest/dialects/postgresql.html#operator-classes mention postgresql_ops dictionary provide "operator class" used postgresql, , provide example illustrating use: index('my_index', my_table.c.id, my_table.c.data, postgresql_ops={ 'data': 'text_pattern_ops',
Read more

c# - TransactionScope not rolling back although no complete() is called -

-
i'm using transactionscope rollback transaction fail bool errorreported = false; action<importerrorlog> newerrorcallback = e => { errorreported = true; errorcallback(e); }; using (var transaction = new transactionscope()) { foreach (importtaskdefinition task in taskdefinition) { loader.load(streamfile, newerrorcallback, task.destinationtable, processingtaskid); } if (!errorreported) transaction.complete(); } i'm sure there no transactionscope started ahead or after code. i'm using entity framework insert in db. regardless state of errorreported transaction never rolled in case of error. what missing ? transactionscope sets transaction.current . that's does. wants transacted must @ property. i believe ef each time connection opened reason. probably, connection open when scope installed. open connection inside of scope or enlist manually. ef has nasty "design decision": default opens
Read more