Choosing Google Cloud Storage object name when uploading a file using Python blobstore API -

-

i migrating blobstore google cloud storage in google app engine python app. use blobstore api when uploading gcs. ok, according gae python documentation regarding blobstore

the flow works storing blobstore. client requests upload url, blobstore.create_upload_url(...) creates it, client uploads file via multipart post, , server redirects upload handler in gae application.

the problem though got choose gcs bucket (it 1 of parameters of create_upload_url call) don't see how can choose file name. break down folders. inspiration comes

google app engine blobstore google cloud storage migration tool filename broken browsing of gcs "folders" manageable.

i know of 1 way of naming gcs file - forego blobstore api. instead client upload file gae handler, use lib.cloudstorage write file data gcs - exacly quoted migration tool does.

i lose gcs goodies retries on errors during upload.

the question: there way upload file directly gcs, while impacting way resulting gcs object named.

repository : https://github.com/voscausa/appengine-gcs-upload

example code first option.

  • where can name bucket object
  • and use signed url access bucket

docs: https://cloud.google.com/storage/docs/reference-methods?hl=bg#postobject

the upload template:

<!doctype html> <html lang="en"> <head>     <meta charset="utf-8">     <title>'gcs_upload'</title> </head> <body>     <form action="http://storage.googleapis.com/{{ form_bucket }}"           method="post" enctype="multipart/form-data">         <input type="text" name="key" value="">         <input type="hidden" name="googleaccessid" value="{{ form_access_id }}">         <input type="hidden" name="acl" value="bucket-owner-read">         <input type="hidden" name="success_action_redirect" value="{{ form_succes_redirect }}">         <input type="hidden" name="policy" value="{{ form_policy }}">         <input type="hidden" name="signature" value="{{ form_signature }}">         <input type="file" name="file">         <input type="submit" value="upload">     </form> </body> </html>

the upload form handler:

class gcsupload(basehandler):      def get(self):          default_bucket = app_identity.get_default_gcs_bucket_name()         google_access_id = app_identity.get_service_account_name()         succes_redirect = 'http://www.example.com/success'         policy_string = """         {"expiration": "2015-06-22t18:11:11z",                   "conditions": [                       ["starts-with", "$key", ""],                       {"acl": "bucket-owner-read"},                       {"success_action_redirect": "%s"},                   ]}""" % succes_redirect          policy = base64.b64encode(policy_string)         _, signature_bytes = app_identity.sign_blob(policy)         signature = base64.b64encode(signature_bytes)          self.render_template('gcs_upload.html', form_bucket=default_bucket, form_succes_redirect=succes_redirect,                              form_access_id=google_access_id, form_signature=signature, form_policy=policy)

Comments

Post a Comment

Popular posts from this blog

PHP DOM loadHTML() method unusual warning -

-
i had following code works fine on localhost: $document = new domdocument(); $document->loadhtml($p_result); $form = $document->getelementsbytagname('form')->item(0); // code continues using $form variable after same code updated on outside server, loadhtml() failed , issued warning. warning: domdocument::loadhtml() expects parameter 1 valid path, string given in path/name/to/script.php returned null instead of object code pretty gets fatal error. note contents of $p_result absolutely same on outside server , on localhost. but why displays kind of warning , why not work? doesn't loadhtml() expects argument 1 string in first place? why method expects parameter 1 valid path ? just make clear i'm not calling loadhtmlfile() , i'm calling loadhtml() . thanks. you're affected one of php bugs . issue present in php 5.6.8 , 5.6.9. have affected php version on server, , bug-free version on localhost. the bug forbids null
Read more

python - How to create jsonb index using GIN on SQLAlchemy? -

-
here's current code creating index jsonb. index("mytable_data_idx_id_key", mytable.data['id'].astext, postgresql_using='gin') but got error. sqlalchemy.exc.programmingerror: (psycopg2.programmingerror) data type text has no default operator class access method "gin" hint: must specify operator class index or define default operator class data type. [sql: "create index event_data_idx_id_key on event using gin ((data ->> 'id'))"] is there way create index on sqlalchemy? the postgresql specific sqlalchemy docs @ http://docs.sqlalchemy.org/en/latest/dialects/postgresql.html#operator-classes mention postgresql_ops dictionary provide "operator class" used postgresql, , provide example illustrating use: index('my_index', my_table.c.id, my_table.c.data, postgresql_ops={ 'data': 'text_pattern_ops',
Read more

c# - TransactionScope not rolling back although no complete() is called -

-
i'm using transactionscope rollback transaction fail bool errorreported = false; action<importerrorlog> newerrorcallback = e => { errorreported = true; errorcallback(e); }; using (var transaction = new transactionscope()) { foreach (importtaskdefinition task in taskdefinition) { loader.load(streamfile, newerrorcallback, task.destinationtable, processingtaskid); } if (!errorreported) transaction.complete(); } i'm sure there no transactionscope started ahead or after code. i'm using entity framework insert in db. regardless state of errorreported transaction never rolled in case of error. what missing ? transactionscope sets transaction.current . that's does. wants transacted must @ property. i believe ef each time connection opened reason. probably, connection open when scope installed. open connection inside of scope or enlist manually. ef has nasty "design decision": default opens
Read more