Cloud Utilities

GCP

Upload models to the google cloud bucket (developers only).

construe.cloud.gcp.upload(name, path, client=None, bucket='construe')[source]: Upload data from source path to a bucket with destination name.

construe.cloud.gcp.connect_storage(credentials=None)[source]: Create a google cloud storage client and connect.

construe.cloud.gcp.find_service_account()[source]

Manifest

Manifest handlers for downloading cloud resources and checking signatures.

construe.cloud.manifest.load_manifest(path)[source]

construe.cloud.manifest.generate_manifest(fixtures, out, upload_type, extra=None)[source]

construe.cloud.manifest.make_fixture_url(fname, upload_type, version=None)[source]

construe.cloud.manifest.make_fixture_path(fname, upload_type, version=None)[source]

construe.cloud.manifest.get_uncompressed_size(path)[source]

Return type:: int

Signature

Computes the signature of downloaded files for hash verification.

construe.cloud.signature.sha256sum(path, blocksize=65536)[source]: Computes the SHA256 signature of a file to verify that the file has not been modified in transit and that it is the correct version of the data.

Downloader

Handle HTTP download requests from content URLs

construe.cloud.download.download_zip(url, out, signature, replace=False, extract=True, progress=True)[source]: Download a zipped file at the given URL saving it to the out directory. Once downloaded, verify the signature to make sure the download hasn’t been tampered with or corrupted. If the file already exists it will be overwritten only if replace=True. If extract=True then the file will be unzipped.