Models

Managers for loading models

construe.models.loaders.load_all_models(model_home=None)

Load all available models as defined by __all__

construe.models.loaders.cleanup_all_models(model_home=None)

Delete everything in the model home directory

construe.models.loaders.load_moondream(model_home=None)

construe.models.loaders.cleanup_moondream(model_home=None, archive='.zip')

construe.models.loaders.load_whisper(model_home=None)

Returns a tflite interpreter with the whisper model and the whisper prepocessor.

construe.models.loaders.cleanup_whisper(model_home=None, archive='.zip')

construe.models.loaders.load_mobilenet(model_home=None)

construe.models.loaders.cleanup_mobilenet(model_home=None, archive='.zip')

construe.models.loaders.load_mobilevit(model_home=None)

construe.models.loaders.cleanup_mobilevit(model_home=None, archive='.zip')

construe.models.loaders.load_nsfw(model_home=None)

construe.models.loaders.cleanup_nsfw(model_home=None, archive='.zip')

construe.models.loaders.load_lowlight(model_home=None)

construe.models.loaders.cleanup_lowlight(model_home=None, archive='.zip')

construe.models.loaders.load_offensive(model_home=None)

construe.models.loaders.cleanup_offensive(model_home=None, archive='.zip')

construe.models.loaders.load_gliner(model_home=None)

construe.models.loaders.cleanup_gliner(model_home=None, archive='.zip')

TFLite

Utilities for model loading and conversion.

class construe.models.tflite.TFLiteGenerateModel(model)

Bases: Module

Defines a model whose serving function is the generation call.

Attributes:

name

Returns the name of this module as passed or determined in the ctor.

name_scope

Returns a tf.name_scope instance for this class.

non_trainable_variables

Sequence of non-trainable variables owned by this module and its submodules.

submodules

Sequence of all sub-modules.

trainable_variables

Sequence of trainable variables owned by this module and its submodules.

variables

Sequence of variables owned by this module and its submodules.

Methods

with_name_scope(method)

Decorator to automatically enter the module name scope.

serving

serving(input_features)

Manifest

Manifest handlers for models

construe.models.manifest.load_manifest(path='/home/runner/work/llm-benchmark/llm-benchmark/llm-benchmark/construe/models/manifest.json')

construe.models.manifest.generate_manifest(fixtures='/home/runner/work/llm-benchmark/llm-benchmark/llm-benchmark/construe/models/fixtures', out='/home/runner/work/llm-benchmark/llm-benchmark/llm-benchmark/construe/models/manifest.json')

Path

Path handling for model downloads

construe.models.path.get_model_home(path=None)

Return the path of the Construe models directory. This folder is used by model loaders to avoid downloading model parameters several times.

By default, this folder is in a config directory in the users home folderso the model can be can be easily located. Alternatively it can be set by the $CONSTRUE_MODELS environment variable, or programmatically by giving a folder path. Note that the '~' symbol is expanded to the user home directory, and environment variables are also expanded when resolving the path.

construe.models.path.find_model_path(model, model_home=None, fname=None, ext=None, raises=True)

Looks up the path to the model specified in the models home directory. The storage location of the models can be set with the $CONSTRUE_MODELS environment variable.

If the model is not found a ModelsError is raised by default.

construe.models.path.model_exists(model, model_home=None, fname=None, ext=None)

Checks to see if the specified model exists in the model home directory.

construe.models.path.model_tflite_exists(model, model_home)

Checks to see if the model .tflite file exists or not.

construe.models.path.model_archive(model, signature, model_home=None, ext='.zip')

Checks to see if the model archive file exists and determines if it is the latest version by comparing the signature specified with the archive signature.

construe.models.path.cleanup_model(model, model_home=None, archive='.zip')