tenzr::CachedExecutable¶

A compiled PJRT executable together with its hash and the shape and dtype descriptors of its inputs and outputs.

#include <jit_cache.h>

Public Functions¶

Public Attributes¶

Public Functions Documentation¶

function ~CachedExecutable¶

~CachedExecutable()

Destroy the wrapped PJRT loaded executable, tolerating a missing runtime API.

Public Attributes Documentation¶

variable hash¶

uint64_t hash {0};

Hash key identifying the compiled graph.

variable executable¶

PJRT_LoadedExecutable * executable {nullptr};

Loaded PJRT executable handle, null until materialized.

variable in_shapes¶

std::vector< Shape > in_shapes;

Path-neutral input descriptor, in executable argument order.

variable in_dtypes¶

std::vector< DType > in_dtypes;

variable out_shapes¶

std::vector< Shape > out_shapes;

Path-neutral output descriptor, in executable output order.

variable out_dtypes¶

std::vector< DType > out_dtypes;