Skip to content
FLUX (Black Forest Labs) · Generative Media

Add trt support for BF16 (#195)

Add trt support for BF16 (#195) * fix interface of `get_sample_input` * save configuration parameters * ae wrapper implemented * fix import * add AEWrapper step * from set_model_to_dtype to prepare_model * fix eval mode during inference * fix clip onnx export. Now it trace ony the needed outputs * fix t5 wrapper * reor