Skip to content

Isotropic Merging

arXiv

alt text

Code Integration

Merge CLIP-ViT-B/32 models on eight image classification tasks using ISO-C, with a scaling factor of 1.5:

fusion_bench \
    fabric.loggers.name=iso_c \
    method=isotropic_merging/iso_c \
    method.scaling_factor=1.5 \
    modelpool=CLIPVisionModelPool/clip-vit-base-patch32_TA8 \
    taskpool=CLIPVisionModelTaskPool/clip-vit-classification_TA8

Merge CLIP-ViT-B/32 models on eight image classification tasks using ISO-CTS, with a scaling factor of 1.5:

fusion_bench \
    fabric.loggers.name=iso_cts \
    method=isotropic_merging/iso_cts \
    method.scaling_factor=1.5 \
    modelpool=CLIPVisionModelPool/clip-vit-base-patch32_TA8 \
    taskpool=CLIPVisionModelTaskPool/clip-vit-classification_TA8