Giters

M-3LAB / IM-IAD

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

IM-IAD: Industrial Image Anomaly Detection Benchmark in Manufacturing

[Main Page] [Survey] [Benchmark] [Result]

The results of vanilla setting on MVTec AD

Vanilla MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA Image AUC 1.000 0.994 0.999 0.947 0.997 0.996 0.986 0.965 0.985 0.983 0.999 1.000 0.994 0.974 0.888 0.981
Image AP 1.000 0.997 1.000 0.978 0.996 0.999 0.996 0.993 0.996 0.995 1.000 1.000 0.999 0.995 0.959 0.993
Pixel AUC 0.984 0.985 0.934 0.985 0.978 0.932 0.983 0.957 0.985 0.977 0.982 0.991 0.975 0.967 0.957 0.971
Pixel AP 0.726 0.691 0.394 0.484 0.721 0.406 0.580 0.440 0.525 0.317 0.584 0.405 0.802 0.764 0.237 0.538
Pixel PRO 0.931 0.917 0.762 0.868 0.948 0.861 0.933 0.847 0.926 0.928 0.935 0.965 0.896 0.928 0.832 0.898
CSFlow Image AUC 1.000 0.990 0.989 0.939 0.983 0.998 0.996 0.992 1.000 0.983 0.511 1.000 0.988 0.956 0.959 0.952
Image AP 1.000 0.993 0.996 0.977 0.981 1.000 0.999 0.999 1.000 0.994 0.723 1.000 0.997 0.992 0.982 0.975
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
CutPaste Image AUC 0.998 0.962 0.992 0.964 0.945 0.918 0.998 0.724 0.985 0.996 0.980 0.799 0.993 0.908 0.607 0.918
Image AP 0.999 0.975 0.997 0.988 0.928 0.971 0.999 0.933 0.996 0.999 0.979 0.882 0.999 0.983 0.849 0.965
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
DRAEM Image AUC 0.969 0.934 0.961 0.963 1.000 1.000 1.000 0.994 0.968 0.992 1.000 0.997 0.942 0.992 0.997 0.981
Image AP 0.986 0.958 0.992 0.988 1.000 1.000 1.000 0.999 0.994 0.997 1.000 0.999 0.935 0.997 0.999 0.990
Pixel AUC 0.993 0.954 0.940 0.962 0.996 0.995 0.989 0.987 0.976 0.997 0.995 0.981 0.900 0.972 0.986 0.975
Pixel AP 0.897 0.624 0.427 0.638 0.553 0.877 0.690 0.914 0.459 0.705 0.969 0.533 0.513 0.808 0.719 0.689
Pixel PRO 0.964 0.754 0.904 0.920 0.978 0.975 0.968 0.932 0.881 0.970 0.974 0.899 0.810 0.928 0.954 0.921
FastFlow Image AUC 1.000 0.912 0.992 0.875 0.881 0.988 0.961 0.908 0.980 0.978 0.632 1.000 0.881 0.908 0.675 0.905
Image AP 1.000 0.943 0.997 0.945 0.867 0.996 0.987 0.976 0.995 0.993 0.701 1.000 0.968 0.982 0.823 0.945
Pixel AUC 0.980 0.935 0.930 0.961 0.959 0.927 0.975 0.974 0.989 0.981 0.923 0.994 0.927 0.943 0.934 0.955
Pixel AP 0.688 0.276 0.418 0.205 0.539 0.455 0.351 0.276 0.633 0.311 0.259 0.525 0.609 0.378 0.045 0.398
Pixel PRO 0.919 0.808 0.767 0.842 0.838 0.890 0.910 0.866 0.946 0.915 0.818 0.980 0.731 0.851 0.756 0.856
FAVAE Image AUC 0.971 0.898 0.704 0.503 0.884 0.965 0.814 0.532 0.920 0.739 0.949 0.956 0.862 0.546 0.657 0.793
Image AP 0.992 0.938 0.875 0.762 0.888 0.989 0.928 0.847 0.975 0.901 0.975 0.986 0.965 0.883 0.790 0.913
Pixel AUC 0.958 0.946 0.658 0.828 0.944 0.890 0.949 0.966 0.969 0.500 0.977 0.986 0.945 0.868 0.948 0.889
Pixel AP 0.654 0.322 0.142 0.044 0.484 0.315 0.274 0.155 0.498 0.010 0.517 0.361 0.663 0.135 0.027 0.307
Pixel PRO 0.874 0.803 0.446 0.504 0.837 0.821 0.830 0.864 0.858 0.178 0.828 0.966 0.845 0.767 0.817 0.749
PaDiM Image AUC 0.994 0.850 0.949 0.889 0.904 0.991 0.843 0.876 0.981 0.922 0.865 1.000 0.941 0.808 0.809 0.908
Image AP 0.998 0.907 0.981 0.954 0.879 0.997 0.934 0.959 0.994 0.972 0.900 1.000 0.983 0.952 0.908 0.954
Pixel AUC 0.984 0.954 0.906 0.989 0.965 0.930 0.981 0.985 0.988 0.945 0.978 0.992 0.966 0.957 0.978 0.966
Pixel AP 0.730 0.343 0.334 0.497 0.580 0.374 0.452 0.394 0.602 0.249 0.517 0.406 0.713 0.423 0.166 0.452
Pixel PRO 0.950 0.883 0.753 0.929 0.908 0.901 0.935 0.936 0.956 0.867 0.936 0.975 0.921 0.928 0.919 0.913
PatchCore Image AUC 1.000 0.997 0.979 0.988 0.979 1.000 1.000 0.999 0.967 0.988 0.995 1.000 0.999 0.991 0.995 0.992
Image AP 1.000 0.998 0.995 0.997 0.994 1.000 1.000 1.000 0.994 0.996 0.998 1.000 0.998 0.997 0.999 0.998
Pixel AUC 0.988 0.988 0.992 0.992 0.990 0.990 0.994 0.987 0.983 0.996 0.964 0.988 0.961 0.949 0.990 0.994
Pixel AP 0.768 0.653 0.442 0.627 0.325 0.537 0.456 0.870 0.777 0.354 0.546 0.372 0.610 0.477 0.595 0.561
Pixel PRO 0.957 0.945 0.958 0.949 0.939 0.958 0.974 0.954 0.945 0.964 0.906 0.918 0.906 0.914 0.961 0.943
RD4AD Image AUC 0.999 0.970 0.982 0.987 1.000 1.000 1.000 1.000 0.968 0.978 0.993 0.997 0.968 0.992 0.980 0.986
Image AP 1.000 0.982 0.996 0.996 1.000 1.000 1.000 1.000 0.995 0.992 0.997 0.999 0.973 0.998 0.994 0.995
Pixel AUC 0.988 0.970 0.986 0.989 0.993 0.990 0.994 0.973 0.982 0.996 0.957 0.991 0.930 0.954 0.982 0.978
Pixel AP 0.787 0.527 0.451 0.574 0.492 0.621 0.482 0.791 0.784 0.536 0.532 0.518 0.549 0.482 0.571 0.580
Pixel PRO 0.968 0.906 0.959 0.970 0.976 0.955 0.991 0.924 0.964 0.978 0.906 0.945 0.794 0.909 0.955 0.939
SPADE Image AUC 0.994 0.862 0.973 0.950 0.913 0.887 0.949 0.834 0.784 0.474 0.971 0.905 0.859 0.722 0.733 0.854
Image AP 0.998 0.913 0.990 0.980 0.900 0.969 0.985 0.962 0.928 0.748 0.987 0.969 0.962 0.930 0.880 0.940
Pixel AUC 0.971 0.916 0.858 0.992 0.846 0.925 0.983 0.987 0.975 0.976 0.989 0.992 0.971 0.951 0.994 0.955
Pixel AP 0.699 0.234 0.265 0.573 0.321 0.418 0.531 0.438 0.518 0.236 0.662 0.482 0.793 0.452 0.437 0.471
Pixel PRO 0.935 0.793 0.648 0.947 0.719 0.902 0.933 0.955 0.913 0.920 0.958 0.975 0.927 0.929 0.964 0.895
STPM Image AUC 1.000 0.748 0.944 0.925 0.774 0.956 0.953 0.940 0.930 0.976 0.990 1.000 0.972 0.963 0.785 0.924
Image AP 1.000 0.835 0.952 0.966 0.770 0.987 0.984 0.984 0.980 0.991 0.995 1.000 0.994 0.993 0.923 0.957
Pixel AUC 0.983 0.884 0.969 0.988 0.765 0.878 0.986 0.980 0.987 0.989 0.984 0.994 0.955 0.988 0.976 0.954
Pixel AP 0.732 0.327 0.706 0.470 0.299 0.400 0.546 0.363 0.669 0.452 0.596 0.491 0.701 0.801 0.220 0.518
Pixel PRO 0.947 0.583 0.878 0.914 0.602 0.779 0.952 0.947 0.942 0.961 0.945 0.980 0.898 0.960 0.903 0.879

The results with 0.05 noise ratio on MVTec AD

Noisy 0.05 MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA Image AUC 0.998 0.994 0.997 0.944 0.990 0.988 0.947 0.947 0.980 0.971 0.998 1.000 0.982 0.970 0.833 0.969
Image AP 0.999 0.997 0.999 0.974 0.987 0.996 0.981 0.990 0.994 0.990 0.999 1.000 0.995 0.994 0.932 0.989
Pixel AUC 0.980 0.984 0.908 0.985 0.967 0.941 0.933 0.951 0.981 0.959 0.978 0.993 0.827 0.962 0.939 0.952
Pixel AP 0.704 0.696 0.326 0.507 0.676 0.492 0.479 0.435 0.495 0.218 0.583 0.454 0.441 0.780 0.230 0.501
Pixel PRO 0.920 0.919 0.727 0.854 0.923 0.865 0.823 0.825 0.916 0.875 0.919 0.970 0.829 0.915 0.791 0.871
CSFlow Image AUC 0.992 0.992 0.965 0.926 0.988 0.944 0.986 0.969 0.990 0.844 0.773 0.995 0.830 0.951 0.934 0.939
Image AP 0.998 0.995 0.988 0.972 0.986 0.983 0.996 0.994 0.997 0.923 0.875 0.998 0.954 0.991 0.969 0.975
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
CutPaste Image AUC 1.000 0.963 0.969 0.778 0.945 0.918 0.983 0.667 0.436 0.981 0.972 0.865 0.991 0.896 0.598 0.864
Image AP 1.000 0.981 0.980 0.895 0.936 0.973 0.994 0.922 0.782 0.994 0.987 0.937 0.998 0.980 0.797 0.944
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
DRAEM Image AUC 0.962 0.811 0.939 0.894 0.996 0.994 1.000 0.950 0.902 0.968 0.998 0.991 0.919 0.982 1.000 0.954
Image AP 0.978 0.884 0.986 0.958 0.998 0.996 1.000 0.987 0.974 0.974 0.999 0.996 0.889 0.993 1.000 0.974
Pixel AUC 0.949 0.837 0.948 0.943 0.988 0.986 0.973 0.781 0.973 0.980 0.932 0.992 0.838 0.930 0.976 0.935
Pixel AP 0.710 0.251 0.421 0.483 0.300 0.679 0.527 0.342 0.425 0.529 0.718 0.671 0.408 0.597 0.660 0.515
Pixel PRO 0.864 0.692 0.859 0.882 0.949 0.965 0.939 0.820 0.821 0.917 0.868 0.931 0.740 0.852 0.937 0.869
FastFlow Image AUC 0.999 0.848 0.983 0.880 0.888 0.980 0.945 0.928 0.980 0.964 0.485 0.999 0.802 0.877 0.716 0.885
Image AP 1.000 0.910 0.993 0.936 0.870 0.992 0.979 0.984 0.994 0.986 0.680 1.000 0.935 0.976 0.848 0.939
Pixel AUC 0.972 0.905 0.898 0.978 0.948 0.937 0.970 0.976 0.986 0.964 0.949 0.993 0.845 0.936 0.934 0.946
Pixel AP 0.617 0.213 0.336 0.354 0.481 0.501 0.335 0.272 0.608 0.247 0.259 0.458 0.371 0.346 0.054 0.363
Pixel PRO 0.898 0.752 0.704 0.873 0.821 0.899 0.899 0.883 0.936 0.875 0.833 0.977 0.673 0.815 0.755 0.839
FAVAE Image AUC 0.234 0.860 0.741 0.784 0.881 0.975 0.848 0.577 0.945 0.657 0.932 0.961 0.817 0.534 0.769 0.768
Image AP 0.670 0.919 0.892 0.898 0.894 0.992 0.935 0.875 0.982 0.829 0.968 0.986 0.945 0.886 0.912 0.905
Pixel AUC 0.920 0.951 0.695 0.959 0.945 0.894 0.964 0.973 0.972 0.385 0.975 0.988 0.932 0.880 0.976 0.894
Pixel AP 0.298 0.407 0.158 0.415 0.515 0.329 0.335 0.231 0.503 0.005 0.515 0.372 0.610 0.149 0.193 0.336
Pixel PRO 0.754 0.800 0.478 0.801 0.846 0.822 0.872 0.876 0.860 0.069 0.810 0.968 0.818 0.787 0.905 0.764
IGD Image AUC 0.995 0.769 0.912 0.852 0.877 0.919 0.923 0.527 0.783 0.436 0.956 0.864 0.868 0.778 0.612 0.805
Image AP 0.998 0.827 0.968 0.924 0.866 0.976 0.978 0.869 0.933 0.679 0.979 0.953 0.965 0.955 0.796 0.911
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
PaDiM Image AUC 0.996 0.863 0.935 0.852 0.894 0.998 0.879 0.839 0.980 0.866 0.740 1.000 0.973 0.813 0.727 0.890
Image AP 0.999 0.924 0.975 0.924 0.879 0.999 0.945 0.942 0.994 0.943 0.805 1.000 0.992 0.958 0.860 0.942
Pixel AUC 0.983 0.962 0.913 0.988 0.962 0.945 0.982 0.983 0.990 0.933 0.982 0.994 0.951 0.955 0.977 0.967
Pixel AP 0.736 0.401 0.397 0.445 0.582 0.449 0.474 0.378 0.614 0.250 0.539 0.472 0.628 0.498 0.152 0.468
Pixel PRO 0.949 0.897 0.773 0.931 0.874 0.924 0.939 0.931 0.962 0.858 0.933 0.978 0.919 0.933 0.918 0.915
PatchCore Image AUC 1.000 0.998 0.974 0.998 0.977 1.000 1.000 0.999 0.956 0.979 0.995 1.000 0.996 0.984 0.988 0.990
Image AP 1.000 0.998 0.993 0.999 0.993 1.000 1.000 1.000 0.991 0.992 0.998 1.000 0.993 0.993 0.996 0.996
Pixel AUC 0.983 0.912 0.986 0.991 0.990 0.987 0.991 0.939 0.909 0.995 0.953 0.986 0.954 0.969 0.988 0.969
Pixel AP 0.727 0.429 0.430 0.551 0.317 0.500 0.368 0.739 0.681 0.355 0.551 0.413 0.664 0.565 0.613 0.527
Pixel PRO 0.947 0.889 0.946 0.953 0.939 0.945 0.966 0.922 0.926 0.963 0.811 0.902 0.877 0.892 0.952 0.922
RD4AD Image AUC 1.000 0.973 1.000 0.997 0.967 0.994 0.982 0.979 0.989 1.000 1.000 1.000 0.994 0.981 0.977 0.989
Image AP 1.000 0.985 1.000 0.999 0.970 0.998 0.994 0.996 0.997 1.000 1.000 1.000 0.999 0.997 0.992 0.995
Pixel AUC 0.988 0.972 0.961 0.992 0.904 0.961 0.982 0.986 0.991 0.994 0.991 0.996 0.907 0.986 0.996 0.974
Pixel AP 0.785 0.552 0.540 0.550 0.557 0.551 0.609 0.452 0.591 0.534 0.663 0.537 0.545 0.819 0.508 0.586
Pixel PRO 0.960 0.899 0.874 0.937 0.808 0.915 0.948 0.950 0.959 0.973 0.959 0.980 0.913 0.965 0.973 0.934
SPADE Image AUC 0.994 0.862 0.968 0.944 0.912 0.915 0.955 0.813 0.812 0.461 0.974 0.897 0.858 0.716 0.731 0.854
Image AP 0.998 0.921 0.988 0.975 0.899 0.975 0.986 0.960 0.940 0.697 0.989 0.962 0.956 0.931 0.882 0.937
Pixel AUC 0.970 0.916 0.846 0.991 0.838 0.931 0.982 0.987 0.975 0.975 0.988 0.994 0.838 0.951 0.994 0.945
Pixel AP 0.701 0.238 0.248 0.573 0.344 0.460 0.514 0.447 0.529 0.222 0.658 0.566 0.395 0.461 0.434 0.453
Pixel PRO 0.934 0.792 0.631 0.945 0.745 0.909 0.933 0.955 0.916 0.924 0.956 0.977 0.857 0.930 0.964 0.891
STPM Image AUC 1.000 0.745 0.933 0.877 0.786 0.991 0.947 0.919 0.947 0.914 0.942 0.972 0.927 0.957 0.780 0.909
Image AP 1.000 0.863 0.935 0.938 0.759 0.997 0.981 0.981 0.984 0.967 0.975 0.990 0.981 0.992 0.906 0.950
Pixel AUC 0.980 0.882 0.965 0.988 0.794 0.881 0.979 0.981 0.987 0.984 0.867 0.995 0.866 0.986 0.978 0.941
Pixel AP 0.705 0.484 0.640 0.479 0.318 0.448 0.521 0.369 0.693 0.426 0.423 0.519 0.409 0.799 0.198 0.495
Pixel PRO 0.946 0.542 0.880 0.914 0.618 0.824 0.939 0.950 0.944 0.946 0.728 0.979 0.836 0.955 0.907 0.860

The results with 0.1 noise ratio on MVTec AD

Noisy 0.1 MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA Image AUC 0.996 0.979 0.988 0.944 0.994 0.992 0.926 0.921 0.951 0.916 0.992 1.000 0.984 0.965 0.881 0.962
Image AP 0.999 0.989 0.996 0.971 0.992 0.998 0.972 0.981 0.984 0.964 0.996 1.000 0.996 0.995 0.960 0.986
Pixel AUC 0.976 0.962 0.889 0.985 0.981 0.926 0.872 0.914 0.967 0.942 0.973 0.995 0.820 0.909 0.943 0.937
Pixel AP 0.684 0.590 0.296 0.492 0.725 0.424 0.374 0.370 0.375 0.239 0.546 0.552 0.434 0.607 0.178 0.459
Pixel PRO 0.922 0.868 0.689 0.844 0.926 0.824 0.729 0.748 0.879 0.827 0.884 0.967 0.819 0.891 0.805 0.841
CSFlow Image AUC 0.989 0.964 0.960 0.962 0.587 0.992 0.972 0.946 0.982 0.815 0.965 1.000 0.850 0.475 0.945 0.894
Image AP 0.996 0.975 0.985 0.983 0.626 0.998 0.992 0.987 0.994 0.899 0.982 1.000 0.960 0.873 0.978 0.949
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
CutPaste Image AUC 0.999 0.967 0.992 0.924 0.911 0.847 0.955 0.693 0.961 0.977 0.965 0.849 0.991 0.865 0.602 0.900
Image AP 1.000 0.981 0.997 0.970 0.886 0.948 0.988 0.898 0.987 0.991 0.984 0.932 0.998 0.977 0.794 0.955
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
DRAEM Image AUC 0.955 0.691 0.917 0.828 0.988 0.945 1.000 0.855 0.944 0.951 0.935 0.969 0.902 0.883 0.921 0.912
Image AP 0.964 0.778 0.978 0.911 0.993 0.932 1.000 0.954 0.988 0.979 0.966 0.989 0.832 0.939 0.972 0.945
Pixel AUC 0.954 0.776 0.907 0.882 0.981 0.956 0.989 0.584 0.948 0.982 0.885 0.994 0.786 0.929 0.923 0.898
Pixel AP 0.695 0.205 0.408 0.313 0.216 0.527 0.518 0.208 0.490 0.575 0.559 0.728 0.329 0.554 0.279 0.440
Pixel PRO 0.852 0.549 0.844 0.787 0.938 0.925 0.967 0.740 0.872 0.924 0.732 0.925 0.689 0.821 0.798 0.824
FastFlow Image AUC 0.985 0.831 0.978 0.823 0.942 0.924 0.920 0.897 0.959 0.933 0.433 0.985 0.859 0.898 0.643 0.867
Image AP 0.995 0.900 0.993 0.881 0.900 0.972 0.966 0.968 0.986 0.974 0.604 0.994 0.958 0.979 0.832 0.927
Pixel AUC 0.965 0.905 0.878 0.971 0.970 0.939 0.965 0.970 0.984 0.977 0.886 0.993 0.870 0.925 0.884 0.939
Pixel AP 0.546 0.216 0.288 0.325 0.602 0.488 0.292 0.244 0.546 0.322 0.142 0.443 0.428 0.349 0.029 0.351
Pixel PRO 0.876 0.756 0.670 0.868 0.879 0.887 0.882 0.853 0.934 0.925 0.703 0.976 0.718 0.809 0.631 0.824
FAVAE Image AUC 0.993 0.874 0.715 0.538 0.915 0.957 0.794 0.546 0.938 0.746 0.913 0.981 0.894 0.496 0.718 0.801
Image AP 0.997 0.920 0.880 0.726 0.913 0.989 0.915 0.833 0.978 0.868 0.964 0.993 0.970 0.887 0.876 0.914
Pixel AUC 0.982 0.938 0.657 0.913 0.951 0.891 0.953 0.968 0.971 0.559 0.966 0.989 0.948 0.883 0.977 0.903
Pixel AP 0.733 0.280 0.150 0.140 0.500 0.320 0.279 0.173 0.469 0.014 0.495 0.374 0.659 0.152 0.118 0.324
Pixel PRO 0.936 0.758 0.461 0.695 0.859 0.800 0.841 0.864 0.845 0.242 0.758 0.970 0.871 0.785 0.908 0.773
IGD Image AUC 0.993 0.778 0.875 0.858 0.853 0.923 0.886 0.574 0.795 0.402 0.922 0.870 0.881 0.818 0.583 0.801
Image AP 0.997 0.824 0.957 0.916 0.817 0.980 0.967 0.859 0.933 0.656 0.962 0.956 0.967 0.966 0.788 0.903
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
PaDiM Image AUC 0.995 0.842 0.952 0.920 0.903 0.977 0.866 0.847 0.980 0.916 0.870 1.000 0.962 0.792 0.787 0.907
Image AP 0.998 0.903 0.975 0.959 0.899 0.994 0.942 0.940 0.993 0.960 0.921 1.000 0.990 0.959 0.911 0.956
Pixel AUC 0.985 0.947 0.898 0.990 0.966 0.915 0.978 0.982 0.989 0.941 0.980 0.991 0.941 0.956 0.978 0.962
Pixel AP 0.740 0.342 0.362 0.492 0.626 0.359 0.393 0.350 0.556 0.227 0.531 0.384 0.602 0.485 0.141 0.439
Pixel PRO 0.953 0.873 0.722 0.931 0.889 0.899 0.929 0.922 0.958 0.841 0.921 0.975 0.882 0.926 0.921 0.903
PatchCore Image AUC 1.000 0.982 0.966 0.999 1.000 1.000 1.000 0.994 0.957 0.970 0.999 0.997 0.959 0.975 0.988 0.986
Image AP 1.000 0.988 0.991 1.000 1.000 1.000 1.000 0.998 0.990 0.986 0.999 0.998 0.963 0.987 0.995 0.993
Pixel AUC 0.983 0.793 0.991 0.991 0.990 0.994 0.991 0.838 0.961 0.995 0.939 0.989 0.881 0.952 0.987 0.952
Pixel AP 0.695 0.313 0.510 0.570 0.312 0.658 0.436 0.498 0.471 0.357 0.401 0.437 0.595 0.458 0.564 0.485
Pixel PRO 0.951 0.862 0.956 0.959 0.933 0.964 0.966 0.889 0.932 0.952 0.831 0.918 0.868 0.880 0.950 0.921
RD4AD Image AUC 1.000 0.947 0.995 0.993 0.958 0.988 0.966 0.973 0.982 1.000 1.000 1.000 0.999 0.980 0.977 0.984
Image AP 1.000 0.973 0.998 0.997 0.959 0.997 0.988 0.993 0.994 1.000 1.000 1.000 1.000 0.997 0.993 0.992
Pixel AUC 0.988 0.960 0.953 0.993 0.879 0.960 0.980 0.984 0.990 0.995 0.990 0.996 0.913 0.985 0.996 0.971
Pixel AP 0.785 0.462 0.491 0.599 0.490 0.541 0.563 0.404 0.536 0.525 0.653 0.569 0.555 0.795 0.504 0.565
Pixel PRO 0.964 0.886 0.850 0.943 0.781 0.910 0.947 0.945 0.949 0.978 0.953 0.979 0.909 0.961 0.969 0.928
SPADE Image AUC 0.993 0.868 0.973 0.962 0.889 0.936 0.948 0.832 0.830 0.444 0.955 0.911 0.876 0.732 0.773 0.861
Image AP 0.997 0.918 0.990 0.980 0.873 0.984 0.983 0.955 0.943 0.697 0.982 0.971 0.963 0.939 0.905 0.939
Pixel AUC 0.973 0.863 0.834 0.992 0.833 0.928 0.980 0.985 0.973 0.982 0.987 0.994 0.830 0.947 0.994 0.940
Pixel AP 0.706 0.201 0.238 0.558 0.312 0.443 0.494 0.395 0.472 0.217 0.656 0.566 0.376 0.394 0.439 0.431
Pixel PRO 0.941 0.778 0.611 0.949 0.715 0.901 0.928 0.952 0.906 0.927 0.950 0.978 0.838 0.927 0.964 0.884
STPM Image AUC 0.999 0.503 0.938 0.889 0.716 0.983 0.939 0.907 0.905 0.909 0.984 0.973 0.693 0.976 0.844 0.877
Image AP 1.000 0.684 0.948 0.934 0.694 0.995 0.978 0.971 0.969 0.959 0.992 0.991 0.879 0.996 0.941 0.929
Pixel AUC 0.978 0.855 0.950 0.989 0.751 0.948 0.986 0.977 0.980 0.990 0.989 0.995 0.429 0.987 0.979 0.919
Pixel AP 0.699 0.176 0.576 0.492 0.262 0.591 0.557 0.346 0.604 0.477 0.677 0.509 0.096 0.792 0.253 0.474
Pixel PRO 0.947 0.607 0.844 0.917 0.587 0.923 0.952 0.947 0.915 0.964 0.933 0.979 0.137 0.957 0.919 0.835

The results with 0.15 noise ratio on MVTec AD

Noisy 0.15 MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA Image AUC 1.000 0.981 0.992 0.935 0.982 0.964 0.892 0.934 0.939 0.869 0.983 1.000 0.966 0.931 0.872 0.949
Image AP 1.000 0.991 0.997 0.972 0.978 0.985 0.956 0.986 0.983 0.954 0.991 1.000 0.991 0.984 0.955 0.981
Pixel AUC 0.972 0.945 0.917 0.984 0.962 0.900 0.782 0.877 0.948 0.930 0.964 0.989 0.703 0.848 0.934 0.910
Pixel AP 0.678 0.468 0.465 0.494 0.697 0.362 0.231 0.318 0.313 0.174 0.518 0.403 0.307 0.355 0.134 0.394
Pixel PRO 0.916 0.845 0.762 0.838 0.905 0.766 0.602 0.704 0.826 0.786 0.872 0.957 0.776 0.858 0.765 0.812
CSFlow Image AUC 0.995 0.820 0.820 0.978 0.971 0.981 0.962 0.914 0.947 0.914 0.796 1.000 0.795 0.829 0.835 0.904
Image AP 0.998 0.902 0.936 0.992 0.970 0.993 0.989 0.980 0.985 0.966 0.884 1.000 0.922 0.957 0.944 0.961
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
CutPaste Image AUC 0.993 0.965 0.978 0.839 0.871 0.825 0.972 0.723 0.391 0.972 0.929 0.945 0.955 0.887 0.523 0.851
Image AP 0.997 0.980 0.990 0.933 0.873 0.897 0.992 0.926 0.731 0.990 0.966 0.973 0.989 0.977 0.759 0.932
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
DRAEM Image AUC 0.975 0.675 0.786 0.774 0.810 0.842 1.000 0.864 0.937 0.896 0.884 0.948 0.840 0.906 0.902 0.869
Image AP 0.985 0.699 0.936 0.856 0.834 0.788 1.000 0.951 0.984 0.946 0.926 0.979 0.689 0.898 0.966 0.896
Pixel AUC 0.938 0.759 0.867 0.877 0.893 0.958 0.971 0.609 0.926 0.962 0.792 0.991 0.896 0.885 0.860 0.879
Pixel AP 0.588 0.084 0.253 0.344 0.065 0.535 0.281 0.171 0.477 0.417 0.358 0.635 0.325 0.377 0.144 0.337
Pixel PRO 0.849 0.538 0.770 0.796 0.703 0.858 0.964 0.777 0.861 0.882 0.581 0.958 0.722 0.742 0.601 0.773
FastFlow Image AUC 0.981 0.819 0.975 0.770 0.918 0.969 0.883 0.855 0.950 0.883 0.432 1.000 0.834 0.850 0.697 0.854
Image AP 0.992 0.897 0.991 0.863 0.914 0.986 0.945 0.959 0.986 0.960 0.627 1.000 0.951 0.968 0.836 0.925
Pixel AUC 0.955 0.863 0.910 0.972 0.948 0.922 0.956 0.967 0.967 0.962 0.872 0.994 0.816 0.921 0.911 0.929
Pixel AP 0.465 0.198 0.387 0.310 0.543 0.435 0.252 0.167 0.415 0.253 0.159 0.435 0.331 0.301 0.037 0.313
Pixel PRO 0.847 0.662 0.717 0.872 0.833 0.873 0.862 0.854 0.869 0.842 0.704 0.978 0.717 0.826 0.698 0.810
FAVAE Image AUC 0.977 0.831 0.722 0.826 0.860 0.997 0.792 0.515 0.832 0.617 0.950 0.995 0.796 0.509 0.748 0.798
Image AP 0.992 0.916 0.897 0.938 0.851 0.999 0.914 0.836 0.946 0.838 0.978 0.998 0.944 0.869 0.883 0.920
Pixel AUC 0.975 0.928 0.697 0.971 0.887 0.889 0.919 0.967 0.956 0.324 0.965 0.991 0.936 0.898 0.973 0.885
Pixel AP 0.713 0.268 0.171 0.458 0.288 0.326 0.210 0.184 0.386 0.005 0.481 0.393 0.599 0.168 0.139 0.319
Pixel PRO 0.916 0.730 0.479 0.814 0.716 0.820 0.760 0.853 0.800 0.055 0.751 0.971 0.846 0.827 0.894 0.749
IGD Image AUC 0.981 0.774 0.876 0.926 0.846 0.856 0.884 0.538 0.813 0.386 0.784 0.825 0.808 0.797 0.633 0.782
Image AP 0.992 0.836 0.960 0.967 0.830 0.944 0.965 0.871 0.944 0.733 0.872 0.939 0.950 0.954 0.809 0.904
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
PaDiM Image AUC 0.997 0.850 0.958 0.796 0.925 1.000 0.834 0.882 0.980 0.866 0.846 1.000 0.948 0.826 0.784 0.899
Image AP 0.999 0.915 0.986 0.895 0.922 1.000 0.925 0.963 0.994 0.953 0.903 1.000 0.989 0.957 0.901 0.953
Pixel AUC 0.988 0.946 0.921 0.990 0.965 0.938 0.980 0.982 0.988 0.939 0.978 0.994 0.933 0.952 0.974 0.964
Pixel AP 0.767 0.341 0.420 0.467 0.633 0.398 0.410 0.331 0.567 0.335 0.532 0.479 0.578 0.431 0.128 0.454
Pixel PRO 0.963 0.865 0.776 0.932 0.877 0.916 0.928 0.926 0.954 0.843 0.932 0.977 0.910 0.932 0.909 0.909
PatchCore Image AUC 1.000 0.985 0.954 0.997 0.947 0.994 1.000 1.000 0.951 0.964 0.982 1.000 0.905 0.963 0.986 0.975
Image AP 1.000 0.987 0.983 0.998 0.968 0.989 1.000 1.000 0.988 0.974 0.992 1.000 0.915 0.973 0.994 0.984
Pixel AUC 0.983 0.829 0.983 0.993 0.994 0.993 0.993 0.899 0.909 0.994 0.954 0.992 0.797 0.968 0.986 0.951
Pixel AP 0.676 0.333 0.359 0.611 0.259 0.531 0.480 0.668 0.711 0.301 0.577 0.494 0.462 0.460 0.577 0.500
Pixel PRO 0.951 0.863 0.948 0.961 0.961 0.959 0.973 0.898 0.927 0.956 0.801 0.920 0.687 0.885 0.947 0.909
PatchCore neighborhood 3 Image AUC 1.000 0.972 0.960 0.992 0.947 1.000 1.000 0.995 0.955 0.958 0.982 0.996 0.98 0.966 0.983 0.979
Image AP 1.000 0.974 0.986 0.996 0.971 1.000 1.000 0.998 0.989 0.971 0.993 0.998 0.938 0.975 0.993 0.985
Pixel AUC 0.986 0.803 0.985 0.993 0.995 0.994 0.995 0.874 0.921 0.996 0.948 0.991 0.942 0.968 0.988 0.959
Pixel AP 0.722 0.317 0.368 0.572 0.281 0.619 0.537 0.61 0.597 0.39 0.491 0.467 0.573 0.454 0.58 0.505
Pixel PRO 0.959 0.831 0.950 0.962 0.970 0.944 0.975 0.891 0.919 0.957 0.81 0.942 0.883 0.899 0.954 0.923
PatchCore neighborhood 9 Image AUC 1 0.996 0.972 1 0.95 1 1 0.996 0.958 0.973 1 1 0.985 0.952 0.984 0.984
Image AP 1 0.996 0.99 1 0.971 1 1 0.999 0.99 0.983 1 1 0.953 0.961 0.993 0.989
Pixel AUC 0.989 0.829 0.99 0.993 0.995 0.993 0.995 0.809 0.774 0.995 0.954 0.99 0.532 0.959 0.988 0.919
Pixel AP 0.861 0.313 0.463 0.566 0.466 0.451 0.53 0.407 0.253 0.367 0.516 0.477 0.125 0.597 0.582 0.465
Pixel PRO 0.962 0.881 0.948 0.965 0.95 0.937 0.972 0.886 0.92 0.961 0.855 0.912 0.673 0.898 0.95 0.911
RD4AD Image AUC 1.000 0.932 0.999 0.996 0.983 0.983 0.964 0.984 0.973 0.859 1.000 1.000 0.991 0.977 0.985 0.975
Image AP 1.000 0.969 1.000 0.998 0.985 0.993 0.988 0.997 0.992 0.899 1.000 1.000 0.998 0.996 0.995 0.987
Pixel AUC 0.991 0.896 0.964 0.993 0.894 0.951 0.979 0.982 0.987 0.988 0.990 0.996 0.878 0.984 0.996 0.965
Pixel AP 0.815 0.350 0.603 0.570 0.555 0.475 0.524 0.402 0.467 0.293 0.675 0.561 0.450 0.764 0.482 0.532
Pixel PRO 0.970 0.836 0.885 0.939 0.798 0.904 0.945 0.951 0.940 0.962 0.957 0.980 0.898 0.963 0.968 0.926
SPADE Image AUC 0.993 0.872 0.978 0.974 0.877 0.903 0.939 0.836 0.842 0.448 0.951 0.910 0.819 0.715 0.766 0.855
Image AP 0.997 0.929 0.992 0.989 0.870 0.968 0.980 0.962 0.952 0.753 0.980 0.969 0.938 0.928 0.896 0.940
Pixel AUC 0.978 0.755 0.846 0.993 0.823 0.913 0.977 0.978 0.969 0.976 0.985 0.994 0.793 0.926 0.993 0.926
Pixel AP 0.717 0.205 0.262 0.581 0.349 0.418 0.441 0.361 0.429 0.205 0.629 0.586 0.313 0.269 0.392 0.410
Pixel PRO 0.950 0.748 0.599 0.949 0.725 0.899 0.925 0.947 0.895 0.921 0.946 0.979 0.842 0.924 0.961 0.881
STPM Image AUC 1.000 0.471 0.969 0.883 0.786 0.994 0.923 0.941 0.921 0.917 0.968 0.997 0.903 0.961 0.742 0.892
Image AP 1.000 0.639 0.989 0.940 0.787 0.998 0.968 0.987 0.976 0.974 0.987 0.999 0.974 0.992 0.857 0.938
Pixel AUC 0.981 0.761 0.966 0.990 0.783 0.935 0.980 0.958 0.975 0.988 0.985 0.985 0.860 0.987 0.923 0.937
Pixel AP 0.711 0.113 0.679 0.458 0.336 0.521 0.492 0.320 0.579 0.477 0.632 0.394 0.385 0.763 0.119 0.465
Pixel PRO 0.953 0.313 0.876 0.918 0.601 0.908 0.936 0.902 0.910 0.951 0.945 0.951 0.842 0.961 0.713 0.845

The results with 0.2 noise ratio on MVTec AD

Noisy 0.2 MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA Image AUC 1.000 0.969 0.987 0.925 0.984 0.968 0.891 0.905 0.966 0.854 0.995 1.000 0.972 0.956 0.822 0.946
Image AP 1.000 0.986 0.995 0.963 0.980 0.992 0.958 0.978 0.993 0.946 0.997 1.000 0.994 0.992 0.934 0.981
Pixel AUC 0.968 0.919 0.895 0.984 0.959 0.888 0.780 0.911 0.957 0.923 0.965 0.989 0.719 0.800 0.932 0.906
Pixel AP 0.681 0.444 0.355 0.502 0.693 0.380 0.231 0.405 0.331 0.168 0.538 0.355 0.327 0.307 0.153 0.391
Pixel PRO 0.905 0.808 0.774 0.820 0.895 0.753 0.613 0.706 0.835 0.736 0.870 0.966 0.755 0.871 0.785 0.806
CSFlow Image AUC 0.745 0.761 0.940 0.945 0.918 0.963 0.923 0.915 0.880 0.754 0.683 0.965 0.915 0.908 0.898 0.874
Image AP 0.854 0.878 0.967 0.976 0.922 0.991 0.979 0.979 0.976 0.867 0.783 0.983 0.982 0.981 0.966 0.939
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
CutPaste Image AUC 1.000 0.978 0.985 0.980 0.930 0.889 0.991 0.698 0.935 0.969 0.945 0.874 0.975 0.873 0.576 0.907
Image AP 1.000 0.990 0.993 0.991 0.915 0.975 0.998 0.917 0.982 0.989 0.973 0.907 0.995 0.975 0.796 0.960
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
DRAEM Image AUC 0.923 0.743 0.848 0.789 0.984 0.908 0.998 0.819 0.878 0.979 0.906 0.981 0.918 0.856 0.922 0.897
Image AP 0.909 0.733 0.951 0.857 0.981 0.833 0.998 0.926 0.965 0.986 0.914 0.989 0.784 0.860 0.947 0.909
Pixel AUC 0.891 0.839 0.867 0.909 0.990 0.933 0.974 0.643 0.697 0.987 0.841 0.992 0.898 0.879 0.935 0.885
Pixel AP 0.488 0.142 0.248 0.230 0.144 0.414 0.410 0.207 0.260 0.543 0.402 0.578 0.310 0.346 0.287 0.334
Pixel PRO 0.796 0.633 0.749 0.794 0.957 0.877 0.957 0.778 0.738 0.950 0.684 0.958 0.766 0.770 0.822 0.815
FastFlow Image AUC 0.972 0.835 0.955 0.740 0.868 0.958 0.900 0.843 0.975 0.942 0.534 0.999 0.854 0.866 0.582 0.855
Image AP 0.987 0.916 0.981 0.814 0.873 0.989 0.957 0.947 0.995 0.979 0.666 1.000 0.953 0.971 0.786 0.921
Pixel AUC 0.959 0.885 0.908 0.978 0.952 0.915 0.948 0.970 0.964 0.974 0.888 0.992 0.786 0.887 0.899 0.927
Pixel AP 0.473 0.211 0.319 0.344 0.557 0.440 0.232 0.228 0.427 0.314 0.169 0.399 0.294 0.232 0.030 0.311
Pixel PRO 0.838 0.713 0.720 0.877 0.815 0.836 0.844 0.852 0.888 0.896 0.674 0.974 0.654 0.802 0.687 0.805
FAVAE Image AUC 0.982 0.867 0.751 0.740 0.892 0.958 0.748 0.581 0.936 0.642 0.913 0.988 0.877 0.535 0.802 0.814
Image AP 0.992 0.937 0.888 0.881 0.916 0.989 0.920 0.850 0.985 0.846 0.959 0.995 0.969 0.884 0.932 0.930
Pixel AUC 0.982 0.927 0.725 0.951 0.949 0.869 0.934 0.967 0.967 0.559 0.950 0.993 0.925 0.880 0.979 0.904
Pixel AP 0.773 0.274 0.150 0.322 0.545 0.327 0.229 0.196 0.418 0.013 0.419 0.400 0.565 0.142 0.240 0.334
Pixel PRO 0.929 0.749 0.505 0.759 0.852 0.788 0.776 0.832 0.822 0.262 0.706 0.974 0.825 0.785 0.918 0.765
IGD Image AUC 0.977 0.760 0.848 0.885 0.852 0.878 0.914 0.533 0.878 0.300 0.860 0.845 0.909 0.794 0.612 0.790
Image AP 0.990 0.837 0.938 0.943 0.842 0.968 0.978 0.854 0.975 0.675 0.912 0.937 0.979 0.944 0.785 0.904
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
PaDiM Image AUC 0.992 0.894 0.969 0.860 0.894 0.984 0.876 0.810 0.984 0.885 0.865 1.000 0.956 0.838 0.786 0.906
Image AP 0.996 0.949 0.986 0.923 0.890 0.996 0.952 0.935 0.997 0.958 0.914 1.000 0.987 0.963 0.916 0.957
Pixel AUC 0.988 0.952 0.918 0.989 0.968 0.916 0.979 0.983 0.987 0.946 0.982 0.995 0.930 0.955 0.978 0.964
Pixel AP 0.781 0.420 0.367 0.449 0.670 0.418 0.403 0.400 0.500 0.313 0.623 0.503 0.570 0.452 0.215 0.472
Pixel PRO 0.959 0.892 0.814 0.931 0.891 0.885 0.932 0.922 0.953 0.879 0.927 0.979 0.899 0.940 0.925 0.915
PatchCore Image AUC 1.000 0.964 0.974 0.999 0.933 1.000 0.998 0.998 0.925 0.978 0.975 1.000 1.000 0.972 0.982 0.980
Image AP 1.000 0.966 0.990 0.999 0.961 1.000 0.998 0.999 0.979 0.982 0.987 1.000 1.000 0.972 0.991 0.988
Pixel AUC 0.983 0.767 0.987 0.991 0.997 0.991 0.994 0.834 0.823 0.995 0.956 0.990 0.959 0.943 0.987 0.946
Pixel AP 0.771 0.259 0.380 0.455 0.523 0.513 0.511 0.503 0.406 0.302 0.596 0.466 0.566 0.379 0.548 0.479
Pixel PRO 0.951 0.857 0.948 0.966 0.979 0.975 0.974 0.853 0.902 0.971 0.801 0.937 0.874 0.878 0.950 0.921
RD4AD Image AUC 1.000 0.921 0.997 0.995 0.969 0.979 0.959 0.971 0.991 1.000 1.000 1.000 0.984 0.991 0.995 0.983
Image AP 1.000 0.963 0.999 0.998 0.968 0.994 0.987 0.993 0.998 1.000 1.000 1.000 0.997 0.998 0.998 0.993
Pixel AUC 0.990 0.888 0.969 0.993 0.897 0.957 0.978 0.986 0.989 0.994 0.992 0.996 0.861 0.982 0.996 0.964
Pixel AP 0.822 0.364 0.569 0.600 0.563 0.555 0.525 0.434 0.509 0.534 0.696 0.559 0.437 0.763 0.514 0.563
Pixel PRO 0.969 0.822 0.914 0.938 0.794 0.909 0.939 0.948 0.945 0.972 0.951 0.981 0.882 0.967 0.972 0.927
SPADE Image AUC 0.990 0.877 0.976 0.935 0.869 0.873 0.962 0.846 0.893 0.377 0.952 0.912 0.926 0.797 0.707 0.859
Image AP 0.995 0.937 0.991 0.967 0.862 0.969 0.991 0.962 0.976 0.684 0.979 0.963 0.984 0.946 0.877 0.939
Pixel AUC 0.977 0.733 0.850 0.992 0.830 0.910 0.979 0.986 0.973 0.974 0.987 0.993 0.786 0.890 0.994 0.923
Pixel AP 0.741 0.224 0.221 0.570 0.366 0.442 0.462 0.443 0.456 0.199 0.664 0.549 0.317 0.250 0.428 0.422
Pixel PRO 0.947 0.749 0.648 0.947 0.716 0.876 0.930 0.952 0.901 0.905 0.948 0.976 0.823 0.932 0.967 0.881
STPM Image AUC 1.000 0.751 0.936 0.870 0.774 0.984 0.931 0.938 0.895 0.927 0.981 0.998 0.903 0.963 0.879 0.915
Image AP 1.000 0.873 0.948 0.930 0.764 0.996 0.975 0.983 0.977 0.975 0.992 0.999 0.979 0.993 0.953 0.956
Pixel AUC 0.980 0.867 0.967 0.988 0.788 0.911 0.984 0.983 0.980 0.981 0.938 0.995 0.835 0.987 0.984 0.944
Pixel AP 0.726 0.413 0.673 0.489 0.349 0.514 0.509 0.369 0.610 0.466 0.560 0.532 0.357 0.733 0.254 0.504
Pixel PRO 0.950 0.535 0.883 0.918 0.597 0.858 0.948 0.947 0.916 0.948 0.793 0.979 0.798 0.965 0.932 0.864

The performance of continual setting on MVTec AD

Continual MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA Image AUC 0.310 0.763 0.519 0.320 0.923 0.984 0.489 0.275 0.834 0.571 0.903 0.935 0.464 0.528 0.528 0.623
Image AP 0.674 0.904 0.765 0.353 0.974 0.995 0.652 0.753 0.948 0.764 0.940 0.981 0.853 0.888 0.756 0.813
Pixel AUC 0.613 0.600 0.850 0.534 0.747 0.982 0.653 0.885 0.864 0.282 0.920 0.965 0.783 0.717 0.914 0.754
Pixel AP 0.068 0.155 0.054 0.056 0.281 0.573 0.056 0.050 0.271 0.004 0.341 0.393 0.255 0.080 0.015 0.177
Pixel PRO 0.225 0.377 0.617 0.208 0.652 0.932 0.340 0.700 0.693 0.024 0.814 0.907 0.243 0.597 0.704 0.535
CSFlow Image AUC 0.129 0.697 0.569 0.432 0.802 0.997 0.420 0.363 0.978 0.602 0.269 0.906 0.220 0.263 0.434 0.539
Image AP 0.624 0.888 0.784 0.369 0.939 0.999 0.641 0.800 0.994 0.774 0.500 0.969 0.681 0.775 0.708 0.763
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
CutPaste Image AUC 0.111 0.112 0.158 0.340 0.150 0.776 0.422 0.373 0.198 0.214 0.578 0.008 0.517 0.371 0.356 0.312
Image AP 0.601 0.552 0.553 0.318 0.594 0.890 0.607 0.785 0.606 0.598 0.732 0.534 0.855 0.827 0.701 0.650
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
DRAEM Image AUC 0.793 0.411 0.517 0.537 0.799 0.524 0.480 0.422 0.452 1.000 0.548 0.625 0.307 0.517 0.996 0.595
Image AP 0.924 0.592 0.827 0.751 0.906 0.675 0.811 0.794 0.828 1.000 0.814 0.832 0.300 0.752 0.999 0.787
Pixel AUC 0.741 0.288 0.794 0.566 0.447 0.715 0.538 0.570 0.643 0.389 0.646 0.712 0.435 0.390 0.987 0.591
Pixel AP 0.117 0.019 0.044 0.018 0.005 0.036 0.013 0.142 0.104 0.002 0.130 0.039 0.040 0.033 0.734 0.098
Pixel PRO 0.316 0.069 0.579 0.199 0.066 0.314 0.257 0.214 0.370 0.000 0.242 0.305 0.057 0.135 0.943 0.271
FastFlow Image AUC 0.454 0.489 0.267 0.526 0.616 0.867 0.512 0.517 0.489 0.482 0.522 0.487 0.476 0.575 0.402 0.512
Image AP 0.748 0.713 0.592 0.413 0.805 0.939 0.643 0.822 0.757 0.723 0.648 0.736 0.827 0.893 0.710 0.731
Pixel AUC 0.406 0.462 0.536 0.393 0.500 0.951 0.377 0.669 0.461 0.354 0.625 0.551 0.408 0.467 0.631 0.519
Pixel AP 0.044 0.061 0.015 0.036 0.037 0.264 0.021 0.013 0.013 0.005 0.028 0.007 0.090 0.029 0.003 0.044
Pixel PRO 0.053 0.098 0.068 0.029 0.135 0.836 0.023 0.221 0.054 0.058 0.261 0.090 0.036 0.124 0.205 0.153
FAVAE Image AUC 0.666 0.563 0.503 0.331 0.728 0.544 0.396 0.357 0.610 0.644 0.884 0.406 0.416 0.531 0.624 0.547
Image AP 0.874 0.778 0.762 0.318 0.886 0.846 0.552 0.762 0.846 0.800 0.943 0.741 0.810 0.877 0.784 0.772
Pixel AUC 0.544 0.459 0.829 0.491 0.671 0.667 0.689 0.858 0.506 0.316 0.937 0.840 0.682 0.694 0.927 0.674
Pixel AP 0.086 0.064 0.043 0.046 0.093 0.039 0.048 0.039 0.015 0.004 0.389 0.112 0.174 0.070 0.017 0.083
Pixel PRO 0.284 0.187 0.506 0.175 0.489 0.290 0.304 0.669 0.078 0.050 0.732 0.590 0.202 0.537 0.759 0.390
PaDiM Image AUC 0.458 0.581 0.678 0.408 0.549 0.855 0.544 0.418 0.454 0.704 0.635 0.418 0.446 0.449 0.578 0.545
Image AP 0.786 0.766 0.872 0.368 0.824 0.939 0.682 0.790 0.735 0.848 0.795 0.708 0.775 0.839 0.785 0.767
Pixel AUC 0.572 0.497 0.825 0.535 0.702 0.981 0.550 0.808 0.676 0.458 0.898 0.773 0.656 0.617 0.915 0.697
Pixel AP 0.073 0.065 0.044 0.049 0.080 0.452 0.038 0.030 0.023 0.006 0.183 0.039 0.155 0.044 0.014 0.086
Pixel PRO 0.299 0.201 0.557 0.198 0.570 0.935 0.292 0.566 0.219 0.077 0.776 0.513 0.246 0.447 0.716 0.441
PatchCore Image AUC 1.000 0.990 0.811 0.942 0.994 0.964 0.909 0.782 0.972 0.896 0.999 1.000 0.967 0.831 0.731 0.919
Image AP 1.000 0.996 0.932 0.943 0.998 0.989 0.949 0.954 0.992 0.967 1.000 1.000 0.992 0.968 0.888 0.971
Pixel AUC 0.979 0.931 0.973 0.870 0.917 0.984 0.835 0.964 0.987 0.895 0.980 0.991 0.960 0.960 0.941 0.944
Pixel AP 0.703 0.414 0.509 0.513 0.383 0.523 0.345 0.418 0.539 0.249 0.548 0.399 0.800 0.699 0.176 0.481
Pixel PRO 0.920 0.789 0.726 0.771 0.845 0.933 0.812 0.816 0.933 0.724 0.934 0.967 0.878 0.901 0.758 0.847
RD4AD Image AUC 0.401 0.715 0.397 0.385 0.700 0.987 0.538 0.475 0.583 0.558 0.909 0.596 0.623 0.479 0.596 0.596
Image AP 0.728 0.876 0.686 0.337 0.891 0.996 0.696 0.822 0.855 0.795 0.955 0.819 0.892 0.862 0.801 0.801
Pixel AUC 0.535 0.724 0.798 0.568 0.781 0.983 0.579 0.880 0.934 0.360 0.928 0.905 0.724 0.687 0.916 0.753
Pixel AP 0.055 0.193 0.034 0.060 0.097 0.562 0.040 0.064 0.212 0.005 0.384 0.116 0.247 0.061 0.016 0.143
Pixel PRO 0.103 0.455 0.540 0.236 0.630 0.950 0.309 0.705 0.793 0.082 0.822 0.749 0.287 0.581 0.724 0.531
SPADE Image AUC 0.302 0.881 0.386 0.622 0.897 0.949 0.444 0.525 0.529 0.460 0.410 0.577 0.592 0.484 0.514 0.572
Image AP 0.694 0.955 0.703 0.559 0.962 0.985 0.593 0.853 0.817 0.730 0.565 0.818 0.880 0.848 0.753 0.781
Pixel AUC 0.646 0.569 0.817 0.517 0.788 0.983 0.638 0.874 0.880 0.294 0.942 0.929 0.699 0.681 0.936 0.746
Pixel AP 0.122 0.096 0.043 0.050 0.172 0.531 0.052 0.044 0.117 0.004 0.513 0.264 0.182 0.060 0.020 0.151
Pixel PRO 0.393 0.331 0.568 0.234 0.743 0.933 0.426 0.725 0.682 0.038 0.878 0.863 0.310 0.643 0.787 0.570
STPM Image AUC 0.329 0.736 0.375 0.450 0.779 0.783 0.539 0.610 0.462 0.569 0.540 0.740 0.456 0.523 0.753 0.576
Image AP 0.683 0.879 0.639 0.433 0.912 0.936 0.677 0.887 0.779 0.754 0.699 0.908 0.833 0.878 0.898 0.786
Pixel AUC 0.622 0.724 0.781 0.461 0.539 0.793 0.316 0.814 0.698 0.338 0.730 0.886 0.783 0.729 0.172 0.626
Pixel AP 0.074 0.397 0.046 0.046 0.119 0.203 0.019 0.073 0.055 0.005 0.037 0.108 0.354 0.111 0.001 0.110
Pixel PRO 0.189 0.383 0.481 0.139 0.270 0.579 0.104 0.565 0.395 0.055 0.185 0.697 0.332 0.449 0.008 0.322
DNE Image AUC 0.550 0.500 0.500 0.500 0.612 0.513 0.979 0.500 0.500 0.500 0.500 0.500 0.500 0.816 0.960 0.595
Image AP 0.778 0.613 0.826 0.761 0.778 0.642 0.986 0.809 0.844 0.744 0.718 0.714 0.400 0.896 0.980 0.766
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -

The Corresponding FM of continual setting on MVTec AD

Continual MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA Image AUC FM 0.691 0.504 0.697 0.146 0.406 0.097 0.065 0.533 0.444 0.418 0.237 0.422 0.676 0.074 0.000 0.361
Image AP FM 0.326 0.345 0.241 0.047 0.230 0.060 0.019 0.147 0.107 0.226 0.096 0.211 0.640 0.025 0.000 0.181
Pixel AUC FM 0.371 0.331 0.069 0.121 0.698 0.063 0.026 0.194 0.241 0.052 0.335 0.135 0.444 0.186 0.000 0.218
Pixel AP FM 0.659 0.632 0.391 0.247 0.298 0.239 0.000 0.565 0.660 0.214 0.247 0.437 0.669 0.128 0.000 0.359
Pixel PRO FM 0.707 0.582 0.142 0.234 0.906 0.124 0.057 0.659 0.322 0.146 0.389 0.249 0.733 0.207 0.000 0.364
CSFlow Image AUC FM 0.871 0.533 0.412 0.022 0.357 0.677 0.094 0.747 0.705 0.536 0.296 0.400 0.552 0.196 0.000 0.426
Image AP FM 0.376 0.328 0.139 0.006 0.212 0.471 0.031 0.311 0.219 0.281 0.109 0.205 0.613 0.060 0.000 0.224
Pixel AUC FM - - - - - - - - - - - - - - - -
Pixel AP FM - - - - - - - - - - - - - - - -
Pixel PRO FM - - - - - - - - - - - - - - - -
CutPaste Image AUC FM 0.889 0.549 0.360 0.754 0.728 0.360 0.992 0.407 0.399 0.261 0.399 0.767 0.387 0.399 0.000 0.510
Image AP FM 0.399 0.378 0.147 0.377 0.375 0.230 0.466 0.125 0.124 0.112 0.258 0.417 0.397 0.250 0.000 0.270
Pixel AUC FM - - - - - - - - - - - - - - - -
Pixel AP FM - - - - - - - - - - - - - - - -
Pixel PRO FM - - - - - - - - - - - - - - - -
DRAEM Image AUC FM 0.581 0.319 0.415 0.120 0.472 0.516 0.578 0.530 -0.083 0.452 0.375 0.501 0.212 0.004 0.000 0.333
Image AP FM 0.405 0.077 0.239 0.066 0.324 0.186 0.206 0.169 -0.016 0.186 0.168 0.620 0.081 0.001 0.000 0.181
Pixel AUC FM 0.703 0.149 0.353 0.510 0.262 0.456 0.424 0.343 0.573 0.320 0.283 0.540 0.408 -0.023 0.000 0.353
Pixel AP FM 0.867 0.511 0.473 0.490 0.343 0.813 0.482 0.814 0.469 0.360 0.924 0.353 0.294 0.063 0.000 0.484
Pixel PRO FM 0.891 0.140 0.657 0.817 0.611 0.711 0.751 0.558 0.748 0.627 0.657 0.769 0.512 -0.049 0.000 0.560
FastFlow Image AUC FM 0.546 0.100 0.280 0.465 0.138 0.092 0.312 0.188 0.161 0.597 0.374 0.400 0.184 0.356 0.000 0.279
Image AP FM 0.252 0.076 0.120 0.230 0.096 0.070 0.183 0.050 0.032 0.290 0.234 0.233 0.252 0.186 0.000 0.154
Pixel AUC FM 0.574 0.401 0.287 0.525 0.527 0.218 0.421 0.410 0.407 0.242 0.414 0.389 0.552 0.336 0.000 0.380
Pixel AP FM 0.636 0.056 0.275 0.622 0.065 0.056 0.228 0.172 0.152 0.014 0.249 0.215 0.317 0.157 0.000 0.214
Pixel PRO FM 0.861 0.313 0.579 0.884 0.608 0.310 0.843 0.495 0.643 0.429 0.575 0.501 0.767 0.620 0.000 0.562
FAVAE Image AUC FM 0.305 0.469 0.068 0.122 0.064 0.008 0.177 0.012 0.015 0.087 0.039 0.003 0.043 0.113 0.000 0.102
Image AP FM 0.118 0.337 0.045 0.053 0.018 0.004 0.095 0.006 0.004 0.035 0.045 0.006 0.015 0.054 0.000 0.056
Pixel AUC FM 0.414 0.262 0.080 0.337 0.057 0.006 0.101 0.008 0.043 0.001 0.120 0.007 0.045 0.133 0.000 0.108
Pixel AP FM 0.568 0.317 0.050 0.069 0.001 0.017 0.059 0.003 0.014 0.000 0.032 0.002 0.008 0.102 0.000 0.083
Pixel PRO FM 0.590 0.492 0.147 0.412 0.023 0.018 0.259 0.008 0.030 0.004 0.147 0.001 0.044 0.190 0.000 0.158
PaDiM Image AUC FM 0.536 0.306 0.457 0.526 0.215 0.280 0.582 0.496 0.360 0.231 0.367 0.228 0.497 0.443 0.000 0.368
Image AP FM 0.212 0.225 0.172 0.259 0.123 0.162 0.292 0.208 0.114 0.122 0.215 0.088 0.512 0.174 0.000 0.192
Pixel AUC FM 0.412 0.404 0.177 0.312 0.486 0.080 0.219 0.310 0.340 0.063 0.409 0.163 0.431 0.228 0.000 0.269
Pixel AP FM 0.658 0.305 0.364 0.578 0.243 0.334 0.367 0.559 0.379 0.151 0.269 0.455 0.531 0.294 0.000 0.366
Pixel PRO FM 0.651 0.590 0.370 0.737 0.790 0.160 0.462 0.675 0.482 0.203 0.552 0.372 0.710 0.330 0.000 0.472
PatchCore Image AUC FM 0.000 0.014 0.021 0.000 0.000 0.001 0.000 0.001 0.007 0.000 0.000 0.008 -0.002 0.000 0.000 0.003
Image AP FM 0.000 0.008 0.005 0.000 0.000 0.000 0.000 0.000 0.001 0.000 0.000 0.007 -0.003 0.000 0.000 0.001
Pixel AUC FM 0.000 0.022 0.000 0.000 0.000 0.003 0.000 0.000 0.000 0.000 0.000 0.001 0.000 0.000 0.000 0.002
Pixel AP FM 0.000 0.029 0.002 0.001 0.000 0.007 0.001 0.000 0.015 0.000 0.000 0.019 0.002 0.000 0.000 0.005
Pixel PRO FM 0.000 0.008 0.000 0.000 0.000 0.001 0.000 0.001 0.000 0.000 0.000 -0.001 0.000 0.000 0.000 0.001
RD4AD Image AUC FM 0.599 0.440 0.510 0.400 0.438 0.091 0.404 0.377 0.495 0.379 0.279 0.603 0.590 0.284 0.000 0.393
Image AP FM 0.272 0.290 0.175 0.141 0.204 0.045 0.181 0.108 0.133 0.191 0.121 0.314 0.638 0.104 0.000 0.194
Pixel AUC FM 0.453 0.386 0.106 0.055 0.633 0.063 0.089 0.249 0.302 0.079 0.236 0.192 0.325 0.176 0.000 0.223
Pixel AP FM 0.728 0.468 0.378 0.357 0.469 0.234 0.354 0.527 0.776 0.423 0.351 0.449 0.464 0.400 0.000 0.425
Pixel PRO FM 0.856 0.587 0.245 0.154 0.889 0.137 0.226 0.656 0.383 0.240 0.403 0.386 0.568 0.279 0.000 0.401
SPADE Image AUC FM 0.692 0.418 0.308 0.255 0.034 0.561 0.328 0.267 0.238 0.036 0.092 0.564 0.291 -0.011 0.000 0.272
Image AP FM 0.304 0.320 0.109 0.112 0.018 0.421 0.151 0.082 0.082 0.026 0.035 0.277 0.341 0.007 0.000 0.152
Pixel AUC FM 0.325 0.278 0.113 0.095 0.682 0.047 0.064 0.271 0.270 0.001 0.289 0.175 0.329 0.138 0.000 0.205
Pixel AP FM 0.576 0.182 0.394 0.402 0.232 0.149 0.218 0.611 0.392 0.000 0.170 0.530 0.272 0.246 0.000 0.292
Pixel PRO FM 0.542 0.367 0.230 0.231 0.882 0.079 0.113 0.617 0.286 0.000 0.316 0.380 0.486 0.159 0.000 0.313
STPM Image AUC FM 0.671 0.221 0.258 0.480 0.431 0.454 0.248 0.279 0.367 0.246 0.251 0.478 0.273 0.214 0.000 0.325
Image AP FM 0.317 0.186 0.080 0.206 0.246 0.298 0.088 0.095 0.101 0.102 0.115 0.305 0.234 0.086 0.000 0.164
Pixel AUC FM 0.362 0.606 0.154 0.277 0.651 0.254 0.108 0.012 0.240 0.000 0.245 0.200 0.297 0.403 0.000 0.254
Pixel AP FM 0.660 0.415 0.245 0.539 0.442 0.529 0.404 0.000 0.610 0.000 0.388 0.362 0.234 0.452 0.000 0.352
Pixel PRO FM 0.761 0.632 0.347 0.508 0.906 0.751 0.280 0.060 0.437 0.000 0.477 0.387 0.453 0.625 0.000 0.442
DNE Image AUC FM 0.410 0.251 0.023 0.364 0.274 0.446 0.021 0.117 0.074 0.054 0.423 0.250 0.179 0.107 0.000 0.200
Image AP FM 0.203 0.193 0.008 0.172 0.198 0.323 0.014 0.043 0.010 0.023 0.238 0.143 0.083 0.068 0.000 0.115
Pixel AUC FM - - - - - - - - - - - - - - - -
Pixel AP FM - - - - - - - - - - - - - - - -
Pixel PRO FM - - - - - - - - - - - - - - - -

The results with 1 shot images on MVTec AD

FewShot 1 MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA Image AUC 0.994 0.637 0.958 0.839 0.796 0.983 0.875 0.653 0.982 0.594 0.954 0.999 0.743 0.673 0.521 0.813
Image AP 0.998 0.744 0.985 0.940 0.781 0.995 0.954 0.844 0.995 0.788 0.973 1.000 0.905 0.925 0.755 0.905
Pixel AUC 0.981 0.948 0.935 0.981 0.864 0.915 0.980 0.974 0.987 0.588 0.969 0.993 0.938 0.949 0.915 0.928
Pixel AP 0.751 0.289 0.432 0.592 0.399 0.438 0.524 0.179 0.633 0.009 0.495 0.461 0.614 0.526 0.016 0.424
Pixel PRO 0.945 0.816 0.793 0.790 0.673 0.881 0.926 0.896 0.941 0.179 0.902 0.973 0.809 0.899 0.711 0.809
CSFlow Image AUC 0.944 0.746 0.927 0.614 0.733 0.875 0.762 0.610 0.999 0.703 0.580 0.996 0.424 0.599 0.631 0.743
Image AP 0.965 0.829 0.973 0.824 0.730 0.967 0.899 0.870 1.000 0.846 0.739 0.999 0.778 0.899 0.849 0.878
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
CutPaste Image AUC 0.865 0.475 0.955 0.639 0.820 0.917 0.334 0.647 0.648 0.549 0.751 0.682 0.534 0.362 0.578 0.650
Image AP 0.953 0.574 0.981 0.831 0.797 0.978 0.742 0.894 0.874 0.790 0.811 0.881 0.819 0.803 0.828 0.837
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
DRAEM Image AUC 0.686 0.588 0.447 0.756 0.932 0.510 0.631 0.715 0.714 0.350 0.823 0.644 0.768 0.904 0.802 0.685
Image AP 0.887 0.679 0.788 0.917 0.974 0.676 0.879 0.918 0.934 0.746 0.926 0.827 0.716 0.972 0.938 0.852
Pixel AUC 0.824 0.586 0.785 0.781 0.468 0.873 0.706 0.792 0.866 0.880 0.740 0.884 0.622 0.666 0.777 0.750
Pixel AP 0.256 0.037 0.042 0.113 0.006 0.335 0.150 0.340 0.262 0.018 0.375 0.084 0.099 0.121 0.067 0.154
Pixel PRO 0.507 0.289 0.524 0.575 0.076 0.758 0.379 0.574 0.792 0.607 0.477 0.611 0.410 0.336 0.476 0.493
FastFlow Image AUC 0.500 0.500 0.500 0.817 0.500 0.968 0.500 0.500 0.500 0.500 0.500 0.500 0.500 0.500 0.500 0.552
Image AP 0.759 0.613 0.718 0.929 0.400 0.991 0.788 0.826 0.761 0.731 0.636 0.742 0.809 0.844 0.744 0.753
Pixel AUC 0.665 0.512 0.501 0.965 0.516 0.824 0.567 0.546 0.489 0.528 0.522 0.501 0.554 0.509 0.519 0.581
Pixel AP 0.084 0.029 0.071 0.496 0.050 0.210 0.024 0.010 0.016 0.007 0.022 0.007 0.129 0.034 0.003 0.079
Pixel PRO 0.000 0.000 0.000 0.674 0.000 0.772 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.096
FAVAE Image AUC 0.968 0.436 0.639 0.669 0.443 0.700 0.695 0.544 0.764 0.667 0.904 0.355 0.518 0.656 0.210 0.611
Image AP 0.991 0.571 0.834 0.841 0.412 0.889 0.897 0.842 0.921 0.802 0.952 0.728 0.824 0.906 0.595 0.800
Pixel AUC 0.958 0.841 0.657 0.944 0.710 0.590 0.841 0.966 0.944 0.437 0.955 0.581 0.756 0.528 0.874 0.772
Pixel AP 0.655 0.082 0.130 0.288 0.081 0.050 0.112 0.172 0.420 0.006 0.438 0.008 0.233 0.033 0.009 0.181
Pixel PRO 0.880 0.443 0.418 0.659 0.272 0.233 0.555 0.861 0.794 0.116 0.773 0.198 0.284 0.173 0.586 0.483
PaDiM Image AUC 0.913 0.556 0.690 0.900 0.497 0.921 0.633 0.587 0.830 0.566 0.951 0.929 0.376 0.430 0.478 0.684
Image AP 0.974 0.655 0.856 0.957 0.458 0.976 0.857 0.860 0.945 0.813 0.976 0.977 0.761 0.808 0.742 0.841
Pixel AUC 0.945 0.836 0.617 0.981 0.759 0.871 0.919 0.964 0.931 0.509 0.955 0.969 0.766 0.850 0.898 0.851
Pixel AP 0.613 0.092 0.117 0.522 0.096 0.323 0.166 0.147 0.407 0.007 0.454 0.373 0.210 0.126 0.014 0.244
Pixel PRO 0.880 0.513 0.375 0.870 0.389 0.843 0.727 0.872 0.834 0.152 0.911 0.931 0.438 0.747 0.673 0.677
PatchCore Image AUC 0.502 0.506 0.900 0.536 0.537 0.849 0.437 0.444 0.904 0.590 0.641 0.952 0.443 0.546 0.496 0.619
Image AP 0.818 0.620 0.963 0.818 0.451 0.957 0.788 0.808 0.973 0.794 0.797 0.986 0.826 0.880 0.721 0.813
Pixel AUC 0.810 0.793 0.871 0.914 0.710 0.861 0.792 0.702 0.978 0.647 0.950 0.990 0.765 0.795 0.878 0.830
Pixel AP 0.266 0.104 0.335 0.476 0.253 0.348 0.144 0.049 0.549 0.010 0.365 0.389 0.277 0.253 0.014 0.255
Pixel PRO 0.574 0.483 0.686 0.411 0.482 0.829 0.490 0.304 0.903 0.233 0.863 0.964 0.433 0.489 0.655 0.587
RD4AD Image AUC 0.987 0.586 0.979 0.819 0.484 0.986 0.850 0.614 1.000 0.684 0.965 1.000 0.477 0.685 0.483 0.773
Image AP 0.996 0.737 0.993 0.933 0.443 0.996 0.945 0.874 1.000 0.874 0.979 1.000 0.825 0.914 0.757 0.884
Pixel AUC 0.981 0.835 0.945 0.963 0.790 0.947 0.955 0.967 0.992 0.760 0.977 0.995 0.836 0.933 0.927 0.920
Pixel AP 0.772 0.106 0.486 0.312 0.125 0.505 0.338 0.196 0.703 0.118 0.543 0.549 0.288 0.458 0.017 0.368
Pixel PRO 0.946 0.458 0.834 0.721 0.507 0.925 0.856 0.846 0.969 0.541 0.939 0.979 0.550 0.849 0.751 0.778
STPM Image AUC 0.994 0.489 0.956 0.722 0.605 0.990 0.834 0.601 0.971 0.698 0.913 0.996 0.824 0.920 0.460 0.798
Image AP 0.998 0.649 0.976 0.878 0.618 0.997 0.941 0.855 0.991 0.850 0.941 0.999 0.955 0.981 0.707 0.889
Pixel AUC 0.976 0.866 0.970 0.963 0.728 0.933 0.955 0.965 0.988 0.767 0.978 0.993 0.927 0.982 0.925 0.928
Pixel AP 0.697 0.193 0.684 0.306 0.228 0.509 0.380 0.124 0.699 0.068 0.547 0.484 0.617 0.734 0.017 0.419
Pixel PRO 0.940 0.589 0.885 0.730 0.532 0.899 0.874 0.908 0.948 0.437 0.935 0.977 0.827 0.951 0.737 0.811
RegAD Image AUC 0.990 0.635 0.634 0.951 0.716 0.974 0.999 0.902 0.701 0.539 0.977 0.826 0.787 0.978 0.808 0.828
Image AP 0.997 0.734 0.869 0.986 0.871 0.987 1.000 0.976 0.932 0.781 0.991 0.934 0.761 0.993 0.940 0.917
Pixel AUC 0.983 0.920 0.970 0.987 0.700 0.978 0.992 0.941 0.957 0.931 0.936 0.975 0.879 0.957 0.953 0.937
Pixel AP 0.755 0.192 0.185 0.556 0.028 0.556 0.455 0.596 0.610 0.019 0.486 0.404 0.359 0.546 0.314 0.404
Pixel PRO 0.932 0.700 0.852 0.944 0.409 0.917 0.976 0.840 0.884 0.760 0.816 0.841 0.695 0.893 0.836 0.820

The results with 2 shot images on MVTec AD

FewShot 2 MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA Image AUC 0.996 0.873 0.983 0.725 0.701 0.993 0.932 0.663 0.970 0.639 0.972 1.000 0.868 0.789 0.487 0.839
Image AP 0.999 0.917 0.993 0.891 0.698 0.998 0.978 0.857 0.992 0.827 0.986 1.000 0.964 0.956 0.746 0.920
Pixel AUC 0.983 0.966 0.945 0.964 0.862 0.938 0.985 0.977 0.986 0.701 0.971 0.993 0.959 0.969 0.915 0.941
Pixel AP 0.753 0.475 0.444 0.455 0.354 0.432 0.583 0.197 0.594 0.016 0.508 0.457 0.771 0.674 0.016 0.449
Pixel PRO 0.943 0.857 0.814 0.749 0.670 0.892 0.938 0.905 0.934 0.300 0.917 0.974 0.868 0.932 0.732 0.828
CSFlow Image AUC 0.949 0.499 0.964 0.711 0.807 0.888 0.682 0.638 1.000 0.786 0.557 0.995 0.429 0.639 0.610 0.743
Image AP 0.964 0.673 0.987 0.875 0.831 0.966 0.878 0.881 1.000 0.911 0.720 0.998 0.776 0.907 0.832 0.880
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
CutPaste Image AUC 0.908 0.712 0.968 0.719 0.295 0.691 0.769 0.524 0.679 0.554 0.835 0.900 0.623 0.728 0.544 0.697
Image AP 0.972 0.790 0.987 0.884 0.338 0.897 0.934 0.858 0.888 0.763 0.912 0.969 0.845 0.942 0.772 0.850
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
DRAEM Image AUC 0.936 0.585 0.483 0.876 0.853 0.758 0.981 0.921 0.756 0.073 0.892 0.747 0.852 0.961 0.980 0.777
Image AP 0.981 0.662 0.791 0.964 0.945 0.867 0.992 0.978 0.943 0.548 0.960 0.848 0.845 0.988 0.994 0.887
Pixel AUC 0.857 0.723 0.815 0.798 0.748 0.938 0.902 0.835 0.932 0.876 0.850 0.906 0.674 0.842 0.882 0.839
Pixel AP 0.505 0.071 0.052 0.224 0.021 0.550 0.469 0.455 0.580 0.019 0.576 0.075 0.161 0.488 0.290 0.302
Pixel PRO 0.683 0.470 0.650 0.663 0.361 0.905 0.869 0.792 0.891 0.612 0.677 0.712 0.515 0.738 0.707 0.683
FastFlow Image AUC 0.500 0.587 0.500 0.500 0.548 0.500 0.818 0.500 0.500 0.500 0.500 0.500 0.517 0.813 0.500 0.552
Image AP 0.759 0.700 0.718 0.714 0.485 0.760 0.927 0.826 0.761 0.731 0.636 0.742 0.814 0.959 0.744 0.752
Pixel AUC 0.923 0.790 0.486 0.899 0.812 0.622 0.887 0.766 0.328 0.516 0.504 0.863 0.730 0.930 0.194 0.683
Pixel AP 0.367 0.096 0.074 0.078 0.206 0.066 0.204 0.078 0.011 0.007 0.025 0.083 0.258 0.514 0.001 0.138
Pixel PRO 0.663 0.465 0.158 0.514 0.493 0.284 0.704 0.367 0.103 0.000 0.285 0.706 0.369 0.801 0.019 0.395
FAVAE Image AUC 0.961 0.559 0.560 0.703 0.696 0.974 0.721 0.457 0.813 0.703 0.856 0.342 0.625 0.549 0.569 0.672
Image AP 0.989 0.634 0.727 0.878 0.705 0.992 0.897 0.817 0.937 0.861 0.929 0.703 0.856 0.871 0.768 0.837
Pixel AUC 0.965 0.858 0.650 0.936 0.756 0.838 0.897 0.958 0.964 0.469 0.946 0.617 0.690 0.856 0.908 0.820
Pixel AP 0.670 0.102 0.112 0.195 0.169 0.147 0.154 0.123 0.453 0.007 0.363 0.009 0.167 0.127 0.014 0.187
Pixel PRO 0.897 0.512 0.197 0.703 0.429 0.480 0.680 0.848 0.837 0.128 0.752 0.204 0.285 0.743 0.709 0.560
PaDiM Image AUC 0.969 0.475 0.763 0.694 0.627 0.949 0.695 0.571 0.838 0.587 0.941 0.974 0.572 0.461 0.505 0.708
Image AP 0.991 0.578 0.892 0.872 0.532 0.985 0.876 0.845 0.943 0.770 0.972 0.992 0.842 0.830 0.755 0.845
Pixel AUC 0.960 0.865 0.720 0.972 0.823 0.901 0.942 0.973 0.949 0.557 0.968 0.978 0.826 0.904 0.927 0.884
Pixel AP 0.668 0.112 0.164 0.427 0.146 0.335 0.286 0.178 0.489 0.008 0.487 0.384 0.269 0.191 0.017 0.277
Pixel PRO 0.898 0.590 0.469 0.838 0.499 0.864 0.808 0.895 0.873 0.239 0.932 0.958 0.587 0.856 0.765 0.738
PatchCore Image AUC 0.965 0.548 0.975 0.756 0.549 0.972 0.602 0.628 0.927 0.456 0.900 1.000 0.504 0.576 0.461 0.721
Image AP 0.991 0.685 0.991 0.903 0.543 0.992 0.872 0.898 0.980 0.725 0.951 1.000 0.806 0.893 0.730 0.864
Pixel AUC 0.896 0.847 0.925 0.946 0.764 0.893 0.858 0.885 0.981 0.559 0.955 0.992 0.761 0.909 0.739 0.860
Pixel AP 0.540 0.184 0.410 0.497 0.343 0.375 0.239 0.129 0.508 0.007 0.403 0.398 0.313 0.443 0.008 0.320
Pixel PRO 0.746 0.612 0.771 0.674 0.520 0.843 0.630 0.609 0.900 0.093 0.904 0.971 0.472 0.733 0.493 0.665
RD4AD Image AUC 0.991 0.725 0.977 0.606 0.550 0.984 0.856 0.639 1.000 0.682 0.949 1.000 0.751 0.659 0.493 0.791
Image AP 0.998 0.826 0.992 0.797 0.450 0.995 0.945 0.881 1.000 0.869 0.975 1.000 0.929 0.914 0.753 0.888
Pixel AUC 0.984 0.892 0.917 0.942 0.810 0.946 0.969 0.970 0.993 0.781 0.976 0.994 0.923 0.927 0.928 0.930
Pixel AP 0.788 0.183 0.416 0.137 0.137 0.504 0.403 0.212 0.689 0.092 0.555 0.529 0.551 0.372 0.019 0.372
Pixel PRO 0.949 0.604 0.780 0.690 0.559 0.918 0.901 0.871 0.971 0.557 0.936 0.978 0.752 0.887 0.762 0.808
STPM Image AUC 0.995 0.648 0.961 0.667 0.690 0.990 0.969 0.624 0.965 0.759 0.946 1.000 0.931 0.939 0.529 0.841
Image AP 0.999 0.797 0.978 0.845 0.680 0.997 0.991 0.867 0.990 0.907 0.973 1.000 0.983 0.989 0.748 0.916
Pixel AUC 0.979 0.868 0.968 0.947 0.736 0.955 0.973 0.969 0.990 0.865 0.981 0.995 0.935 0.979 0.934 0.938
Pixel AP 0.717 0.202 0.659 0.255 0.225 0.548 0.484 0.149 0.679 0.160 0.555 0.501 0.649 0.721 0.022 0.435
Pixel PRO 0.936 0.639 0.869 0.720 0.556 0.930 0.923 0.916 0.955 0.631 0.946 0.980 0.876 0.953 0.777 0.840
RegAD Image AUC 0.997 0.696 0.704 0.968 0.815 0.960 0.999 0.944 0.670 0.566 0.989 0.871 0.837 0.997 0.914 0.862
Image AP 0.999 0.774 0.895 0.991 0.922 0.978 1.000 0.987 0.922 0.789 0.996 0.952 0.821 0.999 0.959 0.932
Pixel AUC 0.985 0.945 0.978 0.989 0.790 0.981 0.992 0.980 0.971 0.942 0.953 0.980 0.945 0.966 0.984 0.959
Pixel AP 0.761 0.310 0.248 0.558 0.081 0.533 0.420 0.846 0.647 0.025 0.575 0.434 0.571 0.574 0.535 0.475
Pixel PRO 0.943 0.784 0.896 0.950 0.555 0.905 0.969 0.923 0.910 0.802 0.833 0.855 0.836 0.904 0.935 0.867

The results with 4 shot images on MVTec AD

FewShot 4 MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA Image AUC 1.000 0.794 0.994 0.847 0.930 0.995 0.930 0.668 0.980 0.775 0.948 1.000 0.950 0.882 0.490 0.879
Image AP 1.000 0.850 0.997 0.938 0.933 0.998 0.970 0.917 0.994 0.907 0.972 1.000 0.988 0.978 0.734 0.945
Pixel AUC 0.984 0.966 0.950 0.982 0.940 0.936 0.985 0.974 0.987 0.781 0.965 0.993 0.967 0.977 0.926 0.954
Pixel AP 0.754 0.509 0.457 0.543 0.550 0.430 0.565 0.320 0.594 0.052 0.459 0.431 0.821 0.728 0.017 0.482
Pixel PRO 0.949 0.862 0.828 0.830 0.855 0.891 0.941 0.886 0.938 0.497 0.894 0.972 0.897 0.945 0.749 0.862
CSFlow Image AUC 0.981 0.682 0.979 0.747 0.919 0.940 0.823 0.679 1.000 0.631 0.437 1.000 0.643 0.722 0.613 0.786
Image AP 0.993 0.768 0.993 0.879 0.913 0.983 0.936 0.918 1.000 0.801 0.590 1.000 0.871 0.929 0.815 0.893
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
CutPaste Image AUC 1.000 0.617 0.780 0.767 0.700 0.843 0.628 0.571 0.834 0.438 0.786 1.000 0.787 0.659 0.514 0.728
Image AP 1.000 0.705 0.897 0.909 0.695 0.952 0.874 0.866 0.947 0.730 0.859 1.000 0.946 0.890 0.735 0.867
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
DRAEM Image AUC 0.960 0.639 0.564 0.979 0.718 0.852 0.921 0.980 0.830 0.310 0.898 0.772 0.928 0.989 0.966 0.820
Image AP 0.987 0.712 0.825 0.994 0.885 0.893 0.973 0.996 0.965 0.662 0.962 0.878 0.917 0.997 0.991 0.909
Pixel AUC 0.903 0.763 0.582 0.901 0.822 0.960 0.952 0.837 0.949 0.876 0.913 0.909 0.701 0.869 0.836 0.852
Pixel AP 0.612 0.080 0.046 0.484 0.094 0.655 0.492 0.522 0.650 0.074 0.701 0.095 0.213 0.509 0.179 0.360
Pixel PRO 0.769 0.534 0.507 0.824 0.501 0.936 0.897 0.829 0.912 0.666 0.765 0.712 0.596 0.730 0.605 0.719
FastFlow Image AUC 0.974 0.574 0.718 0.697 0.785 0.950 0.791 0.788 0.604 0.532 0.873 0.994 0.546 0.716 0.394 0.729
Image AP 0.992 0.655 0.863 0.880 0.784 0.986 0.935 0.944 0.849 0.743 0.936 0.998 0.826 0.925 0.693 0.867
Pixel AUC 0.947 0.666 0.622 0.970 0.904 0.843 0.808 0.962 0.596 0.634 0.904 0.949 0.752 0.789 0.606 0.797
Pixel AP 0.529 0.081 0.127 0.360 0.419 0.216 0.074 0.270 0.048 0.013 0.329 0.424 0.231 0.172 0.005 0.220
Pixel PRO 0.788 0.270 0.304 0.751 0.685 0.789 0.530 0.859 0.381 0.299 0.828 0.919 0.444 0.649 0.298 0.586
FAVAE Image AUC 0.690 0.401 0.754 0.647 0.651 0.924 0.713 0.472 0.785 0.570 0.617 0.355 0.504 0.539 0.636 0.617
Image AP 0.871 0.569 0.902 0.832 0.658 0.976 0.886 0.814 0.927 0.792 0.716 0.725 0.823 0.887 0.794 0.811
Pixel AUC 0.678 0.820 0.666 0.953 0.759 0.840 0.857 0.960 0.958 0.498 0.917 0.723 0.726 0.869 0.918 0.809
Pixel AP 0.129 0.074 0.136 0.315 0.144 0.167 0.122 0.146 0.450 0.007 0.142 0.011 0.204 0.144 0.016 0.147
Pixel PRO 0.381 0.450 0.442 0.745 0.419 0.700 0.589 0.865 0.817 0.151 0.696 0.258 0.350 0.757 0.736 0.557
PaDiM Image AUC 0.980 0.587 0.874 0.583 0.750 0.977 0.697 0.665 0.855 0.573 0.885 0.952 0.547 0.511 0.391 0.722
Image AP 0.995 0.659 0.954 0.748 0.654 0.992 0.848 0.896 0.955 0.806 0.918 0.984 0.821 0.856 0.700 0.852
Pixel AUC 0.975 0.871 0.788 0.983 0.922 0.912 0.965 0.970 0.965 0.595 0.966 0.988 0.851 0.912 0.921 0.906
Pixel AP 0.711 0.112 0.220 0.507 0.311 0.378 0.369 0.236 0.495 0.009 0.460 0.427 0.314 0.237 0.016 0.320
Pixel PRO 0.931 0.605 0.563 0.874 0.782 0.881 0.877 0.893 0.890 0.235 0.924 0.964 0.633 0.874 0.749 0.778
PatchCore Image AUC 0.908 0.802 0.973 0.889 0.769 0.985 0.804 0.630 0.930 0.667 0.897 0.997 0.754 0.741 0.501 0.817
Image AP 0.977 0.887 0.990 0.957 0.772 0.996 0.929 0.904 0.981 0.846 0.950 0.999 0.932 0.947 0.747 0.921
Pixel AUC 0.966 0.917 0.929 0.963 0.806 0.918 0.934 0.918 0.985 0.640 0.952 0.991 0.887 0.876 0.833 0.901
Pixel AP 0.688 0.413 0.421 0.559 0.429 0.403 0.340 0.285 0.551 0.009 0.384 0.397 0.599 0.501 0.013 0.399
Pixel PRO 0.892 0.764 0.788 0.678 0.671 0.866 0.796 0.696 0.916 0.249 0.880 0.965 0.733 0.711 0.600 0.747
RD4AD Image AUC 0.999 0.795 0.965 0.886 0.754 0.983 0.841 0.669 1.000 0.668 0.947 1.000 0.842 0.711 0.437 0.833
Image AP 1.000 0.881 0.988 0.952 0.698 0.995 0.940 0.917 1.000 0.866 0.973 1.000 0.957 0.934 0.716 0.921
Pixel AUC 0.985 0.925 0.928 0.984 0.899 0.946 0.964 0.967 0.993 0.779 0.977 0.995 0.936 0.940 0.936 0.944
Pixel AP 0.783 0.293 0.438 0.534 0.304 0.468 0.388 0.348 0.682 0.134 0.548 0.524 0.661 0.495 0.022 0.441
Pixel PRO 0.954 0.747 0.806 0.847 0.764 0.923 0.894 0.868 0.970 0.531 0.926 0.978 0.840 0.907 0.784 0.849
STPM Image AUC 1.000 0.744 0.952 0.789 0.784 0.992 0.859 0.740 0.962 0.858 0.939 1.000 0.934 0.855 0.551 0.864
Image AP 1.000 0.841 0.974 0.913 0.776 0.998 0.947 0.939 0.989 0.947 0.969 1.000 0.981 0.959 0.763 0.933
Pixel AUC 0.982 0.904 0.973 0.983 0.777 0.959 0.976 0.962 0.989 0.903 0.977 0.995 0.940 0.941 0.944 0.947
Pixel AP 0.751 0.465 0.686 0.473 0.360 0.543 0.481 0.301 0.668 0.203 0.508 0.494 0.638 0.544 0.026 0.476
Pixel PRO 0.952 0.672 0.890 0.855 0.620 0.934 0.928 0.880 0.954 0.735 0.944 0.981 0.889 0.896 0.808 0.863
RegAD Image AUC 0.992 0.859 0.732 0.980 0.868 0.962 0.999 0.950 0.731 0.595 0.983 0.912 0.857 0.988 0.954 0.891
Image AP 0.998 0.904 0.906 0.994 0.951 0.978 1.000 0.988 0.941 0.799 0.994 0.966 0.854 0.996 0.985 0.950
Pixel AUC 0.985 0.957 0.981 0.989 0.856 0.984 0.990 0.965 0.973 0.962 0.926 0.985 0.941 0.963 0.986 0.963
Pixel AP 0.752 0.459 0.276 0.553 0.180 0.534 0.385 0.708 0.677 0.053 0.455 0.467 0.549 0.558 0.625 0.482
Pixel PRO 0.941 0.843 0.906 0.951 0.696 0.913 0.966 0.907 0.922 0.862 0.771 0.877 0.847 0.900 0.937 0.883

The results with 8 shot images on MVTec AD

FewShot 8 MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA Image AUC 1.000 0.924 0.996 0.967 0.864 0.994 0.945 0.850 0.974 0.832 0.996 1.000 0.980 0.920 0.596 0.923
Image AP 1.000 0.954 0.998 0.988 0.862 0.998 0.978 0.958 0.993 0.926 0.998 1.000 0.996 0.986 0.805 0.963
Pixel AUC 0.985 0.977 0.947 0.990 0.935 0.935 0.988 0.987 0.988 0.822 0.986 0.993 0.977 0.982 0.945 0.962
Pixel AP 0.756 0.593 0.431 0.568 0.519 0.429 0.593 0.453 0.565 0.093 0.605 0.438 0.859 0.765 0.032 0.513
Pixel PRO 0.949 0.903 0.814 0.894 0.858 0.890 0.948 0.937 0.940 0.489 0.943 0.971 0.928 0.956 0.806 0.882
CSFlow Image AUC 0.992 0.807 0.985 0.908 0.887 0.926 0.901 0.800 1.000 0.725 0.649 1.000 0.756 0.637 0.702 0.845
Image AP 0.997 0.887 0.995 0.965 0.864 0.979 0.967 0.946 1.000 0.889 0.772 1.000 0.929 0.901 0.851 0.929
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
CutPaste Image AUC 0.997 0.755 0.992 0.447 0.651 0.973 0.303 0.683 0.842 0.573 0.969 0.747 0.738 0.453 0.455 0.705
Image AP 0.999 0.851 0.997 0.734 0.611 0.992 0.713 0.922 0.950 0.794 0.985 0.903 0.916 0.858 0.692 0.861
Pixel AUC - - - - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - - - - -
DRAEM Image AUC 0.950 0.689 0.684 0.864 0.952 0.886 1.000 0.982 0.855 0.656 0.921 0.956 0.884 0.967 0.996 0.883
Image AP 0.982 0.779 0.920 0.960 0.984 0.930 1.000 0.996 0.967 0.863 0.973 0.984 0.897 0.989 0.999 0.948
Pixel AUC 0.921 0.711 0.679 0.912 0.902 0.984 0.957 0.941 0.943 0.886 0.972 0.976 0.746 0.919 0.946 0.893
Pixel AP 0.581 0.075 0.150 0.516 0.149 0.742 0.415 0.736 0.403 0.049 0.873 0.497 0.277 0.596 0.576 0.442
Pixel PRO 0.769 0.576 0.667 0.824 0.737 0.950 0.912 0.913 0.833 0.721 0.880 0.868 0.579 0.800 0.841 0.791
FastFlow Image AUC 0.994 0.892 0.874 0.856 0.855 0.908 0.846 0.782 0.787 0.541 0.684 0.996 0.743 0.786 0.464 0.801
Image AP 0.998 0.914 0.952 0.942 0.815 0.972 0.942 0.944 0.933 0.752 0.824 0.999 0.906 0.955 0.697 0.903
Pixel AUC 0.979 0.907 0.754 0.936 0.853 0.848 0.952 0.961 0.839 0.590 0.768 0.990 0.833 0.905 0.704 0.855
Pixel AP 0.699 0.281 0.297 0.180 0.331 0.274 0.320 0.235 0.174 0.011 0.177 0.546 0.328 0.333 0.005 0.279
Pixel PRO 0.917 0.726 0.522 0.776 0.503 0.728 0.866 0.841 0.670 0.246 0.759 0.976 0.621 0.809 0.268 0.682
FAVAE Image AUC 0.952 0.553 0.639 0.731 0.597 0.938 0.703 0.537 0.815 0.541 0.911 0.801 0.404 0.574 0.657 0.690
Image AP 0.985 0.679 0.842 0.874 0.541 0.979 0.871 0.838 0.939 0.796 0.958 0.935 0.764 0.896 0.805 0.847
Pixel AUC 0.961 0.872 0.646 0.947 0.689 0.863 0.868 0.963 0.957 0.465 0.954 0.975 0.729 0.851 0.926 0.844
Pixel AP 0.657 0.124 0.125 0.340 0.100 0.270 0.092 0.146 0.441 0.014 0.419 0.275 0.191 0.129 0.018 0.223
Pixel PRO 0.885 0.559 0.412 0.736 0.344 0.777 0.605 0.852 0.818 0.126 0.778 0.929 0.274 0.730 0.749 0.638
PaDiM Image AUC 0.985 0.663 0.845 0.883 0.782 0.962 0.749 0.762 0.903 0.602 0.858 0.992 0.662 0.474 0.524 0.776
Image AP 0.995 0.745 0.938 0.936 0.775 0.989 0.896 0.898 0.972 0.807 0.910 0.997 0.887 0.859 0.736 0.889
Pixel AUC 0.977 0.893 0.835 0.990 0.941 0.915 0.977 0.977 0.982 0.646 0.977 0.991 0.897 0.907 0.930 0.922
Pixel AP 0.718 0.143 0.262 0.600 0.412 0.386 0.439 0.282 0.591 0.012 0.532 0.440 0.413 0.190 0.019 0.362
Pixel PRO 0.937 0.710 0.607 0.929 0.818 0.890 0.915 0.906 0.935 0.326 0.936 0.974 0.732 0.855 0.773 0.816
PatchCore Image AUC 0.984 0.870 0.985 0.839 0.877 0.969 0.909 0.734 0.977 0.708 0.964 1.000 0.844 0.752 0.543 0.864
Image AP 0.996 0.928 0.994 0.943 0.876 0.991 0.962 0.933 0.994 0.826 0.982 1.000 0.961 0.946 0.757 0.939
Pixel AUC 0.976 0.940 0.933 0.984 0.811 0.901 0.961 0.945 0.987 0.746 0.974 0.991 0.915 0.932 0.906 0.927
Pixel AP 0.716 0.485 0.414 0.573 0.460 0.362 0.442 0.354 0.545 0.014 0.481 0.391 0.713 0.637 0.020 0.440
Pixel PRO 0.918 0.843 0.791 0.829 0.688 0.849 0.878 0.756 0.937 0.364 0.916 0.967 0.747 0.857 0.704 0.803
RD4AD Image AUC 1.000 0.897 0.981 0.992 0.883 0.992 0.873 0.779 0.995 0.861 0.992 1.000 0.968 0.836 0.495 0.903
Image AP 1.000 0.939 0.994 0.997 0.865 0.998 0.952 0.941 0.999 0.929 0.996 1.000 0.993 0.958 0.711 0.951
Pixel AUC 0.986 0.953 0.938 0.991 0.915 0.949 0.973 0.978 0.992 0.875 0.985 0.994 0.959 0.956 0.952 0.960
Pixel AP 0.785 0.399 0.462 0.581 0.467 0.492 0.465 0.398 0.660 0.114 0.603 0.521 0.760 0.597 0.041 0.490
Pixel PRO 0.955 0.850 0.824 0.921 0.797 0.922 0.916 0.906 0.965 0.626 0.945 0.978 0.903 0.928 0.817 0.883
SPADE Image AUC 0.982 0.808 0.928 0.697 0.892 0.831 0.937 0.725 0.768 0.521 0.895 0.872 0.769 0.607 0.491 0.781
Image AP 0.994 0.880 0.974 0.880 0.854 0.952 0.982 0.929 0.920 0.736 0.942 0.957 0.936 0.897 0.767 0.907
Pixel AUC 0.970 0.896 0.857 0.991 0.797 0.921 0.983 0.983 0.974 0.852 0.984 0.992 0.941 0.952 0.960 0.937
Pixel AP 0.697 0.192 0.265 0.586 0.234 0.409 0.532 0.364 0.513 0.036 0.630 0.483 0.636 0.464 0.037 0.405
Pixel PRO 0.929 0.747 0.646 0.938 0.647 0.897 0.934 0.944 0.911 0.621 0.953 0.976 0.878 0.930 0.860 0.854
STPM Image AUC 1.000 0.825 0.956 0.822 0.845 0.990 0.854 0.729 0.973 0.940 0.996 1.000 0.955 0.740 0.569 0.880
Image AP 1.000 0.894 0.978 0.922 0.829 0.997 0.945 0.898 0.992 0.981 0.998 1.000 0.989 0.928 0.743 0.940
Pixel AUC 0.984 0.928 0.975 0.987 0.778 0.962 0.981 0.967 0.990 0.936 0.981 0.995 0.962 0.960 0.951 0.956
Pixel AP 0.764 0.456 0.685 0.468 0.339 0.562 0.508 0.243 0.676 0.312 0.547 0.509 0.746 0.553 0.044 0.494
Pixel PRO 0.954 0.762 0.899 0.896 0.626 0.937 0.939 0.899 0.959 0.806 0.954 0.981 0.925 0.930 0.822 0.886
RegAD Image AUC 0.998 0.843 0.789 0.984 0.927 0.965 1.000 0.987 0.785 0.634 0.996 0.958 0.886 0.995 0.935 0.912
Image AP 0.999 0.892 0.926 0.995 0.974 0.981 1.000 0.997 0.952 0.815 0.999 0.984 0.859 0.999 0.979 0.957
Pixel AUC 0.985 0.960 0.985 0.989 0.904 0.985 0.993 0.984 0.977 0.972 0.961 0.989 0.959 0.965 0.974 0.972
Pixel AP 0.751 0.444 0.352 0.551 0.250 0.549 0.450 0.841 0.713 0.092 0.608 0.528 0.625 0.580 0.376 0.514
Pixel PRO 0.938 0.829 0.915 0.951 0.799 0.916 0.975 0.940 0.938 0.897 0.855 0.906 0.890 0.891 0.906 0.903

The results with few-shot augmentation on MVTec AD

Few-Shot augmentation MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
CFA-1 Image AUC 0.994 0.718 0.992 0.839 0.695 0.990 0.760 0.646 0.992 0.744 0.998 1.000 0.729 0.851 0.491 0.829
Image AP 0.998 0.806 0.997 0.940 0.685 0.997 0.922 0.877 0.998 0.849 0.999 1.000 0.898 0.970 0.732 0.911
Pixel AUC 0.983 0.933 0.943 0.981 0.857 0.909 0.964 0.971 0.991 0.695 0.981 0.993 0.933 0.968 0.934 0.936
Pixel AP 0.760 0.291 0.437 0.592 0.388 0.356 0.388 0.188 0.606 0.012 0.574 0.465 0.584 0.687 0.020 0.423
Pixel PRO 0.944 0.808 0.803 0.769 0.651 0.865 0.873 0.895 0.953 0.236 0.929 0.973 0.803 0.919 0.767 0.812
CFA-2 Image AUC 0.995 0.857 0.996 0.719 0.716 0.998 0.881 0.651 0.984 0.683 0.990 1.000 0.937 0.867 0.634 0.860
Image AP 0.999 0.909 0.998 0.887 0.669 1.000 0.963 0.861 0.995 0.869 0.995 1.000 0.985 0.973 0.831 0.929
Pixel AUC 0.984 0.943 0.945 0.953 0.864 0.934 0.968 0.971 0.990 0.731 0.985 0.993 0.963 0.983 0.954 0.944
Pixel AP 0.765 0.466 0.437 0.343 0.359 0.377 0.419 0.186 0.619 0.044 0.592 0.455 0.764 0.769 0.039 0.442
Pixel PRO 0.944 0.847 0.810 0.720 0.643 0.880 0.887 0.887 0.953 0.415 0.938 0.973 0.888 0.945 0.832 0.837
CFA-4 Image AUC 1.000 0.849 0.994 0.861 0.897 0.997 0.824 0.679 0.977 0.865 0.998 1.000 0.956 0.917 0.559 0.891
Image AP 1.000 0.915 0.998 0.942 0.861 0.999 0.941 0.922 0.993 0.953 0.999 1.000 0.990 0.984 0.757 0.950
Pixel AUC 0.984 0.943 0.947 0.981 0.929 0.928 0.965 0.971 0.988 0.856 0.987 0.992 0.967 0.986 0.958 0.959
Pixel AP 0.753 0.496 0.435 0.559 0.537 0.354 0.382 0.328 0.540 0.209 0.614 0.403 0.789 0.787 0.038 0.482
Pixel PRO 0.946 0.844 0.806 0.790 0.830 0.869 0.871 0.863 0.944 0.649 0.944 0.969 0.888 0.948 0.845 0.867
CFA-8 Image AUC 1.000 0.894 0.998 0.922 0.855 1.000 0.831 0.827 0.980 0.970 1.000 1.000 0.955 0.897 0.565 0.913
Image AP 1.000 0.940 0.999 0.971 0.833 1.000 0.949 0.955 0.995 0.990 1.000 1.000 0.990 0.979 0.785 0.959
Pixel AUC 0.985 0.939 0.942 0.985 0.936 0.927 0.974 0.982 0.988 0.935 0.988 0.992 0.967 0.984 0.961 0.966
Pixel AP 0.751 0.529 0.412 0.560 0.579 0.353 0.426 0.393 0.544 0.262 0.612 0.409 0.791 0.776 0.093 0.499
Pixel PRO 0.944 0.852 0.788 0.853 0.880 0.864 0.900 0.903 0.942 0.826 0.951 0.965 0.902 0.942 0.851 0.891
PatchCore-1 Image AUC 0.946 0.753 0.973 0.797 0.390 0.982 0.605 0.641 0.988 0.670 0.919 1.000 0.639 0.696 0.518 0.768
Image AP 0.985 0.861 0.990 0.925 0.426 0.995 0.859 0.903 0.997 0.804 0.961 1.000 0.874 0.929 0.757 0.884
Pixel AUC 0.955 0.896 0.923 0.967 0.682 0.915 0.874 0.850 0.990 0.670 0.968 0.991 0.874 0.897 0.881 0.889
Pixel AP 0.662 0.335 0.407 0.611 0.244 0.391 0.211 0.107 0.589 0.010 0.464 0.395 0.522 0.439 0.015 0.360
Pixel PRO 0.855 0.739 0.772 0.666 0.450 0.873 0.662 0.628 0.946 0.211 0.892 0.971 0.679 0.764 0.647 0.717
PatchCore-2 Image AUC 0.996 0.816 0.994 0.706 0.673 0.984 0.775 0.548 0.978 0.490 0.961 0.999 0.827 0.707 0.522 0.798
Image AP 0.999 0.897 0.997 0.891 0.628 0.995 0.933 0.841 0.994 0.758 0.981 1.000 0.956 0.940 0.791 0.907
Pixel AUC 0.975 0.919 0.938 0.967 0.744 0.908 0.924 0.897 0.989 0.632 0.972 0.992 0.899 0.937 0.888 0.905
Pixel AP 0.712 0.459 0.423 0.476 0.270 0.370 0.340 0.129 0.558 0.010 0.490 0.401 0.603 0.639 0.017 0.393
Pixel PRO 0.915 0.807 0.788 0.737 0.570 0.857 0.795 0.636 0.945 0.242 0.911 0.970 0.784 0.831 0.645 0.762
PatchCore-4 Image AUC 0.997 0.892 0.990 0.817 0.743 0.987 0.890 0.596 0.982 0.692 0.984 1.000 0.934 0.806 0.566 0.858
Image AP 0.999 0.940 0.996 0.930 0.733 0.996 0.959 0.895 0.995 0.861 0.991 1.000 0.985 0.963 0.775 0.934
Pixel AUC 0.978 0.924 0.940 0.976 0.796 0.904 0.949 0.934 0.989 0.723 0.978 0.991 0.941 0.953 0.832 0.920
Pixel AP 0.714 0.504 0.427 0.568 0.418 0.372 0.409 0.245 0.553 0.014 0.523 0.388 0.727 0.656 0.017 0.436
Pixel PRO 0.919 0.819 0.797 0.755 0.663 0.860 0.850 0.709 0.946 0.306 0.931 0.966 0.833 0.884 0.555 0.786
PatchCore-8 Image AUC 0.993 0.927 0.991 0.828 0.818 0.979 0.951 0.828 0.985 0.820 0.998 1.000 0.962 0.831 0.639 0.903
Image AP 0.998 0.964 0.997 0.945 0.771 0.994 0.982 0.963 0.996 0.923 0.999 1.000 0.992 0.968 0.824 0.954
Pixel AUC 0.981 0.935 0.941 0.982 0.825 0.900 0.979 0.933 0.989 0.834 0.984 0.992 0.962 0.940 0.916 0.939
Pixel AP 0.718 0.545 0.423 0.589 0.441 0.362 0.510 0.351 0.554 0.055 0.564 0.400 0.804 0.661 0.079 0.470
Pixel PRO 0.926 0.849 0.793 0.798 0.725 0.857 0.921 0.718 0.943 0.509 0.943 0.968 0.888 0.881 0.736 0.830

The results of semi-supervised methods with annotated images on MVTec AD

Semi-supervised MVTec AD Bottle cable capsule carpet grid hazelnut leather metal_nut pill screw tile toothbrush transistor wood zipper average
DevNet-1 Image AUC 0.698 0.580 0.444 0.509 0.466 0.394 0.413 0.538 0.380 0.596 0.495 0.361 0.758 0.538 0.524 0.513
Image AP 0.909 0.606 0.762 0.770 0.482 0.748 0.747 0.860 0.688 0.797 0.693 0.700 0.935 0.873 0.776 0.756
DRA-1 Image AUC 0.515 0.828 0.665 0.647 0.848 0.469 0.687 0.595 0.467 0.463 0.534 0.689 0.651 0.544 0.441 0.603
Image AP 0.758 0.868 0.870 0.839 0.799 0.773 0.874 0.858 0.774 0.709 0.701 0.904 0.894 0.872 0.697 0.813
DevNet-2 Image AUC 0.831 0.565 0.814 0.655 0.742 0.945 0.734 0.597 0.758 0.646 0.816 0.446 0.598 0.744 0.622 0.701
Image AP 0.955 0.604 0.931 0.870 0.738 0.980 0.921 0.898 0.926 0.838 0.909 0.797 0.879 0.940 0.813 0.867
DRA-2 Image AUC 0.618 0.828 0.915 0.702 0.865 0.514 0.728 0.628 0.653 0.629 0.671 0.824 0.597 0.548 0.505 0.682
Image AP 0.834 0.875 0.969 0.886 0.774 0.822 0.910 0.893 0.845 0.826 0.794 0.936 0.884 0.870 0.774 0.859
DevNet-4 Image AUC 0.848 0.534 0.823 0.651 0.794 0.986 0.727 0.730 0.898 0.633 0.935 0.809 0.879 0.429 0.538 0.748
Image AP 0.961 0.580 0.939 0.831 0.798 0.996 0.897 0.917 0.969 0.808 0.967 0.932 0.971 0.848 0.754 0.878
DRA-4 Image AUC 0.704 0.865 0.965 0.734 0.852 0.617 0.613 0.656 0.847 0.541 0.836 0.993 0.733 0.738 0.545 0.749
Image AP 0.891 0.905 0.986 0.882 0.798 0.862 0.836 0.902 0.957 0.776 0.922 0.998 0.921 0.941 0.793 0.891
DevNet-5 Image AUC 0.961 0.821 0.918 0.783 0.777 0.993 0.640 0.659 0.973 0.614 0.678 0.952 0.776 0.720 0.662 0.795
Image AP 0.990 0.886 0.974 0.916 0.798 0.998 0.827 0.914 0.992 0.789 0.836 0.985 0.946 0.940 0.787 0.905
DRA-5 Image AUC 0.897 0.857 0.829 0.731 0.792 0.757 0.735 0.715 0.801 0.588 0.593 0.992 0.772 0.754 0.640 0.763
Image AP 0.968 0.912 0.931 0.886 0.709 0.922 0.918 0.917 0.941 0.797 0.774 0.998 0.935 0.928 0.824 0.891
DevNet-8 Image AUC 0.973 0.799 0.988 0.939 0.876 0.995 0.894 0.923 0.945 0.659 0.912 0.923 0.954 0.736 0.545 0.871
Image AP 0.993 0.837 0.997 0.974 0.873 0.998 0.973 0.983 0.983 0.844 0.960 0.979 0.989 0.943 0.776 0.940
DRA-8 Image AUC 0.924 0.830 0.978 0.765 0.837 0.979 0.870 0.675 0.511 0.610 0.899 0.980 0.751 0.741 0.566 0.794
Image AP 0.980 0.887 0.992 0.888 0.807 0.993 0.964 0.917 0.773 0.827 0.948 0.994 0.931 0.937 0.784 0.908
DevNet-10 Image AUC 1.000 0.599 0.999 0.855 0.821 0.974 0.995 0.882 0.949 0.629 0.961 1.000 0.987 0.807 0.612 0.871
Image AP 1.000 0.650 1.000 0.954 0.828 0.992 0.999 0.977 0.984 0.859 0.979 1.000 0.997 0.961 0.779 0.931
DRA-10 Image AUC 0.962 0.814 0.849 0.614 0.792 0.994 0.976 0.775 0.855 0.579 0.964 1.000 0.767 0.779 0.608 0.822
Image AP 0.989 0.874 0.942 0.850 0.743 0.998 0.993 0.952 0.957 0.847 0.979 1.000 0.932 0.943 0.826 0.922

The results of vanilla setting on MVTec LOCO-AD

Vanilla MVTec LOCO-AD breakfast_box juice_bottle pushpins screw_bag splicing_connectors average
CFA Structural AUC 0.703 0.965 0.841 0.843 0.903 0.851
Logical AUC 0.765 0.934 0.679 0.653 0.807 0.768
Mean AUC 0.734 0.949 0.760 0.748 0.855 0.809
Structural sPRO 0.01 0.283 0.587 0.398 0.321 0.506 0.419
Logical sPRO 0.01 0.303 0.557 0.204 0.115 0.385 0.313
Mean sPRO 0.01 0.293 0.572 0.301 0.218 0.445 0.366
Structural sPRO 0.05 0.526 0.826 0.525 0.515 0.735 0.625
Logical sPRO 0.05 0.486 0.754 0.505 0.315 0.620 0.536
Mean sPRO 0.05 0.506 0.790 0.515 0.415 0.677 0.581
Structural sPRO 0.1 0.614 0.869 0.579 0.621 0.791 0.695
Logical sPRO 0.1 0.589 0.844 0.657 0.410 0.719 0.644
Mean sPRO 0.1 0.602 0.857 0.618 0.515 0.755 0.669
Structural sPRO 0.3 0.729 0.909 0.678 0.773 0.859 0.790
Logical sPRO 0.3 0.748 0.940 0.853 0.591 0.863 0.799
Mean sPRO 0.3 0.739 0.925 0.766 0.682 0.861 0.795
Structural sPRO 1.0 0.869 0.953 0.852 0.913 0.927 0.903
Logical sPRO 1.0 0.904 0.982 0.955 0.833 0.958 0.926
Mean sPRO 1.0 0.886 0.967 0.903 0.873 0.942 0.915
CSFlow Structural AUC 0.924 0.997 0.653 0.712 0.950 0.847
Logical AUC 0.852 0.992 0.572 0.588 0.910 0.783
Mean AUC 0.888 0.994 0.613 0.650 0.930 0.815
Structural sPRO - - - - - -
Logical sPRO - - - - - -
Mean sPRO - - - - - -
CutPaste Structural AUC 0.905 0.957 0.771 0.831 0.869 0.867
Logical AUC 0.823 0.893 0.680 0.729 0.769 0.779
Mean AUC 0.864 0.925 0.726 0.780 0.819 0.823
Structural sPRO - - - - - -
Logical sPRO - - - - - -
Mean sPRO - - - - - -
DRAEM Structural AUC 0.690 0.806 0.787 0.768 0.670 0.744
Logical AUC 0.778 0.932 0.595 0.668 0.668 0.728
Mean AUC 0.734 0.869 0.691 0.718 0.669 0.736
Structural sPRO 0.01 0.193 0.279 0.260 0.077 0.135 0.189
Logical sPRO 0.01 0.336 0.486 0.185 0.056 0.169 0.246
Mean sPRO 0.01 0.264 0.382 0.222 0.067 0.152 0.217
Structural sPRO 0.05 0.432 0.624 0.390 0.181 0.361 0.398
Logical sPRO 0.05 0.451 0.841 0.398 0.233 0.345 0.454
Mean sPRO 0.05 0.442 0.733 0.394 0.207 0.353 0.426
Structural sPRO 0.1 0.542 0.774 0.459 0.295 0.491 0.512
Logical sPRO 0.1 0.525 0.917 0.546 0.355 0.494 0.567
Mean sPRO 0.1 0.533 0.846 0.502 0.325 0.493 0.540
Structural sPRO 0.3 0.716 0.922 0.616 0.615 0.687 0.711
Logical sPRO 0.3 0.687 0.972 0.797 0.612 0.734 0.760
Mean sPRO 0.3 0.702 0.947 0.706 0.613 0.711 0.736
Structural sPRO 1.0 0.890 0.977 0.848 0.881 0.888 0.897
Logical sPRO 1.0 0.885 0.992 0.938 0.874 0.911 0.920
Mean sPRO 1.0 0.888 0.984 0.893 0.877 0.899 0.908
FastFlow Structural AUC 0.538 0.809 0.676 0.764 0.773 0.712
Logical AUC 0.649 0.885 0.651 0.680 0.769 0.727
Mean AUC 0.593 0.847 0.664 0.722 0.771 0.720
Structural sPRO 0.01 0.071 0.328 0.155 0.097 0.316 0.193
Logical sPRO 0.01 0.007 0.323 0.176 0.014 0.341 0.172
Mean sPRO 0.01 0.039 0.326 0.165 0.055 0.328 0.183
Structural sPRO 0.05 0.176 0.540 0.314 0.165 0.586 0.356
Logical sPRO 0.05 0.067 0.518 0.439 0.125 0.643 0.359
Mean sPRO 0.05 0.122 0.529 0.377 0.145 0.614 0.357
Structural sPRO 0.1 0.266 0.631 0.403 0.218 0.704 0.445
Logical sPRO 0.1 0.184 0.655 0.587 0.223 0.780 0.486
Mean sPRO 0.1 0.225 0.643 0.495 0.220 0.742 0.465
Structural sPRO 0.3 0.496 0.762 0.595 0.371 0.844 0.614
Logical sPRO 0.3 0.415 0.849 0.820 0.408 0.915 0.681
Mean sPRO 0.3 0.455 0.806 0.708 0.390 0.879 0.648
Structural sPRO 1.0 0.774 0.894 0.830 0.713 0.941 0.830
Logical sPRO 1.0 0.685 0.954 0.945 0.747 0.974 0.861
Mean sPRO 1.0 0.729 0.924 0.888 0.730 0.957 0.846
FAVAE Structural AUC 0.608 0.746 0.659 0.449 0.679 0.628
Logical AUC 0.647 0.763 0.680 0.486 0.717 0.659
Mean AUC 0.628 0.754 0.670 0.468 0.698 0.643
Structural sPRO 0.01 0.199 0.331 0.088 0.061 0.157 0.167
Logical sPRO 0.01 0.057 0.402 0.259 0.134 0.337 0.238
Mean sPRO 0.01 0.128 0.367 0.173 0.097 0.247 0.202
Structural sPRO 0.05 0.393 0.639 0.267 0.224 0.438 0.392
Logical sPRO 0.05 0.184 0.738 0.465 0.479 0.638 0.501
Mean sPRO 0.05 0.289 0.688 0.366 0.351 0.538 0.446
Structural sPRO 0.1 0.498 0.751 0.377 0.425 0.607 0.532
Logical sPRO 0.1 0.287 0.854 0.551 0.658 0.750 0.620
Mean sPRO 0.1 0.393 0.802 0.464 0.542 0.678 0.576
Structural sPRO 0.3 0.668 0.888 0.614 0.776 0.838 0.757
Logical sPRO 0.3 0.559 0.949 0.738 0.856 0.884 0.797
Mean sPRO 0.3 0.613 0.918 0.676 0.816 0.861 0.777
Structural sPRO 1.0 0.881 0.966 0.864 0.933 0.951 0.919
Logical sPRO 1.0 0.858 0.985 0.916 0.955 0.955 0.934
Mean sPRO 1.0 0.870 0.975 0.890 0.944 0.953 0.927
PaDiM Structural AUC 0.569 0.871 0.751 0.697 0.637 0.705
Logical AUC 0.581 0.890 0.512 0.534 0.666 0.637
Mean AUC 0.575 0.881 0.632 0.615 0.651 0.671
Structural sPRO 0.01 0.252 0.565 0.124 0.198 0.173 0.262
Logical sPRO 0.01 0.198 0.560 0.096 0.121 0.244 0.244
Mean sPRO 0.01 0.225 0.562 0.110 0.160 0.208 0.253
Structural sPRO 0.05 0.557 0.798 0.344 0.464 0.463 0.525
Logical sPRO 0.05 0.432 0.855 0.308 0.452 0.537 0.517
Mean sPRO 0.05 0.494 0.826 0.326 0.458 0.500 0.521
Structural sPRO 0.1 0.660 0.863 0.482 0.633 0.643 0.656
Logical sPRO 0.1 0.516 0.924 0.410 0.622 0.710 0.636
Mean sPRO 0.1 0.588 0.893 0.446 0.628 0.677 0.646
Structural sPRO 0.3 0.802 0.935 0.714 0.860 0.852 0.833
Logical sPRO 0.3 0.695 0.974 0.515 0.815 0.880 0.776
Mean sPRO 0.3 0.749 0.955 0.614 0.838 0.866 0.804
Structural sPRO 1.0 0.933 0.980 0.901 0.958 0.955 0.946
Logical sPRO 1.0 0.901 0.992 0.767 0.937 0.960 0.912
Mean sPRO 1.0 0.917 0.986 0.834 0.948 0.958 0.929
PatchCore Structural AUC 0.726 0.893 0.787 0.924 0.772 0.820
Logical AUC 0.828 0.829 0.617 0.573 0.601 0.690
Mean AUC 0.777 0.861 0.702 0.748 0.687 0.755
Structural sPRO 0.01 0.231 0.209 0.079 0.265 0.116 0.180
Logical sPRO 0.01 0.250 0.081 0.139 0.142 0.223 0.167
Mean sPRO 0.01 0.240 0.145 0.109 0.204 0.169 0.173
Structural sPRO 0.05 0.367 0.458 0.172 0.499 0.228 0.345
Logical sPRO 0.05 0.395 0.330 0.274 0.403 0.298 0.340
Mean sPRO 0.05 0.381 0.394 0.223 0.451 0.263 0.343
Structural sPRO 0.1 0.452 0.555 0.228 0.595 0.309 0.428
Logical sPRO 0.1 0.481 0.527 0.365 0.548 0.382 0.460
Mean sPRO 0.1 0.466 0.541 0.297 0.572 0.345 0.444
Structural sPRO 0.3 0.699 0.711 0.374 0.762 0.549 0.619
Logical sPRO 0.3 0.705 0.761 0.616 0.764 0.661 0.701
Mean sPRO 0.3 0.702 0.736 0.495 0.763 0.605 0.660
Structural sPRO 1.0 0.902 0.893 0.705 0.916 0.838 0.851
Logical sPRO 1.0 0.906 0.922 0.871 0.922 0.888 0.902
Mean sPRO 1.0 0.904 0.908 0.788 0.919 0.863 0.876
RD4AD Structural AUC 0.676 0.965 0.879 0.922 0.959 0.880
Logical AUC 0.697 0.912 0.611 0.502 0.748 0.694
Mean AUC 0.687 0.939 0.745 0.712 0.853 0.787
Structural sPRO 0.01 0.288 0.699 0.595 0.619 0.733 0.587
Logical sPRO 0.01 0.225 0.449 0.265 0.103 0.350 0.278
Mean sPRO 0.01 0.256 0.574 0.430 0.361 0.542 0.433
Structural sPRO 0.05 0.477 0.870 0.819 0.820 0.898 0.777
Logical sPRO 0.05 0.369 0.806 0.423 0.327 0.562 0.497
Mean sPRO 0.05 0.423 0.838 0.621 0.574 0.730 0.637
Structural sPRO 0.1 0.569 0.915 0.879 0.879 0.940 0.836
Logical sPRO 0.1 0.463 0.902 0.538 0.466 0.670 0.608
Mean sPRO 0.1 0.516 0.908 0.709 0.673 0.805 0.722
Structural sPRO 0.3 0.744 0.966 0.941 0.950 0.978 0.916
Logical sPRO 0.3 0.659 0.967 0.730 0.729 0.833 0.784
Mean sPRO 0.3 0.701 0.966 0.835 0.840 0.906 0.850
Structural sPRO 1.0 0.918 0.990 0.978 0.985 0.994 0.973
Logical sPRO 1.0 0.889 0.990 0.911 0.916 0.941 0.929
Mean sPRO 1.0 0.904 0.990 0.945 0.950 0.967 0.951
SPADE Structural AUC 0.643 0.920 0.722 0.656 0.804 0.749
Logical AUC 0.617 0.840 0.529 0.563 0.714 0.653
Mean AUC 0.630 0.880 0.626 0.609 0.759 0.701
Structural sPRO 0.01 0.246 0.680 0.325 0.281 0.562 0.419
Logical sPRO 0.01 0.031 0.280 0.213 0.102 0.348 0.195
Mean sPRO 0.01 0.139 0.480 0.269 0.192 0.455 0.307
Structural sPRO 0.05 0.393 0.850 0.485 0.538 0.781 0.609
Logical sPRO 0.05 0.093 0.618 0.370 0.471 0.598 0.430
Mean sPRO 0.05 0.243 0.734 0.427 0.504 0.689 0.520
Structural sPRO 0.1 0.486 0.896 0.588 0.681 0.861 0.702
Logical sPRO 0.1 0.176 0.766 0.425 0.655 0.715 0.548
Mean sPRO 0.1 0.331 0.831 0.507 0.668 0.788 0.625
Structural sPRO 0.3 0.726 0.953 0.772 0.856 0.942 0.850
Logical sPRO 0.3 0.494 0.917 0.493 0.838 0.836 0.715
Mean sPRO 0.3 0.610 0.935 0.632 0.847 0.889 0.783
Structural sPRO 1.0 0.911 0.986 0.918 0.952 0.983 0.950
Logical sPRO 1.0 0.828 0.975 0.790 0.945 0.933 0.894
Mean sPRO 1.0 0.870 0.980 0.854 0.949 0.958 0.922
STPM Structural AUC 0.484 0.919 0.816 0.774 0.823 0.763
Logical AUC 0.530 0.785 0.560 0.577 0.535 0.597
Mean AUC 0.507 0.852 0.688 0.676 0.679 0.680
Structural sPRO 0.01 0.033 0.599 0.434 0.340 0.495 0.380
Logical sPRO 0.01 0.086 0.213 0.174 0.063 0.154 0.138
Mean sPRO 0.01 0.059 0.406 0.304 0.202 0.324 0.259
Structural sPRO 0.05 0.105 0.803 0.550 0.483 0.705 0.529
Logical sPRO 0.05 0.178 0.505 0.320 0.213 0.421 0.328
Mean sPRO 0.05 0.142 0.654 0.435 0.348 0.563 0.428
Structural sPRO 0.1 0.169 0.853 0.621 0.570 0.813 0.605
Logical sPRO 0.1 0.245 0.667 0.408 0.328 0.587 0.447
Mean sPRO 0.1 0.207 0.760 0.515 0.449 0.700 0.526
Structural sPRO 0.3 0.351 0.912 0.765 0.733 0.935 0.739
Logical sPRO 0.3 0.456 0.867 0.602 0.537 0.791 0.651
Mean sPRO 0.3 0.403 0.889 0.684 0.635 0.863 0.695
Structural sPRO 1.0 0.740 0.965 0.914 0.900 0.980 0.900
Logical sPRO 1.0 0.810 0.960 0.855 0.814 0.917 0.871
Mean sPRO 1.0 0.775 0.962 0.885 0.857 0.949 0.886

The results of vanilla setting on MPDD

Vanilla MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA Image AUC 0.828 0.967 0.912 0.952 1.000 0.877 0.923
Image AP 0.905 0.964 0.926 0.805 1.000 0.934 0.922
Pixel AUC 0.882 0.936 0.942 0.972 0.985 0.972 0.948
Pixel AP 0.028 0.189 0.010 0.237 0.898 0.334 0.283
Pixel PRO 0.823 0.714 0.731 0.911 0.915 0.900 0.832
CSFlow Image AUC 0.978 0.993 0.972 0.971 0.985 0.937 0.973
Image AP 0.976 0.996 0.971 0.894 0.995 0.974 0.968
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
CutPaste Image AUC 0.534 0.600 0.624 0.962 1.000 0.909 0.771
Image AP 0.626 0.733 0.573 0.903 1.000 0.964 0.800
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
DRAEM Image AUC 0.868 0.928 0.880 1.000 1.000 0.970 0.941
Image AP 0.916 0.944 0.919 1.000 1.000 0.985 0.961
Pixel AUC 0.981 0.681 0.977 0.944 0.975 0.951 0.918
Pixel AP 0.043 0.011 0.025 0.066 0.935 0.649 0.288
Pixel PRO 0.935 0.453 0.735 0.825 0.907 0.834 0.781
FastFlow Image AUC 0.948 0.964 0.964 0.874 0.937 0.633 0.887
Image AP 0.959 0.955 0.966 0.618 0.976 0.813 0.881
Pixel AUC 0.710 0.616 0.867 0.857 0.935 0.863 0.808
Pixel AP 0.002 0.005 0.001 0.021 0.618 0.042 0.115
Pixel PRO 0.459 0.179 0.522 0.533 0.708 0.586 0.498
FAVAE Image AUC 0.672 0.479 0.390 0.912 0.453 0.517 0.570
Image AP 0.776 0.627 0.516 0.816 0.749 0.749 0.705
Pixel AUC 0.943 0.958 0.926 0.980 0.783 0.849 0.906
Pixel AP 0.007 0.059 0.001 0.154 0.220 0.088 0.088
Pixel PRO 0.791 0.873 0.759 0.932 0.381 0.499 0.706
PaDiM Image AUC 0.685 0.722 0.846 0.848 0.545 0.591 0.706
Image AP 0.815 0.811 0.841 0.637 0.822 0.778 0.784
Pixel AUC 0.949 0.953 0.978 0.979 0.942 0.931 0.955
Pixel AP 0.009 0.074 0.036 0.205 0.534 0.074 0.155
Pixel PRO 0.863 0.839 0.878 0.926 0.815 0.769 0.848
PatchCore Image AUC 0.884 0.961 0.934 1.000 1.000 0.907 0.948
Image AP 0.932 0.976 0.949 1.000 1.000 0.965 0.970
Pixel AUC 0.986 0.980 0.999 0.995 0.990 0.991 0.990
Pixel AP 0.061 0.239 0.038 0.701 0.932 0.621 0.432
Pixel PRO 0.942 0.936 0.919 0.975 0.919 0.941 0.939
RD4AD Image AUC 0.860 0.919 0.820 1.000 1.000 0.963 0.927
Image AP 0.920 0.952 0.859 1.000 1.000 0.986 0.953
Pixel AUC 0.980 0.976 0.986 0.995 0.990 0.992 0.987
Pixel AP 0.121 0.253 0.013 0.660 0.925 0.761 0.455
Pixel PRO 0.946 0.956 0.935 0.975 0.951 0.959 0.953
SPADE Image AUC 0.655 0.885 0.760 0.781 0.998 0.627 0.784
Image AP 0.766 0.913 0.801 0.631 0.999 0.781 0.815
Pixel AUC 0.984 0.988 0.975 0.986 0.977 0.980 0.982
Pixel AP 0.060 0.332 0.015 0.353 0.792 0.500 0.342
Pixel PRO 0.931 0.958 0.876 0.950 0.915 0.927 0.926
STPM Image AUC 0.832 0.738 0.784 1.000 1.000 0.899 0.876
Image AP 0.895 0.805 0.822 1.000 1.000 0.959 0.914
Pixel AUC 0.962 0.968 0.987 0.991 0.992 0.988 0.981
Pixel AP 0.113 0.074 0.013 0.482 0.947 0.499 0.354
Pixel PRO 0.911 0.930 0.936 0.965 0.951 0.944 0.939

The results with 0.05 noise ratio on MPDD

Noisy 0.05 MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA Image AUC 0.778 0.882 0.859 0.991 0.999 0.854 0.894
Image AP 0.875 0.886 0.873 0.984 1.000 0.926 0.924
Pixel AUC 0.831 0.940 0.814 0.966 0.981 0.961 0.915
Pixel AP 0.021 0.155 0.002 0.256 0.840 0.312 0.264
Pixel PRO 0.778 0.791 0.567 0.898 0.911 0.860 0.801
CSFlow Image AUC 0.567 0.535 0.687 0.969 0.969 0.913 0.773
Image AP 0.692 0.702 0.715 0.956 0.983 0.965 0.835
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
CutPaste Image AUC 0.567 0.535 0.687 0.969 0.969 0.913 0.773
Image AP 0.692 0.702 0.715 0.956 0.983 0.965 0.835
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
DRAEM Image AUC 0.641 0.816 0.733 0.775 0.992 0.901 0.810
Image AP 0.720 0.869 0.692 0.716 0.997 0.952 0.825
Pixel AUC 0.862 0.539 0.974 0.860 0.946 0.951 0.855
Pixel AP 0.008 0.007 0.007 0.165 0.762 0.572 0.253
Pixel PRO 0.704 0.467 0.887 0.709 0.853 0.856 0.746
FastFlow Image AUC 0.760 0.872 0.967 0.888 0.845 0.687 0.836
Image AP 0.830 0.887 0.963 0.662 0.927 0.849 0.853
Pixel AUC 0.784 0.762 0.816 0.854 0.853 0.759 0.805
Pixel AP 0.003 0.010 0.001 0.020 0.357 0.018 0.068
Pixel PRO 0.564 0.425 0.494 0.515 0.529 0.380 0.484
FAVAE Image AUC 0.666 0.452 0.410 0.665 0.574 0.451 0.536
Image AP 0.787 0.613 0.478 0.506 0.786 0.714 0.647
Pixel AUC 0.938 0.959 0.924 0.962 0.840 0.847 0.912
Pixel AP 0.006 0.058 0.001 0.081 0.286 0.092 0.087
Pixel PRO 0.773 0.878 0.769 0.867 0.510 0.494 0.715
IGD Image AUC 0.637 0.802 0.897 0.862 0.984 0.600 0.797
Image AP 0.722 0.810 0.898 0.749 0.994 0.791 0.827
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
PaDiM Image AUC 0.685 0.686 0.783 0.855 0.525 0.513 0.675
Image AP 0.807 0.802 0.721 0.765 0.798 0.702 0.766
Pixel AUC 0.941 0.952 0.963 0.979 0.942 0.916 0.949
Pixel AP 0.008 0.062 0.008 0.216 0.524 0.053 0.145
Pixel PRO 0.851 0.860 0.855 0.925 0.814 0.715 0.836
PatchCore Image AUC 0.763 0.923 0.841 0.738 1.000 0.877 0.857
Image AP 0.834 0.948 0.843 0.596 1.000 0.952 0.862
Pixel AUC 0.942 0.984 0.974 0.753 0.980 0.980 0.936
Pixel AP 0.045 0.186 0.001 0.231 0.821 0.562 0.308
Pixel PRO 0.876 0.932 0.893 0.726 0.932 0.929 0.881
RD4AD Image AUC 0.764 0.888 0.881 1.000 0.998 0.924 0.909
Image AP 0.865 0.930 0.909 1.000 0.999 0.973 0.946
Pixel AUC 0.976 0.981 0.964 0.996 0.988 0.984 0.981
Pixel AP 0.115 0.195 0.007 0.655 0.896 0.765 0.439
Pixel PRO 0.938 0.959 0.914 0.977 0.950 0.926 0.944
SPADE Image AUC 0.625 0.873 0.792 0.800 0.998 0.615 0.784
Image AP 0.756 0.902 0.828 0.679 0.999 0.785 0.825
Pixel AUC 0.976 0.986 0.962 0.986 0.976 0.961 0.975
Pixel AP 0.059 0.305 0.004 0.368 0.785 0.481 0.333
Pixel PRO 0.914 0.953 0.864 0.950 0.914 0.894 0.915
STPM Image AUC 0.809 0.735 0.806 0.991 1.000 0.830 0.862
Image AP 0.890 0.808 0.849 0.984 1.000 0.928 0.910
Pixel AUC 0.965 0.966 0.982 0.991 0.991 0.982 0.979
Pixel AP 0.075 0.074 0.008 0.453 0.929 0.457 0.333
Pixel PRO 0.915 0.918 0.934 0.964 0.953 0.919 0.934

The results with 0.1 noise ratio on MPDD

Noisy 0.1 MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA Image AUC 0.707 0.829 0.734 0.831 0.986 0.761 0.808
Image AP 0.838 0.870 0.737 0.621 0.995 0.871 0.822
Pixel AUC 0.756 0.927 0.882 0.875 0.963 0.937 0.890
Pixel AP 0.014 0.109 0.002 0.086 0.731 0.212 0.192
Pixel PRO 0.617 0.738 0.591 0.720 0.877 0.807 0.725
CSFlow Image AUC 0.500 0.851 0.881 0.902 0.930 0.672 0.789
Image AP 0.597 0.917 0.858 0.858 0.971 0.820 0.837
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
CutPaste Image AUC 0.440 0.508 0.505 0.836 0.990 0.749 0.671
Image AP 0.614 0.680 0.470 0.671 0.997 0.869 0.717
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
DRAEM Image AUC 0.623 0.784 0.726 0.575 0.990 0.859 0.760
Image AP 0.597 0.826 0.622 0.179 0.996 0.914 0.689
Pixel AUC 0.898 0.747 0.979 0.885 0.880 0.927 0.886
Pixel AP 0.014 0.021 0.030 0.039 0.678 0.462 0.207
Pixel PRO 0.840 0.611 0.725 0.712 0.706 0.821 0.736
FastFlow Image AUC 0.653 0.869 0.814 0.742 0.690 0.581 0.725
Image AP 0.771 0.937 0.748 0.501 0.850 0.744 0.759
Pixel AUC 0.795 0.801 0.888 0.898 0.706 0.818 0.818
Pixel AP 0.003 0.015 0.001 0.027 0.204 0.039 0.048
Pixel PRO 0.611 0.393 0.624 0.682 0.386 0.542 0.540
FAVAE Image AUC 0.569 0.480 0.239 0.556 0.500 0.511 0.476
Image AP 0.708 0.683 0.348 0.377 0.779 0.733 0.605
Pixel AUC 0.918 0.961 0.916 0.943 0.844 0.850 0.905
Pixel AP 0.005 0.070 0.001 0.040 0.288 0.090 0.082
Pixel PRO 0.712 0.887 0.751 0.809 0.509 0.502 0.695
IGD Image AUC 0.569 0.790 0.812 0.987 0.974 0.583 0.786
Image AP 0.698 0.815 0.785 0.972 0.989 0.757 0.836
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
PaDiM Image AUC 0.598 0.646 0.565 0.707 0.469 0.497 0.580
Image AP 0.746 0.780 0.523 0.500 0.787 0.681 0.669
Pixel AUC 0.938 0.947 0.963 0.955 0.943 0.928 0.946
Pixel AP 0.008 0.064 0.013 0.061 0.527 0.065 0.123
Pixel PRO 0.844 0.833 0.862 0.856 0.814 0.760 0.828
PatchCore Image AUC 0.742 0.901 0.705 0.633 1.000 0.759 0.790
Image AP 0.782 0.897 0.690 0.293 1.000 0.883 0.758
Pixel AUC 0.909 0.981 0.921 0.680 0.980 0.881 0.892
Pixel AP 0.041 0.127 0.002 0.019 0.818 0.397 0.234
Pixel PRO 0.862 0.930 0.731 0.609 0.930 0.777 0.807
RD4AD Image AUC 0.736 0.856 0.727 0.853 0.996 0.854 0.837
Image AP 0.829 0.929 0.759 0.854 0.998 0.944 0.886
Pixel AUC 0.975 0.979 0.954 0.953 0.986 0.975 0.970
Pixel AP 0.075 0.207 0.004 0.330 0.883 0.720 0.370
Pixel PRO 0.937 0.953 0.851 0.856 0.949 0.896 0.907
SPADE Image AUC 0.579 0.833 0.711 0.724 0.998 0.523 0.728
Image AP 0.713 0.896 0.760 0.564 0.999 0.695 0.771
Pixel AUC 0.975 0.983 0.955 0.905 0.973 0.930 0.954
Pixel AP 0.069 0.286 0.003 0.216 0.772 0.422 0.295
Pixel PRO 0.909 0.938 0.844 0.754 0.910 0.842 0.866
STPM Image AUC 0.755 0.752 0.756 0.822 0.999 0.896 0.830
Image AP 0.862 0.835 0.794 0.749 1.000 0.953 0.865
Pixel AUC 0.964 0.965 0.977 0.976 0.991 0.981 0.976
Pixel AP 0.071 0.072 0.005 0.273 0.937 0.456 0.302
Pixel PRO 0.908 0.914 0.911 0.923 0.956 0.922 0.922

The results with 0.15 noise ratio on MPDD

Noisy 0.15 MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA Image AUC 0.696 0.839 0.817 0.913 0.971 0.801 0.839
Image AP 0.850 0.847 0.813 0.837 0.990 0.892 0.871
Pixel AUC 0.744 0.916 0.920 0.940 0.965 0.933 0.903
Pixel AP 0.013 0.086 0.004 0.180 0.723 0.263 0.212
Pixel PRO 0.629 0.729 0.662 0.847 0.865 0.791 0.754
CSFlow Image AUC 0.804 0.790 0.923 0.976 0.901 0.771 0.861
Image AP 0.856 0.871 0.930 0.947 0.954 0.891 0.908
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
CutPaste Image AUC 0.366 0.512 0.513 0.830 0.947 0.747 0.653
Image AP 0.630 0.624 0.532 0.665 0.971 0.891 0.718
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
DRAEM Image AUC 0.669 0.784 0.564 0.650 0.850 0.839 0.726
Image AP 0.507 0.729 0.364 0.226 0.919 0.916 0.610
Pixel AUC 0.861 0.605 0.988 0.832 0.835 0.936 0.843
Pixel AP 0.007 0.007 0.017 0.026 0.494 0.491 0.174
Pixel PRO 0.759 0.465 0.897 0.597 0.661 0.839 0.703
FastFlow Image AUC 0.585 0.719 0.840 0.814 0.755 0.636 0.725
Image AP 0.736 0.795 0.857 0.649 0.881 0.800 0.786
Pixel AUC 0.832 0.685 0.887 0.904 0.781 0.775 0.811
Pixel AP 0.005 0.011 0.002 0.037 0.255 0.021 0.055
Pixel PRO 0.701 0.377 0.578 0.683 0.417 0.441 0.533
FAVAE Image AUC 0.598 0.504 0.313 0.668 0.340 0.468 0.482
Image AP 0.769 0.649 0.450 0.541 0.686 0.678 0.629
Pixel AUC 0.945 0.967 0.907 0.945 0.832 0.842 0.906
Pixel AP 0.008 0.086 0.001 0.057 0.272 0.055 0.080
Pixel PRO 0.798 0.879 0.728 0.814 0.506 0.478 0.701
IGD Image AUC 0.493 0.776 0.877 0.984 0.990 0.612 0.789
Image AP 0.690 0.801 0.879 0.971 0.997 0.758 0.849
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
PaDiM Image AUC 0.529 0.727 0.617 0.810 0.490 0.582 0.626
Image AP 0.720 0.795 0.633 0.622 0.773 0.728 0.712
Pixel AUC 0.933 0.948 0.958 0.974 0.942 0.938 0.949
Pixel AP 0.008 0.056 0.007 0.130 0.524 0.092 0.136
Pixel PRO 0.831 0.835 0.837 0.911 0.814 0.789 0.836
PatchCore Image AUC 0.661 0.904 0.490 0.858 0.998 0.780 0.782
Image AP 0.560 0.862 0.421 0.586 0.999 0.894 0.720
Pixel AUC 0.879 0.982 0.918 0.810 0.973 0.876 0.906
Pixel AP 0.019 0.125 0.002 0.149 0.756 0.475 0.254
Pixel PRO 0.809 0.912 0.683 0.700 0.905 0.784 0.799
RD4AD Image AUC 0.636 0.830 0.663 0.925 0.994 0.908 0.826
Image AP 0.805 0.859 0.692 0.863 0.998 0.962 0.863
Pixel AUC 0.974 0.979 0.971 0.982 0.985 0.971 0.977
Pixel AP 0.066 0.126 0.007 0.447 0.878 0.723 0.374
Pixel PRO 0.932 0.950 0.883 0.938 0.947 0.890 0.923
SPADE Image AUC 0.536 0.842 0.760 0.743 0.996 0.542 0.737
Image AP 0.710 0.873 0.820 0.640 0.999 0.703 0.791
Pixel AUC 0.974 0.983 0.957 0.937 0.975 0.939 0.961
Pixel AP 0.070 0.268 0.004 0.288 0.777 0.447 0.309
Pixel PRO 0.906 0.939 0.836 0.834 0.914 0.854 0.880
STPM Image AUC 0.766 0.733 0.815 0.964 1.000 0.814 0.848
Image AP 0.886 0.787 0.884 0.941 1.000 0.916 0.902
Pixel AUC 0.966 0.955 0.983 0.986 0.992 0.954 0.973
Pixel AP 0.065 0.056 0.008 0.387 0.949 0.387 0.309
Pixel PRO 0.909 0.892 0.919 0.951 0.953 0.832 0.909

The results with 0.2 noise ratio on MPDD

Noisy 0.2 MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA Image AUC 0.696 0.752 0.653 0.901 0.914 0.773 0.782
Image AP 0.850 0.786 0.669 0.823 0.961 0.853 0.824
Pixel AUC 0.744 0.892 0.834 0.927 0.935 0.949 0.880
Pixel AP 0.013 0.058 0.001 0.108 0.637 0.192 0.168
Pixel PRO 0.629 0.649 0.453 0.807 0.832 0.830 0.700
CSFlow Image AUC 0.404 0.704 0.822 0.980 0.795 0.654 0.727
Image AP 0.625 0.789 0.809 0.959 0.914 0.825 0.820
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
CutPaste Image AUC 0.366 0.347 0.725 0.854 0.996 0.810 0.683
Image AP 0.630 0.558 0.802 0.770 0.998 0.893 0.775
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
DRAEM Image AUC 0.362 0.668 0.758 0.700 0.830 0.839 0.693
Image AP 0.365 0.544 0.412 0.402 0.918 0.916 0.593
Pixel AUC 0.798 0.632 0.984 0.944 0.836 0.936 0.855
Pixel AP 0.008 0.013 0.019 0.073 0.434 0.491 0.173
Pixel PRO 0.531 0.571 0.811 0.831 0.664 0.839 0.708
FastFlow Image AUC 0.585 0.795 0.803 0.751 0.605 0.609 0.691
Image AP 0.736 0.826 0.814 0.511 0.810 0.769 0.745
Pixel AUC 0.832 0.804 0.907 0.888 0.712 0.807 0.825
Pixel AP 0.005 0.013 0.002 0.028 0.198 0.023 0.045
Pixel PRO 0.701 0.479 0.661 0.623 0.379 0.448 0.549
FAVAE Image AUC 0.598 0.456 0.389 0.700 0.432 0.573 0.525
Image AP 0.769 0.604 0.474 0.581 0.701 0.739 0.644
Pixel AUC 0.945 0.960 0.909 0.953 0.834 0.843 0.907
Pixel AP 0.008 0.083 0.001 0.060 0.270 0.092 0.086
Pixel PRO 0.798 0.868 0.727 0.839 0.493 0.478 0.700
IGD Image AUC 0.493 0.648 0.836 1.000 0.963 0.597 0.756
Image AP 0.690 0.701 0.827 1.000 0.985 0.778 0.830
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
PaDiM Image AUC 0.558 0.659 0.603 0.755 0.525 0.550 0.608
Image AP 0.728 0.738 0.650 0.542 0.793 0.721 0.695
Pixel AUC 0.936 0.944 0.966 0.970 0.932 0.943 0.949
Pixel AP 0.009 0.054 0.017 0.099 0.481 0.083 0.124
Pixel PRO 0.834 0.832 0.862 0.900 0.792 0.799 0.837
PatchCore Image AUC 0.844 0.852 0.483 0.667 0.984 0.746 0.763
Image AP 0.740 0.777 0.255 0.306 0.995 0.858 0.655
Pixel AUC 0.989 0.986 0.926 0.815 0.970 0.915 0.934
Pixel AP 0.027 0.216 0.000 0.171 0.777 0.436 0.271
Pixel PRO 0.961 0.891 0.828 0.735 0.894 0.828 0.856
RD4AD Image AUC 0.636 0.744 0.769 0.949 0.989 0.856 0.824
Image AP 0.805 0.772 0.793 0.916 0.996 0.941 0.870
Pixel AUC 0.974 0.972 0.961 0.978 0.981 0.982 0.975
Pixel AP 0.066 0.084 0.007 0.384 0.845 0.731 0.353
Pixel PRO 0.932 0.942 0.871 0.925 0.940 0.913 0.920
SPADE Image AUC 0.536 0.792 0.717 0.771 0.993 0.504 0.719
Image AP 0.710 0.825 0.790 0.657 0.997 0.645 0.771
Pixel AUC 0.974 0.981 0.953 0.935 0.966 0.942 0.959
Pixel AP 0.070 0.262 0.003 0.259 0.729 0.362 0.281
Pixel PRO 0.906 0.930 0.824 0.837 0.899 0.823 0.870
STPM Image AUC 0.766 0.635 0.658 0.972 0.979 0.842 0.809
Image AP 0.886 0.733 0.728 0.946 0.990 0.923 0.868
Pixel AUC 0.966 0.961 0.979 0.982 0.989 0.959 0.973
Pixel AP 0.065 0.054 0.007 0.359 0.924 0.400 0.302
Pixel PRO 0.909 0.904 0.911 0.941 0.952 0.846 0.910

The results with 1 shot images on MPDD

FewShot 1 MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA Image AUC 0.453 0.520 0.640 0.326 0.968 0.347 0.542
Image AP 0.568 0.675 0.648 0.306 0.985 0.623 0.634
Pixel AUC 0.928 0.927 0.954 0.962 0.966 0.943 0.947
Pixel AP 0.006 0.039 0.003 0.076 0.768 0.101 0.165
Pixel PRO 0.758 0.798 0.856 0.875 0.857 0.802 0.824
CSFlow Image AUC 0.737 0.601 0.650 0.814 0.658 0.507 0.661
Image AP 0.787 0.687 0.660 0.609 0.873 0.730 0.724
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
CutPaste Image AUC 0.670 0.448 0.656 0.719 0.294 0.404 0.532
Image AP 0.679 0.617 0.584 0.566 0.619 0.604 0.612
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
DRAEM Image AUC 0.463 0.559 0.664 0.674 0.993 0.727 0.680
Image AP 0.591 0.687 0.604 0.451 0.997 0.846 0.696
Pixel AUC 0.973 0.739 0.937 0.882 0.967 0.867 0.894
Pixel AP 0.021 0.016 0.004 0.055 0.863 0.116 0.179
Pixel PRO 0.922 0.701 0.900 0.690 0.822 0.589 0.771
FastFlow Image AUC 0.500 0.500 0.500 0.500 0.500 0.500 0.500
Image AP 0.595 0.662 0.500 0.318 0.732 0.683 0.582
Pixel AUC 0.678 0.554 0.542 0.559 0.615 0.543 0.582
Pixel AP 0.001 0.005 0.000 0.006 0.148 0.009 0.028
Pixel PRO 0.000 0.000 0.000 0.000 0.000 0.000 0.000
FAVAE Image AUC 0.665 0.480 0.513 0.367 0.407 0.405 0.473
Image AP 0.762 0.662 0.472 0.317 0.730 0.657 0.600
Pixel AUC 0.881 0.944 0.863 0.934 0.758 0.852 0.872
Pixel AP 0.004 0.042 0.001 0.038 0.204 0.056 0.057
Pixel PRO 0.661 0.836 0.537 0.776 0.397 0.505 0.619
PaDiM Image AUC 0.570 0.436 0.547 0.662 0.241 0.427 0.481
Image AP 0.667 0.625 0.596 0.409 0.623 0.679 0.600
Pixel AUC 0.886 0.928 0.937 0.935 0.844 0.901 0.905
Pixel AP 0.004 0.031 0.002 0.055 0.292 0.064 0.075
Pixel PRO 0.604 0.834 0.758 0.778 0.548 0.667 0.698
PatchCore Image AUC 0.339 0.496 0.610 0.471 0.523 0.462 0.484
Image AP 0.483 0.652 0.600 0.305 0.798 0.674 0.585
Pixel AUC 0.871 0.881 0.891 0.923 0.869 0.904 0.890
Pixel AP 0.004 0.053 0.002 0.052 0.585 0.060 0.126
Pixel PRO 0.564 0.688 0.595 0.748 0.568 0.677 0.640
RD4AD Image AUC 0.533 0.439 0.607 0.367 0.575 0.535 0.509
Image AP 0.674 0.615 0.584 0.324 0.748 0.739 0.614
Pixel AUC 0.953 0.949 0.950 0.953 0.913 0.905 0.937
Pixel AP 0.011 0.048 0.003 0.055 0.440 0.041 0.100
Pixel PRO 0.824 0.865 0.828 0.844 0.759 0.692 0.802
STPM Image AUC 0.576 0.635 0.824 0.612 0.989 0.655 0.715
Image AP 0.701 0.756 0.831 0.479 0.996 0.826 0.765
Pixel AUC 0.941 0.913 0.984 0.962 0.983 0.962 0.958
Pixel AP 0.028 0.023 0.054 0.091 0.915 0.258 0.228
Pixel PRO 0.868 0.778 0.912 0.875 0.885 0.858 0.863
RegAD Image AUC 0.589 0.473 0.462 0.600 0.557 0.651 0.555
Image AP 0.684 0.655 0.472 0.453 0.796 0.829 0.648
Pixel AUC 0.951 0.937 0.925 0.954 0.921 0.928 0.936
Pixel AP 0.014 0.035 0.004 0.069 0.456 0.084 0.110
Pixel PRO 0.813 0.813 0.722 0.845 0.718 0.764 0.779

The results with 2 shot images on MPDD

FewShot 2 MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA Image AUC 0.449 0.523 0.567 0.524 1.000 0.348 0.568
Image AP 0.561 0.672 0.622 0.389 1.000 0.646 0.648
Pixel AUC 0.922 0.950 0.940 0.963 0.985 0.961 0.954
Pixel AP 0.005 0.051 0.002 0.088 0.901 0.246 0.216
Pixel PRO 0.753 0.857 0.750 0.879 0.922 0.855 0.836
CSFlow Image AUC 0.604 0.542 0.734 0.760 0.470 0.668 0.630
Image AP 0.713 0.726 0.662 0.523 0.744 0.822 0.698
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
CutPaste Image AUC 0.700 0.499 0.468 0.286 0.527 0.558 0.506
Image AP 0.757 0.689 0.488 0.241 0.766 0.772 0.619
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
DRAEM Image AUC 0.537 0.586 0.562 0.802 0.978 0.777 0.707
Image AP 0.705 0.679 0.555 0.761 0.993 0.882 0.762
Pixel AUC 0.975 0.668 0.919 0.930 0.979 0.867 0.889
Pixel AP 0.023 0.018 0.002 0.175 0.911 0.281 0.235
Pixel PRO 0.930 0.641 0.855 0.817 0.878 0.638 0.793
FastFlow Image AUC 0.500 0.490 0.500 0.500 0.500 0.500 0.498
Image AP 0.595 0.658 0.500 0.318 0.732 0.683 0.581
Pixel AUC 0.306 0.461 0.802 0.309 0.781 0.688 0.558
Pixel AP 0.001 0.005 0.001 0.004 0.280 0.016 0.051
Pixel PRO 0.034 0.082 0.000 0.024 0.306 0.289 0.122
FAVAE Image AUC 0.486 0.644 0.260 0.757 0.463 0.322 0.489
Image AP 0.591 0.731 0.380 0.482 0.751 0.603 0.590
Pixel AUC 0.925 0.910 0.903 0.865 0.812 0.826 0.874
Pixel AP 0.007 0.024 0.001 0.018 0.253 0.024 0.054
Pixel PRO 0.680 0.793 0.703 0.555 0.479 0.423 0.605
PaDiM Image AUC 0.511 0.465 0.559 0.629 0.392 0.611 0.528
Image AP 0.628 0.637 0.608 0.382 0.666 0.803 0.621
Pixel AUC 0.908 0.936 0.954 0.947 0.853 0.907 0.918
Pixel AP 0.004 0.035 0.003 0.062 0.301 0.060 0.078
Pixel PRO 0.686 0.839 0.814 0.821 0.589 0.689 0.740
PatchCore Image AUC 0.415 0.500 0.612 0.381 0.918 0.458 0.547
Image AP 0.547 0.697 0.664 0.269 0.971 0.669 0.636
Pixel AUC 0.890 0.713 0.939 0.926 0.916 0.929 0.886
Pixel AP 0.004 0.027 0.003 0.056 0.772 0.137 0.167
Pixel PRO 0.690 0.599 0.704 0.782 0.755 0.766 0.716
RD4AD Image AUC 0.587 0.447 0.521 0.529 0.780 0.582 0.574
Image AP 0.703 0.621 0.492 0.464 0.914 0.757 0.658
Pixel AUC 0.934 0.956 0.951 0.962 0.949 0.948 0.950
Pixel AP 0.009 0.053 0.003 0.075 0.610 0.102 0.142
Pixel PRO 0.801 0.897 0.822 0.874 0.815 0.826 0.839
STPM Image AUC 0.648 0.546 0.704 0.598 1.000 0.673 0.695
Image AP 0.721 0.694 0.677 0.508 1.000 0.838 0.740
Pixel AUC 0.931 0.931 0.973 0.970 0.989 0.976 0.962
Pixel AP 0.021 0.030 0.008 0.147 0.935 0.378 0.253
Pixel PRO 0.852 0.835 0.833 0.900 0.935 0.907 0.877
RegAD Image AUC 0.666 0.570 0.454 0.495 0.642 0.643 0.578
Image AP 0.759 0.720 0.456 0.397 0.836 0.818 0.664
Pixel AUC 0.948 0.930 0.949 0.954 0.934 0.940 0.943
Pixel AP 0.020 0.031 0.004 0.062 0.514 0.149 0.130
Pixel PRO 0.859 0.811 0.824 0.844 0.761 0.782 0.813

The results with 4 shot images on MPDD

FewShot 4 MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA Image AUC 0.359 0.486 0.444 0.864 0.971 0.726 0.642
Image AP 0.492 0.665 0.459 0.703 0.989 0.853 0.693
Pixel AUC 0.934 0.950 0.953 0.977 0.977 0.973 0.960
Pixel AP 0.006 0.045 0.003 0.147 0.839 0.376 0.236
Pixel PRO 0.798 0.863 0.859 0.919 0.894 0.896 0.871
CSFlow Image AUC 0.601 0.584 0.757 0.843 0.717 0.749 0.708
Image AP 0.697 0.740 0.793 0.697 0.893 0.864 0.781
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
CutPaste Image AUC 0.344 0.587 0.467 0.631 0.843 0.282 0.526
Image AP 0.549 0.751 0.472 0.524 0.937 0.560 0.632
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
DRAEM Image AUC 0.486 0.612 0.530 0.990 0.999 0.846 0.744
Image AP 0.648 0.705 0.526 0.980 1.000 0.909 0.795
Pixel AUC 0.973 0.761 0.921 0.895 0.989 0.945 0.914
Pixel AP 0.024 0.023 0.001 0.304 0.950 0.504 0.301
Pixel PRO 0.930 0.729 0.824 0.776 0.937 0.826 0.837
FastFlow Image AUC 0.517 0.641 0.748 0.569 0.881 0.667 0.671
Image AP 0.614 0.725 0.672 0.370 0.958 0.764 0.684
Pixel AUC 0.436 0.442 0.750 0.781 0.888 0.669 0.661
Pixel AP 0.001 0.004 0.001 0.032 0.596 0.014 0.108
Pixel PRO 0.099 0.061 0.570 0.480 0.524 0.291 0.338
FAVAE Image AUC 0.420 0.544 0.496 0.729 0.708 0.510 0.568
Image AP 0.541 0.733 0.494 0.475 0.893 0.752 0.648
Pixel AUC 0.920 0.939 0.901 0.948 0.818 0.841 0.894
Pixel AP 0.005 0.036 0.001 0.049 0.298 0.069 0.076
Pixel PRO 0.716 0.812 0.709 0.823 0.406 0.476 0.657
PaDiM Image AUC 0.464 0.504 0.602 0.769 0.453 0.550 0.557
Image AP 0.605 0.677 0.602 0.521 0.729 0.767 0.650
Pixel AUC 0.925 0.950 0.965 0.957 0.893 0.908 0.933
Pixel AP 0.005 0.046 0.004 0.081 0.369 0.046 0.092
Pixel PRO 0.756 0.873 0.851 0.855 0.698 0.692 0.788
PatchCore Image AUC 0.397 0.465 0.453 0.850 0.812 0.631 0.601
Image AP 0.512 0.678 0.446 0.695 0.895 0.812 0.673
Pixel AUC 0.869 0.928 0.844 0.959 0.929 0.947 0.913
Pixel AP 0.005 0.039 0.001 0.319 0.635 0.192 0.198
Pixel PRO 0.673 0.790 0.634 0.861 0.778 0.823 0.760
RD4AD Image AUC 0.539 0.480 0.519 0.641 0.865 0.650 0.616
Image AP 0.690 0.646 0.531 0.495 0.948 0.831 0.690
Pixel AUC 0.909 0.953 0.965 0.968 0.962 0.971 0.955
Pixel AP 0.005 0.051 0.004 0.140 0.680 0.260 0.190
Pixel PRO 0.743 0.899 0.875 0.890 0.863 0.891 0.860
STPM Image AUC 0.509 0.493 0.729 0.831 0.997 0.881 0.740
Image AP 0.656 0.679 0.677 0.697 0.999 0.956 0.777
Pixel AUC 0.929 0.937 0.991 0.980 0.989 0.980 0.968
Pixel AP 0.033 0.033 0.019 0.234 0.944 0.472 0.289
Pixel PRO 0.852 0.855 0.965 0.932 0.942 0.919 0.911
RegAD Image AUC 0.674 0.555 0.482 0.682 0.785 0.711 0.648
Image AP 0.744 0.671 0.487 0.508 0.902 0.861 0.695
Pixel AUC 0.955 0.950 0.942 0.958 0.955 0.950 0.952
Pixel AP 0.020 0.047 0.006 0.081 0.637 0.174 0.161
Pixel PRO 0.846 0.841 0.771 0.861 0.824 0.816 0.827

The results with 8 shot images on MPDD

FewShot 8 MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA Image AUC 0.678 0.613 0.380 0.667 1.000 0.824 0.694
Image AP 0.734 0.715 0.461 0.432 1.000 0.908 0.708
Pixel AUC 0.970 0.964 0.948 0.977 0.985 0.982 0.971
Pixel AP 0.020 0.062 0.003 0.161 0.898 0.473 0.269
Pixel PRO 0.915 0.898 0.861 0.919 0.924 0.928 0.908
CSFlow Image AUC 0.539 0.731 0.793 0.798 0.839 0.749 0.741
Image AP 0.624 0.804 0.834 0.671 0.930 0.861 0.787
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
CutPaste Image AUC 0.534 0.486 0.424 0.855 0.514 0.646 0.577
Image AP 0.631 0.668 0.432 0.732 0.705 0.754 0.654
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
DRAEM Image AUC 0.546 0.730 0.512 0.990 0.998 0.863 0.773
Image AP 0.671 0.757 0.487 0.980 0.999 0.917 0.802
Pixel AUC 0.913 0.645 0.876 0.920 0.977 0.945 0.879
Pixel AP 0.022 0.010 0.001 0.280 0.919 0.487 0.286
Pixel PRO 0.860 0.506 0.749 0.786 0.898 0.836 0.773
FastFlow Image AUC 0.682 0.626 0.789 0.616 0.864 0.740 0.719
Image AP 0.744 0.718 0.750 0.464 0.948 0.856 0.747
Pixel AUC 0.538 0.658 0.812 0.729 0.926 0.686 0.725
Pixel AP 0.001 0.006 0.001 0.010 0.646 0.031 0.116
Pixel PRO 0.101 0.195 0.664 0.269 0.661 0.334 0.371
FAVAE Image AUC 0.491 0.333 0.373 0.310 0.453 0.381 0.390
Image AP 0.561 0.568 0.447 0.243 0.720 0.663 0.534
Pixel AUC 0.933 0.945 0.893 0.939 0.828 0.841 0.896
Pixel AP 0.006 0.073 0.001 0.042 0.269 0.048 0.073
Pixel PRO 0.744 0.692 0.688 0.793 0.481 0.471 0.645
PaDiM Image AUC 0.494 0.631 0.459 0.707 0.459 0.608 0.560
Image AP 0.598 0.754 0.511 0.481 0.717 0.794 0.643
Pixel AUC 0.928 0.944 0.959 0.962 0.912 0.915 0.937
Pixel AP 0.006 0.044 0.004 0.088 0.417 0.051 0.102
Pixel PRO 0.752 0.872 0.816 0.872 0.752 0.715 0.797
PatchCore Image AUC 0.516 0.548 0.568 0.893 0.964 0.675 0.694
Image AP 0.659 0.690 0.518 0.771 0.986 0.853 0.746
Pixel AUC 0.920 0.943 0.960 0.979 0.955 0.953 0.952
Pixel AP 0.011 0.054 0.006 0.232 0.823 0.314 0.240
Pixel PRO 0.749 0.837 0.828 0.927 0.830 0.837 0.835
RD4AD Image AUC 0.595 0.613 0.599 0.781 0.955 0.648 0.699
Image AP 0.702 0.717 0.537 0.674 0.982 0.790 0.734
Pixel AUC 0.946 0.950 0.975 0.976 0.976 0.975 0.966
Pixel AP 0.013 0.053 0.005 0.262 0.796 0.343 0.245
Pixel PRO 0.847 0.911 0.907 0.917 0.905 0.902 0.898
SPADE Image AUC 0.279 0.647 0.491 0.564 0.965 0.617 0.594
Image AP 0.517 0.770 0.470 0.424 0.985 0.752 0.653
Pixel AUC 0.971 0.968 0.960 0.977 0.971 0.981 0.971
Pixel AP 0.016 0.079 0.003 0.185 0.746 0.535 0.261
Pixel PRO 0.892 0.920 0.875 0.923 0.901 0.928 0.906
STPM Image AUC 0.713 0.651 0.670 0.805 1.000 0.916 0.792
Image AP 0.787 0.720 0.611 0.694 1.000 0.968 0.797
Pixel AUC 0.957 0.954 0.988 0.984 0.989 0.985 0.976
Pixel AP 0.087 0.049 0.025 0.308 0.938 0.521 0.321
Pixel PRO 0.901 0.910 0.951 0.943 0.936 0.935 0.929
RegAD Image AUC 0.650 0.609 0.613 0.737 0.899 0.750 0.710
Image AP 0.747 0.714 0.597 0.528 0.954 0.868 0.735
Pixel AUC 0.955 0.954 0.951 0.968 0.955 0.947 0.955
Pixel AP 0.022 0.056 0.012 0.094 0.659 0.144 0.165
Pixel PRO 0.884 0.871 0.816 0.889 0.822 0.810 0.849

The results with few-shot augmentation on MPDD

FewShot augmentation MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA-1 Image AUC 0.434 0.495 0.558 0.374 0.957 0.481 0.550
Image AP 0.577 0.653 0.552 0.292 0.986 0.716 0.629
Pixel AUC 0.936 0.923 0.954 0.959 0.971 0.958 0.950
Pixel AP 0.007 0.029 0.003 0.070 0.820 0.217 0.191
Pixel PRO 0.789 0.787 0.848 0.865 0.842 0.850 0.830
CFA-2 Image AUC 0.442 0.520 0.418 0.455 0.997 0.702 0.589
Image AP 0.590 0.664 0.461 0.379 0.999 0.839 0.655
Pixel AUC 0.928 0.935 0.927 0.959 0.985 0.973 0.951
Pixel AP 0.006 0.034 0.002 0.067 0.891 0.363 0.227
Pixel PRO 0.775 0.829 0.743 0.865 0.916 0.897 0.837
CFA-4 Image AUC 0.418 0.454 0.382 0.881 0.974 0.948 0.676
Image AP 0.541 0.640 0.424 0.812 0.989 0.977 0.731
Pixel AUC 0.936 0.936 0.943 0.974 0.979 0.983 0.958
Pixel AP 0.006 0.033 0.002 0.154 0.866 0.469 0.255
Pixel PRO 0.815 0.832 0.859 0.909 0.885 0.933 0.872
CFA-8 Image AUC 0.688 0.608 0.342 0.574 0.988 0.857 0.676
Image AP 0.751 0.701 0.409 0.500 0.996 0.940 0.716
Pixel AUC 0.972 0.952 0.913 0.963 0.982 0.975 0.959
Pixel AP 0.069 0.047 0.002 0.092 0.855 0.409 0.246
Pixel PRO 0.876 0.876 0.779 0.879 0.895 0.907 0.869
PatchCore-1 Image AUC 0.342 0.502 0.659 0.298 0.901 0.313 0.502
Image AP 0.494 0.669 0.670 0.240 0.954 0.615 0.607
Pixel AUC 0.890 0.891 0.913 0.914 0.963 0.928 0.917
Pixel AP 0.004 0.028 0.003 0.057 0.813 0.105 0.168
Pixel PRO 0.645 0.777 0.654 0.761 0.824 0.759 0.736
PatchCore-2 Image AUC 0.398 0.534 0.482 0.445 0.986 0.587 0.572
Image AP 0.507 0.672 0.526 0.288 0.995 0.776 0.627
Pixel AUC 0.880 0.897 0.943 0.946 0.966 0.935 0.928
Pixel AP 0.004 0.031 0.004 0.077 0.865 0.233 0.202
Pixel PRO 0.610 0.746 0.715 0.829 0.856 0.788 0.757
PatchCore-4 Image AUC 0.370 0.468 0.581 0.767 0.944 0.602 0.622
Image AP 0.504 0.665 0.558 0.575 0.978 0.811 0.682
Pixel AUC 0.924 0.932 0.919 0.969 0.961 0.963 0.945
Pixel AP 0.007 0.043 0.003 0.188 0.780 0.353 0.229
Pixel PRO 0.787 0.816 0.785 0.898 0.863 0.863 0.835
PatchCore-8 Image AUC 0.614 0.605 0.607 0.917 0.994 0.747 0.747
Image AP 0.695 0.736 0.570 0.810 0.998 0.886 0.782
Pixel AUC 0.886 0.949 0.959 0.970 0.972 0.970 0.951
Pixel AP 0.018 0.059 0.008 0.235 0.885 0.390 0.266
Pixel PRO 0.798 0.855 0.875 0.903 0.890 0.892 0.869

The performance of continual setting on MPDD

Continual MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA Image AUC 0.190 0.519 0.506 0.264 0.366 0.630 0.412
Image AP 0.443 0.711 0.567 0.234 0.719 0.783 0.576
Pixel AUC 0.944 0.949 0.888 0.934 0.780 0.980 0.913
Pixel AP 0.016 0.062 0.001 0.041 0.219 0.499 0.140
Pixel PRO 0.742 0.852 0.641 0.779 0.454 0.927 0.732
CSFlow Image AUC 0.509 0.379 0.750 0.617 0.640 0.901 0.633
Image AP 0.565 0.658 0.705 0.406 0.869 0.955 0.693
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
CutPaste Image AUC 0.499 0.501 0.652 0.721 0.856 0.762 0.665
Image AP 0.611 0.675 0.653 0.560 0.956 0.894 0.725
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -
DRAEM Image AUC 0.642 0.370 0.529 0.063 0.077 0.957 0.440
Image AP 0.650 0.635 0.638 0.214 0.544 0.979 0.610
Pixel AUC 0.040 0.312 0.053 0.157 0.695 0.957 0.369
Pixel AP 0.000 0.003 0.000 0.003 0.171 0.611 0.131
Pixel PRO 0.000 0.073 0.000 0.010 0.209 0.839 0.189
FastFlow Image AUC 0.700 0.462 0.510 0.350 0.552 0.682 0.543
Image AP 0.801 0.675 0.534 0.287 0.747 0.817 0.643
Pixel AUC 0.174 0.150 0.085 0.303 0.165 0.742 0.270
Pixel AP 0.001 0.003 0.000 0.004 0.069 0.017 0.015
Pixel PRO 0.000 0.004 0.000 0.000 0.002 0.361 0.061
FAVAE Image AUC 0.549 0.485 0.264 0.198 0.465 0.499 0.410
Image AP 0.617 0.656 0.387 0.218 0.740 0.735 0.559
Pixel AUC 0.929 0.944 0.846 0.919 0.780 0.841 0.877
Pixel AP 0.010 0.046 0.001 0.030 0.219 0.083 0.065
Pixel PRO 0.690 0.834 0.557 0.726 0.377 0.475 0.610
PaDiM Image AUC 0.646 0.367 0.532 0.445 0.189 0.588 0.461
Image AP 0.728 0.602 0.554 0.299 0.594 0.781 0.593
Pixel AUC 0.829 0.891 0.835 0.869 0.687 0.932 0.841
Pixel AP 0.003 0.040 0.001 0.032 0.166 0.076 0.053
Pixel PRO 0.304 0.738 0.457 0.595 0.309 0.770 0.529
PatchCore Image AUC 0.581 0.749 0.642 0.936 0.987 0.827 0.787
Image AP 0.721 0.886 0.672 0.922 0.995 0.912 0.851
Pixel AUC 0.961 0.952 0.951 0.987 0.961 0.968 0.964
Pixel AP 0.074 0.181 0.018 0.647 0.842 0.387 0.358
Pixel PRO 0.869 0.760 0.729 0.945 0.849 0.882 0.839
RD4AD Image AUC 0.598 0.432 0.622 0.450 0.535 0.946 0.597
Image AP 0.652 0.659 0.620 0.341 0.804 0.980 0.676
Pixel AUC 0.898 0.902 0.902 0.895 0.790 0.994 0.897
Pixel AP 0.004 0.032 0.002 0.045 0.245 0.763 0.182
Pixel PRO 0.669 0.835 0.631 0.679 0.532 0.967 0.719
SPADE Image AUC 0.190 0.519 0.506 0.264 0.366 0.630 0.412
Image AP 0.443 0.711 0.567 0.234 0.719 0.783 0.576
Pixel AUC 0.944 0.949 0.888 0.934 0.780 0.980 0.913
Pixel AP 0.016 0.062 0.001 0.041 0.219 0.499 0.140
Pixel PRO 0.742 0.852 0.641 0.779 0.454 0.927 0.732
STPM Image AUC 0.737 0.548 0.449 0.131 0.278 0.851 0.499
Image AP 0.733 0.680 0.478 0.205 0.674 0.935 0.618
Pixel AUC 0.051 0.109 0.080 0.110 0.638 0.981 0.328
Pixel AP 0.000 0.002 0.000 0.003 0.168 0.424 0.100
Pixel PRO 0.000 0.005 0.000 0.005 0.375 0.923 0.218
DNE Image AUC 0.505 0.480 0.500 0.500 0.712 0.754 0.575
Image AP 0.597 0.654 0.500 0.318 0.826 0.844 0.623
Pixel AUC - - - - - - -
Pixel AP - - - - - - -
Pixel PRO - - - - - - -

The Corresponding FM of continual setting on MPDD

Continual MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
CFA Image AUC FM 0.465 0.367 0.398 0.517 0.632 0.000 0.396
Image AP FM 0.323 0.202 0.355 0.397 0.280 0.000 0.260
Pixel AUC FM 0.041 0.039 0.087 0.052 0.197 0.000 0.069
Pixel AP FM 0.044 0.270 0.014 0.311 0.575 0.000 0.202
Pixel PRO FM 0.189 0.106 0.235 0.170 0.462 0.000 0.194
CSFlow Image AUC FM 0.477 0.621 0.240 0.371 0.352 0.000 0.344
Image AP FM 0.425 0.342 0.284 0.567 0.128 0.000 0.291
Pixel AUC FM - - - - - - -
Pixel AP FM - - - - - - -
Pixel PRO FM - - - - - - -
CutPaste Image AUC FM -0.043 0.139 -0.019 0.131 -0.154 0.000 0.009
Image AP FM -0.031 0.137 -0.012 0.229 -0.057 0.000 0.044
Pixel AUC FM - - - - - - -
Pixel AP FM - - - - - - -
Pixel PRO FM - - - - - - -
DRAEM Image AUC FM 0.154 0.565 0.298 0.937 0.923 0.000 0.479
Image AP FM 0.221 0.324 0.217 0.786 0.456 0.000 0.334
Pixel AUC FM 0.931 0.647 0.932 0.810 0.295 0.000 0.602
Pixel AP FM 0.048 0.017 0.010 0.309 0.786 0.000 0.195
Pixel PRO FM 0.898 0.790 0.911 2.558 0.731 0.000 0.981
FastFlow Image AUC FM 0.083 0.441 0.344 0.491 0.275 0.000 0.272
Image AP FM 0.034 0.220 0.241 0.361 0.182 0.000 0.173
Pixel AUC FM 0.563 0.513 0.728 0.531 0.706 0.000 0.507
Pixel AP FM 0.002 0.006 0.001 0.015 0.406 0.000 0.072
Pixel PRO FM 0.578 0.602 0.406 0.499 0.608 0.000 0.449
FAVAE Image AUC FM 0.123 0.245 0.110 0.733 -0.171 0.000 0.173
Image AP FM 0.159 0.165 0.041 0.587 -0.095 0.000 0.143
Pixel AUC FM 0.014 0.034 0.081 0.052 -0.078 0.000 0.017
Pixel AP FM -0.001 0.094 0.001 0.065 -0.044 0.000 0.019
Pixel PRO FM 0.101 0.076 0.223 0.174 -0.049 0.000 0.087
PaDiM Image AUC FM 0.038 0.369 0.311 0.402 0.445 0.000 0.261
Image AP FM 0.087 0.210 0.280 0.338 0.257 0.000 0.195
Pixel AUC FM 0.121 0.064 0.146 0.110 0.258 0.000 0.116
Pixel AP FM 0.007 0.034 0.035 0.172 0.385 0.000 0.106
Pixel PRO FM 0.559 0.151 0.434 0.331 0.515 0.000 0.332
PatchCore Image AUC FM 0.026 0.001 0.059 0.005 0.004 0.000 0.016
Image AP FM 0.011 0.001 0.113 0.005 0.001 0.000 0.022
Pixel AUC FM 0.000 0.000 -0.000 0.000 -0.000 0.000 -0.000
Pixel AP FM 0.000 0.000 0.000 0.000 0.003 0.000 0.000
Pixel PRO FM 0.000 0.000 -0.000 0.000 0.000 0.000 0.000
RD4AD Image AUC FM 0.262 0.502 0.223 0.550 0.465 0.000 0.334
Image AP FM 0.268 0.302 0.264 0.659 0.196 0.000 0.281
Pixel AUC FM 0.082 0.081 0.085 0.102 0.202 0.000 0.092
Pixel AP FM 0.118 0.193 0.017 0.683 0.706 0.000 0.286
Pixel PRO FM 0.277 0.129 0.311 0.297 0.420 0.000 0.239
SPADE Image AUC FM 0.465 0.367 0.398 0.517 0.632 0.000 0.396
Image AP FM 0.323 0.202 0.355 0.397 0.280 0.000 0.260
Pixel AUC FM 0.041 0.039 0.087 0.052 0.197 0.000 0.069
Pixel AP FM 0.044 0.270 0.014 0.311 0.575 0.000 0.202
Pixel PRO FM 0.189 0.106 0.235 0.170 0.462 0.000 0.194
STPM Image AUC FM 0.106 0.122 0.295 0.793 0.722 0.000 0.340
Image AP FM 0.168 0.130 0.326 0.656 0.326 0.000 0.268
Pixel AUC FM 0.912 0.853 0.898 0.874 0.354 0.000 0.648
Pixel AP FM 0.121 0.064 0.007 0.339 0.777 0.000 0.218
Pixel PRO FM 0.914 0.905 0.877 0.940 0.575 0.000 0.702
DNE Image AUC FM 0.033 0.020 0.083 0.031 0.274 0.000 0.073
Image AP FM 0.023 0.009 0.052 0.014 0.153 0.000 0.042
Pixel AUC FM - - - - - - -
Pixel AP FM - - - - - - -
Pixel PRO FM - - - - - - -

The results of semi-supervised methods with annotated images on MPDD

Semi-supervised MPDD bracket_black bracket_brown bracket_white connector metal_plate tubes average
DevNet-1 Image AUC 0.231 0.604 0.533 0.695 0.445 0.543 0.508
Image AP 0.465 0.746 0.500 0.455 0.738 0.678 0.597
DRA-1 Image AUC 0.660 0.718 0.682 0.746 0.868 0.673 0.724
Image AP 0.753 0.797 0.673 0.497 0.948 0.799 0.745
DevNet-2 Image AUC 0.431 0.515 0.686 0.441 0.970 0.446 0.582
Image AP 0.556 0.724 0.753 0.314 0.989 0.697 0.672
DRA-2 Image AUC 0.671 0.645 0.800 0.799 0.917 0.807 0.773
Image AP 0.691 0.768 0.821 0.561 0.970 0.903 0.786
DevNet-4 Image AUC 0.619 0.938 0.642 0.970 0.989 0.488 0.774
Image AP 0.695 0.964 0.581 0.962 0.996 0.696 0.816
DRA-4 Image AUC 0.727 0.989 0.611 0.929 0.969 0.702 0.821
Image AP 0.740 0.994 0.643 0.919 0.989 0.836 0.854
DevNet-5 Image AUC 0.405 0.878 0.771 0.988 1.000 0.893 0.822
Image AP 0.574 0.944 0.770 0.979 1.000 0.954 0.870
DRA-5 Image AUC 0.771 0.913 0.894 0.929 0.797 0.908 0.869
Image AP 0.795 0.947 0.909 0.939 0.927 0.955 0.912
DevNet-8 Image AUC 0.588 0.982 0.727 0.993 1.000 0.808 0.850
Image AP 0.678 0.993 0.768 0.986 1.000 0.914 0.890
DRA-8 Image AUC 0.708 1.000 0.836 0.938 1.000 0.907 0.898
Image AP 0.780 1.000 0.870 0.945 1.000 0.955 0.925
DevNet-10 Image AUC 0.719 1.000 0.628 1.000 1.000 0.563 0.818
Image AP 0.785 1.000 0.739 1.000 1.000 0.767 0.882
DRA-10 Image AUC 0.655 1.000 0.893 1.000 0.997 0.947 0.915
Image AP 0.746 1.000 0.923 1.000 0.999 0.975 0.941

The results of vanilla setting on BTAD and MTD

Vanilla BTAD 1 2 3 average Vanilla MTD average
CFA Image AUC 0.991 0.827 0.997 0.938 CFA Image AUC 0.913
Image AP 0.997 0.971 0.971 0.980 Image AP 0.959
Pixel AUC 0.962 0.958 0.956 0.959 Pixel AUC 0.731
Pixel AP 0.512 0.638 0.399 0.517 Pixel AP 0.246
Pixel PRO 0.706 0.508 0.893 0.702 Pixel PRO 0.528
CSFlow Image AUC 0.994 0.866 0.948 0.936 CSFlow Image AUC 0.887
Image AP 0.998 0.978 0.693 0.890 Image AP 0.945
Pixel AUC 0.000 0.000 0.000 0.000 Pixel AUC 0.000
Pixel AP 0.000 0.000 0.000 0.000 Pixel AP 0.000
Pixel PRO 0.000 0.000 0.000 0.000 Pixel PRO 0.000
CutPaste Image AUC 0.954 0.811 0.987 0.917 CutPaste Image AUC 0.830
Image AP 0.983 0.969 0.908 0.953 Image AP 0.912
Pixel AUC 0.000 0.000 0.000 0.000 Pixel AUC 0.000
Pixel AP 0.000 0.000 0.000 0.000 Pixel AP 0.000
Pixel PRO 0.000 0.000 0.000 0.000 Pixel PRO 0.000
DRAEM Image AUC 0.983 0.704 0.998 0.895 DRAEM Image AUC 0.782
Image AP 0.993 0.950 0.977 0.974 Image AP 0.885
Pixel AUC 0.930 0.752 0.940 0.874 Pixel AUC 0.660
Pixel AP 0.191 0.179 0.106 0.159 Pixel AP 0.148
Pixel PRO 0.674 0.424 0.790 0.629 Pixel PRO 0.541
FastFlow Image AUC 0.997 0.829 0.932 0.919 FastFlow Image AUC 0.891
Image AP 0.999 0.972 0.630 0.867 Image AP 0.947
Pixel AUC 0.953 0.963 0.979 0.965 Pixel AUC 0.710
Pixel AP 0.407 0.564 0.165 0.379 Pixel AP 0.172
Pixel PRO 0.674 0.589 0.911 0.725 Pixel PRO 0.568
FAVAE Image AUC 0.993 0.775 1.000 0.923 FAVAE Image AUC 0.795
Image AP 0.997 0.964 0.997 0.986 Image AP 0.867
Pixel AUC 0.968 0.939 0.941 0.949 Pixel AUC 0.735
Pixel AP 0.512 0.370 0.165 0.349 Pixel AP 0.120
Pixel PRO 0.749 0.531 0.858 0.713 Pixel PRO 0.632
PaDiM Image AUC 0.998 0.902 0.994 0.965 PaDiM Image AUC 0.885
Image AP 0.999 0.985 0.945 0.976 Image AP 0.944
Pixel AUC 0.975 0.959 0.996 0.977 Pixel AUC 0.768
Pixel AP 0.568 0.517 0.520 0.535 Pixel AP 0.768
Pixel PRO 0.818 0.602 0.974 0.798 Pixel PRO 0.798
PatchCore Image AUC 0.997 0.845 0.999 0.947 PatchCore Image AUC 0.975
Image AP 0.999 0.976 0.993 0.989 Image AP 0.988
Pixel AUC 0.974 0.965 0.995 0.978 Pixel AUC 0.836
Pixel AP 0.497 0.568 0.495 0.520 Pixel AP 0.303
Pixel PRO 0.746 0.543 0.968 0.752 Pixel PRO 0.686
RD4AD Image AUC 0.981 0.833 0.999 0.937 RD4AD Image AUC 0.884
Image AP 0.993 0.973 0.989 0.985 Image AP 0.947
Pixel AUC 0.964 0.968 0.941 0.958 Pixel AUC 0.693
Pixel AP 0.477 0.692 0.381 0.517 Pixel AP 0.218
Pixel PRO 0.728 0.557 0.885 0.723 Pixel PRO 0.623
SPADE Image AUC 0.938 0.776 0.998 0.904 SPADE Image AUC 0.868
Image AP 0.978 0.961 0.983 0.974 Image AP 0.928
Pixel AUC 0.975 0.962 0.914 0.950 Pixel AUC 0.742
Pixel AP 0.549 0.567 0.208 0.441 Pixel AP 0.123
Pixel PRO 0.813 0.594 0.828 0.745 Pixel PRO 0.627
STPM Image AUC 0.954 0.805 0.995 0.918 STPM Image AUC 0.729
Image AP 0.983 0.969 0.934 0.962 Image AP 0.847
Pixel AUC 0.946 0.956 0.907 0.937 Pixel AUC 0.642
Pixel AP 0.375 0.718 0.109 0.401 Pixel AP 0.102
Pixel PRO 0.673 0.553 0.775 0.667 Pixel PRO 0.478

The results of vanilla setting on DAGM

Vanilla DAGM Class1 Class2 Class3 Class4 Class5 Class6 Class7 Class8 Class9 Class10 Average
CFA Image AUC 0.982 0.989 0.977 1.000 0.956 1.000 1.000 0.582 1.000 0.998 0.948
Image AP 0.801 0.984 0.947 1.000 0.896 0.998 1.000 0.165 0.998 0.995 0.878
Pixel AUC 0.927 0.996 0.916 0.998 0.931 0.985 0.954 0.716 1.000 0.997 0.942
Pixel AP 0.259 0.514 0.441 0.865 0.435 0.689 0.683 0.004 0.586 0.478 0.495
Pixel PRO 0.842 0.966 0.840 0.982 0.816 0.949 0.910 0.431 0.983 0.979 0.870
CSFlow Image AUC 0.976 0.921 0.962 0.749 0.489 0.746 0.796 0.516 0.651 0.712 0.752
Image AP 0.988 0.967 0.983 0.827 0.532 0.756 0.782 0.544 0.709 0.720 0.781
Pixel AUC - - - - - - - - - - -
Pixel AP - - - - - - - - - - -
Pixel PRO - - - - - - - - - - -
CutPaste Image AUC 0.561 0.994 0.898 0.991 0.760 0.967 1.000 0.514 0.825 0.881 0.839
Image AP 0.173 0.979 0.697 0.974 0.494 0.899 0.996 0.143 0.660 0.782 0.680
Pixel AUC - - - - - - - - - - -
Pixel AP - - - - - - - - - - -
Pixel PRO - - - - - - - - - - -
DRAEM Image AUC 0.916 0.900 0.955 1.000 1.000 1.000 0.981 0.994 0.470 0.866 0.908
Image AP 0.835 0.548 0.775 1.000 0.999 0.999 0.955 0.961 0.120 0.705 0.790
Pixel AUC 0.713 0.863 0.881 0.995 0.898 0.891 0.909 0.980 0.607 0.940 0.868
Pixel AP 0.166 0.150 0.208 0.653 0.391 0.534 0.350 0.347 0.001 0.262 0.306
Pixel PRO 0.494 0.644 0.708 0.973 0.764 0.748 0.777 0.948 0.226 0.821 0.710
FastFlow Image AUC 0.949 0.962 0.830 0.988 0.770 0.987 0.797 0.528 0.989 0.939 0.874
Image AP 0.787 0.906 0.623 0.926 0.573 0.935 0.366 0.148 0.964 0.765 0.699
Pixel AUC 0.902 0.996 0.886 0.997 0.902 0.935 0.832 0.684 0.999 0.981 0.911
Pixel AP 0.303 0.431 0.176 0.700 0.287 0.465 0.088 0.002 0.652 0.318 0.342
Pixel PRO 0.789 0.972 0.766 0.980 0.755 0.826 0.663 0.324 0.982 0.935 0.799
FAVAE Image AUC 0.497 0.883 0.629 0.902 0.592 0.678 0.448 0.523 0.934 0.862 0.695
Image AP 0.152 0.679 0.238 0.711 0.230 0.209 0.125 0.156 0.791 0.471 0.376
Pixel AUC 0.568 0.958 0.758 0.982 0.785 0.904 0.600 0.503 0.998 0.981 0.804
Pixel AP 0.005 0.340 0.010 0.450 0.031 0.082 0.006 0.001 0.534 0.244 0.170
Pixel PRO 0.161 0.912 0.471 0.934 0.522 0.711 0.216 0.153 0.981 0.941 0.600
PaDiM Image AUC 0.884 0.999 0.990 1.000 0.985 0.993 0.956 0.601 0.998 0.989 0.940
Image AP 0.453 0.996 0.951 1.000 0.954 0.884 0.743 0.198 0.987 0.945 0.811
Pixel AUC 0.897 0.997 0.966 0.999 0.987 0.989 0.881 0.900 1.000 0.995 0.961
Pixel AP 0.125 0.574 0.478 0.867 0.680 0.738 0.258 0.043 0.613 0.539 0.492
Pixel PRO 0.760 0.982 0.928 0.983 0.951 0.954 0.778 0.763 0.983 0.975 0.906
PatchCore Image AUC 0.808 1.000 0.922 1.000 0.977 0.999 1.000 0.657 0.994 1.000 0.936
Image AP 0.293 0.999 0.799 1.000 0.933 0.993 0.998 0.263 0.985 1.000 0.826
Pixel AUC 0.892 0.998 0.963 1.000 0.982 0.988 0.963 0.889 0.999 0.999 0.967
Pixel AP 0.059 0.557 0.456 0.898 0.647 0.744 0.737 0.068 0.500 0.504 0.517
Pixel PRO 0.704 0.982 0.905 0.985 0.924 0.955 0.922 0.588 0.983 0.983 0.893
RD4AD Image AUC 0.994 1.000 0.926 1.000 0.931 1.000 1.000 0.736 0.991 0.999 0.958
Image AP 0.956 1.000 0.816 1.000 0.859 0.998 1.000 0.408 0.979 0.994 0.901
Pixel AUC 0.955 0.999 0.961 0.999 0.975 0.984 0.968 0.910 0.999 0.998 0.975
Pixel AP 0.533 0.604 0.476 0.705 0.534 0.662 0.758 0.153 0.418 0.495 0.534
Pixel PRO 0.897 0.983 0.911 0.982 0.911 0.941 0.940 0.773 0.981 0.981 0.930
SPADE Image AUC 0.539 0.820 0.599 0.831 0.729 0.959 0.575 0.463 0.948 0.679 0.714
Image AP 0.147 0.424 0.191 0.461 0.449 0.872 0.159 0.126 0.826 0.265 0.392
Pixel AUC 0.765 0.978 0.839 0.988 0.853 0.856 0.834 0.704 0.999 0.982 0.880
Pixel AP 0.012 0.175 0.011 0.263 0.074 0.034 0.045 0.001 0.471 0.247 0.133
Pixel PRO 0.460 0.944 0.615 0.960 0.621 0.552 0.666 0.323 0.983 0.946 0.707
STPM Image AUC 0.997 0.971 0.567 0.588 0.563 0.962 0.963 0.460 0.665 0.658 0.739
Image AP 0.966 0.879 0.182 0.222 0.234 0.892 0.873 0.134 0.195 0.402 0.498
Pixel AUC 0.837 0.977 0.855 0.788 0.783 0.847 0.885 0.782 0.995 0.845 0.859
Pixel AP 0.325 0.416 0.022 0.013 0.038 0.211 0.260 0.002 0.130 0.095 0.151
Pixel PRO 0.689 0.945 0.673 0.445 0.492 0.634 0.735 0.473 0.976 0.617 0.668

The results of vanilla setting on VisA

Vanilla VisA candle capsules cashew chewinggum fryum macaroni1 macaroni2 pcb1 pcb2 pcb3 pcb4 pipe_fryum average
CFA Image AUC 0.944 0.729 0.991 0.997 0.916 0.989 0.933 0.900 0.756 0.949 0.973 0.958 0.920
Image AP 0.957 0.807 0.992 0.999 0.963 0.996 0.966 0.901 0.756 0.951 0.976 0.962 0.935
Pixel AUC 0.911 0.775 0.905 0.979 0.977 0.972 0.745 0.646 0.607 0.956 0.877 0.763 0.843
Pixel AP 0.166 0.057 0.353 0.590 0.664 0.314 0.307 0.004 0.002 0.636 0.057 0.066 0.268
Pixel PRO 0.833 0.347 0.572 0.759 0.730 0.764 0.401 0.334 0.399 0.663 0.574 0.237 0.551
CSFlow Image AUC 0.489 0.749 0.989 0.418 0.962 0.921 0.976 0.712 0.516 0.796 0.746 0.651 0.744
Image AP 0.532 0.827 0.989 0.643 0.983 0.967 0.988 0.720 0.544 0.782 0.756 0.709 0.787
Pixel AUC - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - -
CutPaste Image AUC 0.699 0.790 0.848 0.926 0.940 0.934 0.836 0.831 0.449 0.900 0.907 0.769 0.819
Image AP 0.714 0.886 0.853 0.966 0.970 0.972 0.924 0.817 0.479 0.905 0.901 0.792 0.848
Pixel AUC - - - - - - - - - - - - -
Pixel AP - - - - - - - - - - - - -
Pixel PRO - - - - - - - - - - - - -
DRAEM Image AUC 0.918 0.747 0.951 0.948 0.974 0.972 0.850 0.476 0.898 0.920 0.986 1.000 0.887
Image AP 0.935 0.856 0.977 0.979 0.987 0.968 0.819 0.551 0.898 0.911 0.984 1.000 0.905
Pixel AUC 0.966 0.985 0.835 0.968 0.872 0.999 0.992 0.887 0.913 0.980 0.968 0.858 0.935
Pixel AP 0.377 0.373 0.239 0.277 0.383 0.240 0.316 0.229 0.033 0.149 0.299 0.271 0.265
Pixel PRO 0.944 0.800 0.491 0.507 0.917 0.960 0.926 0.267 0.516 0.879 0.779 0.705 0.724
FastFlow Image AUC 0.928 0.712 0.910 0.914 0.886 0.983 0.863 0.774 0.619 0.743 0.809 0.720 0.822
Image AP 0.938 0.793 0.896 0.955 0.947 0.993 0.918 0.781 0.601 0.726 0.829 0.735 0.843
Pixel AUC 0.949 0.753 0.914 0.986 0.973 0.973 0.892 0.752 0.673 0.948 0.899 0.873 0.882
Pixel AP 0.049 0.014 0.092 0.436 0.353 0.278 0.298 0.002 0.001 0.237 0.054 0.054 0.156
Pixel PRO 0.867 0.333 0.683 0.748 0.743 0.777 0.434 0.599 0.407 0.615 0.588 0.380 0.598
FAVAE Image AUC 0.850 0.515 0.966 0.733 0.857 0.871 0.760 0.825 0.694 0.812 0.916 0.843 0.803
Image AP 0.853 0.624 0.964 0.843 0.934 0.935 0.860 0.843 0.671 0.830 0.919 0.834 0.843
Pixel AUC 0.972 0.562 0.912 0.980 0.994 0.977 0.901 0.737 0.724 0.960 0.938 0.910 0.880
Pixel AP 0.104 0.006 0.124 0.431 0.659 0.253 0.316 0.003 0.001 0.503 0.063 0.091 0.213
Pixel PRO 0.898 0.230 0.669 0.878 0.876 0.814 0.640 0.467 0.372 0.803 0.824 0.683 0.679
PaDiM Image AUC 0.916 0.707 0.930 0.988 0.886 0.870 0.705 0.947 0.885 0.910 0.975 0.970 0.891
Image AP 0.884 0.800 0.966 0.995 0.935 0.837 0.659 0.937 0.883 0.913 0.947 0.984 0.895
Pixel AUC 0.986 0.974 0.985 0.989 0.954 0.991 0.965 0.993 0.987 0.987 0.965 0.993 0.981
Pixel AP 0.131 0.182 0.522 0.563 0.433 0.107 0.011 0.519 0.138 0.288 0.184 0.633 0.309
Pixel PRO 0.957 0.769 0.879 0.835 0.802 0.921 0.754 0.913 0.887 0.849 0.816 0.925 0.859
PatchCore Image AUC 0.986 0.816 0.973 0.991 0.962 0.975 0.781 0.985 0.973 0.979 0.996 0.998 0.951
Image AP 0.985 0.896 0.988 0.996 0.982 0.976 0.790 0.983 0.976 0.979 0.996 0.999 0.962
Pixel AUC 0.995 0.995 0.989 0.991 0.938 0.998 0.991 0.999 0.990 0.992 0.986 0.991 0.988
Pixel AP 0.176 0.687 0.585 0.428 0.372 0.076 0.032 0.917 0.143 0.389 0.424 0.585 0.401
Pixel PRO 0.940 0.855 0.945 0.846 0.853 0.954 0.944 0.943 0.892 0.909 0.901 0.957 0.912
RD4AD Image AUC 0.922 0.901 0.996 0.997 0.966 0.984 0.976 0.976 0.911 0.955 0.965 0.970 0.960
Image AP 0.926 0.941 0.996 0.999 0.984 0.993 0.989 0.973 0.906 0.945 0.961 0.970 0.965
Pixel AUC 0.979 0.895 0.958 0.990 0.943 0.977 0.877 0.750 0.648 0.955 0.928 0.920 0.901
Pixel AP 0.190 0.123 0.282 0.589 0.543 0.438 0.352 0.005 0.006 0.591 0.106 0.104 0.277
Pixel PRO 0.922 0.569 0.790 0.925 0.810 0.713 0.680 0.432 0.464 0.803 0.722 0.683 0.709
SPADE Image AUC 0.910 0.614 0.978 0.858 0.886 0.952 0.879 0.721 0.507 0.905 0.831 0.811 0.821
Image AP 0.925 0.725 0.974 0.934 0.943 0.980 0.942 0.679 0.489 0.911 0.826 0.842 0.847
Pixel AUC 0.979 0.607 0.864 0.986 0.967 0.962 0.875 0.669 0.711 0.951 0.890 0.818 0.856
Pixel AP 0.120 0.041 0.117 0.498 0.354 0.499 0.315 0.003 0.003 0.503 0.082 0.050 0.215
Pixel PRO 0.932 0.361 0.574 0.939 0.913 0.613 0.634 0.384 0.422 0.803 0.716 0.617 0.659
STPM Image AUC 0.905 0.737 0.988 0.913 0.640 0.967 0.759 0.899 0.775 0.745 0.890 0.777 0.833
Image AP 0.912 0.840 0.986 0.962 0.823 0.986 0.881 0.910 0.747 0.756 0.903 0.773 0.873
Pixel AUC 0.966 0.719 0.907 0.761 0.932 0.971 0.867 0.637 0.606 0.958 0.858 0.826 0.834
Pixel AP 0.187 0.026 0.135 0.293 0.205 0.272 0.277 0.002 0.003 0.507 0.080 0.047 0.169
Pixel PRO 0.917 0.386 0.725 0.528 0.836 0.686 0.610 0.370 0.368 0.742 0.723 0.553 0.620

About