ArgyllCMS was recently updated to version 3.2.0 and since they just provide a x86_64 build that can be used with rosetta here a macports based build for arm64:
Argyll_V3.2.0_macOS11_arm64_bin.tgz
built on my system, checked a subset of binaries via doing a display calibration with GitHub - eoyilmaz/displaycal-py3: DisplayCAL Modernization Project , available via PyPi - so no warranty
binaries are unsigned so you you need to convince your mac that this stuff is ok 
xattr -dr com.apple.quarantine * <wherever you unpacked that package>/Argyll_V3.2.0/bin