ComfyUI_Artcoder

This project is a custom node for ComfyUI that uses ArtCoder [CVPR 2021] to refine videos generated by AnimateDiff [ICLR2024 Spotlight] or the other video. The node is to transform these videos into functional QR code videos that can be scanned.

Some demo workflow

Artcoder Artcoder.json

Artcoder Params

content_images: Images generate by AnimateDiff
qr_image: QR code image
style_image: Style image
content_scaling: scaling for content
qr_scaling: scaling for scanablity
style_scaling: scaling for style
iteration: ArtCoder refinement iterations

Citation

Reference for unofficial ArtCoder implement

@misc{liao2024artcoder,
    title  = {A PyTorch implementation of ArtCoder},
    author = {Jia-Wei Liao},
    url    = {https://github.com/jwliao1209/ArtCoder},
    year   = {2024}
}

Reference for the original paper Artcoder: an end-to-end method for generating scanning-robust stylized qr codes

@inproceedings{su2021artcoder,
  title     = {Artcoder: an end-to-end method for generating scanning-robust stylized qr codes},
  author    = {Hao Su, Jianwei Niu, Xuefeng Liu, Qingfeng Li, Ji Wan, Mingliang Xu, Tao Ren},
  booktitle = {CVPR},
  year      = {2021}
}