Model Registry: Torrents for open models using Hugging Face as a fallback web seed.

Hi,

I created a repo/site for publishing/sharing .torrent files for popular open models, added web seed support and a few scripts to automate it.

Repo: https://github.com/marella/modelregistry
Site: https://modelregistry.io

Web seed will be used as a fallback to download files from Hugging Face if no peers are available. To make this work (https://www.bittorrent.org/beps/bep_0019.html), I had to build a small backend service that redirects the requests from BitTorrent clients to the correct HF endpoint depending on whether a file is stored in LFS or not. It's still experimental. Occasionally, HF CDN returns errors for some files, but downloads usually succeed after a few retries.

It is still WIP. I'm planning to automate the entire process (.torrent creation for new models, publishing to site etc.) using GitHub actions. However, GitHub's free runners only provide ~100 GB disk space, so I will have to find an alternative for 100+ GB models.

Please share your thoughts or suggestions.