See if my instructions here help you out:
It is a tutorial to build from source, but it should hopefully not be too bad. Check the extra note I added further down to add curl support as well, which will allow it to grab models straight from huggingface.