Activating the model on huggingface-vscode
Hi. Newbie here. Could you please help me to get around the ways of using the model in VS Code?
I'm trying to activate StableCode-Completion-Alpha-3B-4K on https://github.com/huggingface/huggingface-vscode
I have generated a HF token with a write permission and added it in VS Code extension settings. The bigcode/starcoder model works fine.
On the model page I pressed the '🚀 Deploy' button, selected 'Inference API' item, copied the /static-proxy?url=https%3A%2F%2Fapi-inference.huggingface.co%2Fmodels%2Fstabilityai%2Fstablecode-completion-alpha-3b-4k%3C%2Fa%3E API endpoint URL and pasted it into the 'Hugging Face Code: Model ID Or Endpoint' settings field.
Unlike with the default bigcode/starcoder model, the extension doesn't seem to work. I tried to restart extensions host and also tried stabilityai/stablecode-completion-alpha-3b-4k as value with no luck.
When I type in my editor, I see 🔄 Status bar icon next to Hugging Face Code spinning for a split of a second, and then nothing happens.
The OUTPUT panel shows something like:
INPUT to API: (with parameters {"max_new_tokens":60,"temperature":null,"do_sample":false,"top_p":0.95,"stop":["<|endoftext|>"]})
def main
What am I doing wrong?
Me too, trying to figure out the issue. It works perfectly fine with default model.
I am trying this as well
did anyone figure this out?
xczczxczxcz