How do I use this model along with HuggingfaceInference ?
#31
by
perceptron-743
- opened
Hey @all . I want to use this model but I don't have the utilities to load it locally. For that reason I am going to use HuggingfaceInference. So is this model available for inference? Because when I paste the inference url here: (inference_url)[/static-proxy?url=https%3A%2F%2Fapi-inference.huggingface.co%2Fmodels%2Fmicrosoft%2FPhi-3.5-vision-instruct%5D%3C%2Fa%3E . The url works fine and returns a proper response.
But now the question is what input should I post at this url. How do I post both text AND image to this endpoint? Does anyone know how to figure this out?