Forum in maintenance, we will back soon 🙂
Using HuggingFace for tool development
Hello Hasan and friends: have you or anyone tried building AI tools with HuggginFace open-source models.
HF does provide APIs and there are some 150k models there to play with for different use cases. Was wondering if anyone had gone down that road to build tools using their API yet? if so how that experience was? @husein @hasan
@google-naturemeditation Hello friend, no I havent tried doing it before, but I recently used the Ollama phi 3 model using SimplerLLM and it was very easily integrated in my code.
yes am experimenting with HF a bit on the side to see what models can be used for better outcomes based on tool logic, working with gemini popped up some very questions for me - the free version on the gemini pro is actually not that good in long detailed prompts and or working with multiple apis...haven't seen many folks talking about building tools with HF yet.
@google-naturemeditation Yeah, true. I also tried Gemini and didn't find it suitable for a lot of functionalities, so if you're looking to try a local LLM, try experimenting with Ollama and HuggingFace Models. Both should be easy to integrate.
As I mentioned integrating Ollama Phi 3 model was really easy i followed a youtube video tutorial and it took like 3-5 min.