Skip to content

Forum in maintenance, we will back soon 🙂

Using HuggingFace f...
 
Notifications
Clear all

Using HuggingFace for tool development

4 Posts
2 Users
2 Reactions
68 Views
(@google-naturemeditation)
Posts: 25
Eminent Member
Topic starter
 

Hello Hasan and friends: have you or anyone tried building AI tools with HuggginFace open-source models. 

HF does provide APIs and there are some 150k models there to play with for different use cases. Was wondering if anyone had gone down that road to build tools using their API yet? if so how that experience was? @husein @hasan 

 
Posted : 09/09/2024 6:35 am
(@husein)
Posts: 534
Member Moderator
 

@google-naturemeditation Hello friend, no I havent tried doing it before, but I recently used the Ollama phi 3 model using SimplerLLM and it was very easily integrated in my code.

 
Posted : 09/09/2024 11:30 am
(@google-naturemeditation)
Posts: 25
Eminent Member
Topic starter
 

yes am experimenting with HF a bit on the side to see what models can be used for better outcomes based on tool logic, working with gemini popped up some very questions for me - the free version on the gemini pro is actually not that good in long detailed prompts and or working with multiple apis...haven't seen many folks talking about building tools with HF yet. 

 
Posted : 09/09/2024 4:44 pm
(@husein)
Posts: 534
Member Moderator
 

@google-naturemeditation Yeah, true. I also tried Gemini and didn't find it suitable for a lot of functionalities, so if you're looking to try a local LLM, try experimenting with Ollama and HuggingFace Models. Both should be easy to integrate.

As I mentioned integrating Ollama Phi 3 model was really easy i followed a youtube video tutorial and it took like 3-5 min.

 
Posted : 09/10/2024 8:39 am
Share: