Thanks for the reply and sorry if i was not clear.I can access the llm with the below python request.
def call_llm_with_context(context, query): url = “https://API” payload = json.dumps( “model”: “internal model”, “max_tokens”: 4096, temperature”: 1 “stream”: False, “messages”: ٠ “role”: “system”, “content”: fcontext)’ “role”: “user”, “content”: f”Answer this based on above context: fquery)’
headers Authorization’: Bearer Token, content-type’: ‘application/json
response = requests.request(“POST”, url, headers=headers, data=payload) return response.json()[“choices”][0][“message”][“content”]
if i want to use phidata or crewai..how do i use it ? As the default packages (openaichat..)are more for industry openai..