Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Aleph Alpha Luminous models #60

Closed
Benjoyo opened this issue Jun 19, 2023 · 0 comments
Closed

Add support for Aleph Alpha Luminous models #60

Benjoyo opened this issue Jun 19, 2023 · 0 comments
Assignees
Labels
Prio: SHOULD Important feature, would not prevent from completing the milestone. Status: in progress The task is currently being processed.

Comments

@Benjoyo
Copy link
Member

Benjoyo commented Jun 19, 2023

Aleph Alpha is a German company that provides a set of services using their Luminous series of LLMs. The benefit of using theses models over OpenAI would be their data privacy, European focus and possibility to self host.

First evaluations indicate that at least the biggest „supreme-control“ model may be usable with the „standard“ (non-agent) connectors (extract, decide, compose, translate).

This requires to add an option for these models in the connector template and a switch on the python side to select the right LLM (only ChatOpenAI until now). This is also the time to move away from the vendor and model name agnostic model descriptions in the model select. As more different models are added we need to call them by their names.

Furthermore, the models need specific prompts. They seem to follow the „Stanford/Alpaca“ prompting scheme, so these changes can be made generic to also support some open source LLMs in the future.

@Benjoyo Benjoyo added the Prio: SHOULD Important feature, would not prevent from completing the milestone. label Jun 19, 2023
@Benjoyo Benjoyo self-assigned this Jun 19, 2023
@Benjoyo Benjoyo added the Status: in progress The task is currently being processed. label Jun 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Prio: SHOULD Important feature, would not prevent from completing the milestone. Status: in progress The task is currently being processed.
Projects
None yet
Development

No branches or pull requests

1 participant