Major Release v1.2 #14
metaskills
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Lots of small quality of life changes ( like find by id 404s ) are happening with the Assistant's API. A release out of beta feels like it is coming soon. Time to make some big changes, a huge one is the way our constructor works. When this API was beta, an assistant required a name, description, and instructions. Both Assistants & Tools have removed their (name, description, instructions) ordinal parameters in favor a single options object. Now, the constructor signature is:
Now that names are no longer unique. The question of how to treat deployments has come up. Document how to use the
id
parameter to ensure a single assistant is used for a deployment no matter how much horizontal scaling is happing. Otherwise, spinning up new cloud resources such as Lambda instances or K8s pods would result in creating a new assistant for each process. We also support a newskipUpdate
option that allows for remote configurations to be applied to new running instances. Thus allowing for new resources to leverage the remote configurations, such as model and instructions. Great for zero deployment changes. For example:Beta Was this translation helpful? Give feedback.
All reactions