Friendli: the fastest serving engine for generative AI
APACHE-2.0 License
Bot releases are hidden (Show)
Published by kooyunmo 9 months ago
Published by kooyunmo 10 months ago
periflow-client
instead to use the features.[!NOTE]
We are actively integrating the features in Friendli Dedicated Endpoints (previously known as PeriFlow Cloud) to Friendli Suite.
Please useperiflow-client
pacakge instead offriendli-client
to use features for Friendli Dedicated Endpoints.
Those features will be supported withfriendli-client
very shortly.
friendli api chat-completions create \
-g "user Tell me how to make a delicious pancake" \
-m llama-2-13b-chat
Published by kooyunmo 10 months ago
We're thrilled to announce the official release of Friendli Suite, bringing a wealth of enhancements and features to your fingertips.
With this major update, we've given our package and GitHub repository a facelift, transitioning from periflow-client
to the all-new and improved friendli-client
.
Here's a rundown of the key changes:
The CLI command prefix has undergone a transformation! Say goodbye to the old pf
and embrace the fresh friendli
. Now, to sign in, simply use friendli login
instead of the previous pf login
.
In the Python SDK, we've introduced a breaking change that aligns its semantics with the OpenAI Python SDK v1. Fear not, as this update brings more consistency and compatibility. Dive into the details and explore examples on our documentation page.
import os
from friendli import Friendli
client = Friendli(api_key=os.environ.get("FRIENDLI_API_KEY"))
chat_completion = client.chat.completions.create(
model="llama-2-13b-chat",
messages=[
{
"role": "user",
"content": "Tell me how to make a delicious pancake"
}
],
stream=False,
)
print(chat_completion.choices[0].message.content)
🚀 Upgrade now to unlock a world of possibilities with Friendli Suite! If you encounter any challenges or have questions, don't hesitate to reach out. Happy coding! 🤖💬
Published by kooyunmo 11 months ago
Full Changelog: https://github.com/friendliai/periflow-client/compare/0.1.12...0.1.13
Published by kooyunmo 12 months ago
pf convert-adapter --help
to see details.Published by kooyunmo 12 months ago
Published by kooyunmo about 1 year ago
This release includes a hotfix of 0.1.9.
Published by kooyunmo about 1 year ago
Published by kooyunmo about 1 year ago
Full Changelog: https://github.com/friendliai/periflow-client/compare/0.1.7...0.1.8
Published by kooyunmo about 1 year ago
Full Changelog: https://github.com/friendliai/periflow-client/compare/0.1.6...0.1.7
Published by kooyunmo about 1 year ago
pf gpu list
command is added and pf vm list
is deprecated. In the deployment config, max_num_tokens_to_replace
option is added. @kooyunmo in https://github.com/friendliai/periflow-client/pull/26
Full Changelog: https://github.com/friendliai/periflow-client/compare/0.1.5...0.1.6
Published by kooyunmo about 1 year ago
Full Changelog: https://github.com/friendliai/periflow-client/compare/0.1.4...0.1.5
Published by kooyunmo about 1 year ago
Full Changelog: https://github.com/friendliai/periflow-client/compare/0.1.3...0.1.4
Published by kooyunmo about 1 year ago
Full Changelog: https://github.com/friendliai/periflow-client/compare/0.1.2...0.1.3
Published by kooyunmo about 1 year ago
Full Changelog: https://github.com/friendliai/periflow-client/compare/0.1.1...0.1.2
Published by kooyunmo about 1 year ago
pf deployment create
by @pigbug419 in https://github.com/friendliai/periflow-client/pull/3
Full Changelog: https://github.com/friendliai/periflow-client/compare/0.1.0...0.1.1
Published by kooyunmo over 1 year ago
Full Changelog: https://github.com/friendliai/periflow-client/commits/0.1.0