Posted in

演示:使用 WasmEdge 部署大型语言模型_AI阅读总结 — 包阅AI

包阅导读总结

1.

– `LLMs`、`WasmEdge`、`WebAssembly`、`Language Models`、`JavaScript`

2.

本文主要介绍了关于部署 LLMs 与 WasmEdge 的相关内容,包括吸引用户加入社区获取新闻,提及 WebAssembly 对大型语言模型的优势,以及展示相关演示和视频,同时提到用户订阅和隐私政策等。

3.

– 邀请用户加入软件工程领导者和开发者社区,获取重要新闻和独家内容

– 说明之前退订过的用户可重新订阅,并需同意相关条款

– 欢迎新用户,让其回答问题以获取感兴趣的新闻和资源

– 介绍 WebAssembly 在大型语言模型中的优势

– 具有便携性,无需重新编译

– Miley Fu 在 The New Stack Makers 中展示 WasmEdge 与 Gemma 的结合使用

– 提供相关视频和演示

– 可观看完整视频,查看 Fu 的两场关于 WebAssembly 和 Rust 编程语言的演讲

– 鼓励订阅 YouTube 频道获取更多内容

– 提及 TNS 每日新闻通讯的订阅和隐私政策

思维导图:

文章地址:https://thenewstack.io/demos-deploying-llms-with-wasmedge/

文章来源:thenewstack.io

作者:Heather Joslyn

发布时间:2024/7/18 18:06

语言:英文

总字数:191字

预计阅读时间:1分钟

评分:89分

标签:WebAssembly,大型语言模型,WasmEdge,运行时,人工智能


以下为原文内容

本内容来源于用户推荐转载,旨在分享知识与观点,如有侵权请联系删除 联系邮箱 media@ilingban.com

Join our community of software engineering leaders and aspirational developers. Alwaysstay in-the-know by getting the most important news and exclusive content deliveredfresh to your inbox to learn more about at-scale software development.

It seems that you’ve previously unsubscribed from our newsletterin the past. Click the button below to open the re-subscribe formin a new tab. When you’re done, simply close that tab and continuewith this form to complete your subscription.

The New Stack does not sell your information or share it withunaffiliated third parties. By continuing, you agree to our

Terms of Use

and

Privacy Policy

.

Welcome and thank you for joining The New Stack community!

Please answer a few simple questions to help us deliver the news and resources you are interested in.

Great to meet you!

Tell us a bit about your job so we can cover the topics you find most relevant.

REQUIRED

Welcome!

We’re so glad you’re here. You can expect all the best TNS content to arriveMonday through Friday to keep you on top of the news and at the top of your game.

What’s next?

Check your inbox for a confirmation email where you can adjust your preferencesand even join additional groups.

Follow TNS on your favorite social media networks.

Become a TNS follower on LinkedIn.

Check out the latest featured and trending stories while you wait for yourfirst TNS newsletter.

As a JavaScript developer, what non-React tools do you use most often?

I don’t use JavaScript

0%

Thanks for your opinion! Subscribe below to get the final results, publishedexclusively in our TNS Update newsletter:

2024-07-16 08:28:12

Demos: Deploying LLMs With WasmEdge

podcast,video,

Demos: Deploying LLMs With WasmEdge

WebAssembly’s portability makes it a useful runtime for large language models. See Miley Fu demonstrate the tool for The New Stack Makers.

Jul 16th, 2024 8:28am by Heather Joslyn
Featued image for: Demos: Deploying LLMs With WasmEdge

SEATTLE —Among the benefits of WebAssembly: it offers great promise as a runtime for large language models, due to its portability. WebAssembly (or Wasm, to its friends) allows developers to write code on any platform, in the language of their choice, without the need for recompilation.

VIDEO

“Wasm is — you can think of it as the Java bytecode,” said Miley Fu, devrel and founding member of Second State, in this episode of The New Stack Makers. “That’s because Java used to want to realize the dream of write once, run anywhere.”

In this On the Road episode of Makers, recorded at Open Source Summit North America in April, Fu demonstrated how to use WasmEdge, a runtime she created, with Gemma, an open source language model created by Google.

Watch the entire episode to see WasmEdge in action. And check out Fu’s two Open Source Summit presentations, both about WebAssembly and the Rust programming language: one on building serverless AI workflows and the other about creating AI agents.

YOUTUBE.COM/THENEWSTACK

Tech moves fast, don’t miss an episode. Subscribe to our YouTubechannel to stream all our podcasts, interviews, demos, and more.

GroupCreated with Sketch.

TNS DAILY NEWSLETTERReceive a free roundup of the most recent TNS articles in your inbox each day.

The New Stack does not sell your information or share it withunaffiliated third parties. By continuing, you agree to our

Terms of Use

and

Privacy Policy

.