• Ep05: "Deploy Local LLMs 𝐢𝐧 the Cloud (𝟏𝟎𝟎% 𝐃𝐚𝐭𝐚 𝐏𝐫𝐢𝐯𝐚𝐜𝐲)"

  • 2024/09/24
  • 再生時間： 11 分
  • ポッドキャスト

Ep05: "Deploy Local LLMs 𝐢𝐧 the Cloud (𝟏𝟎𝟎% 𝐃𝐚𝐭𝐚 𝐏𝐫𝐢𝐯𝐚𝐜𝐲)"

無料で聴く

ポッドキャストの詳細を見る

  • サマリー

  • 👨🏽‍🚀 Welcome to Episode 05 of "Tech Beats unplugged"

    This time, we tried something completely crazy – we're letting the AI hosts take over! That's right 😎. We're flipping the script and giving the AI the mic to guide us through the fascinating world of local LLMs. but that's not all as this episode is actually inspired by my recent talk at Oracle Cloud World in Vegas. The topic? You guessed it: Local LLMs in the cloud.

    🌟 We’re so excited to share our latest tech Beats show with you🧡!

    We hope you'll enjoy it!!!

    Topics discussed:

    1. (00:00) Introduction
    2. (01:00) Why OpenAI Might Not Be Your BFF?
    3. (02:40) Local/Open LLMs to the Rescue!
    4. (03:38) What's Quantization!
    5. (04:30) Where to find these Open LLMs?
    6. (05:02) Inference Engines (Ollama)!
    7. (05:50) What's a modelfile!
    8. (06:40) What about deploying local AI to the cloud?(OKE/managed kubernetes)
    9. (07:30) From zero to cloud deployment Hero
    10. (08:28) What's Next (LLM ethic benchmark)
    11. (09:55) Outro.

    Show Notes

    • My local LLM GitRepo: Ollama_lab
    • Helm leaderboard for model safety: Sandford Helm model leaderboard
    • My talks in Oracle cloud world 2024: OCW2024LLM
    続きを読む 一部表示

あらすじ・解説

👨🏽‍🚀 Welcome to Episode 05 of "Tech Beats unplugged"

This time, we tried something completely crazy – we're letting the AI hosts take over! That's right 😎. We're flipping the script and giving the AI the mic to guide us through the fascinating world of local LLMs. but that's not all as this episode is actually inspired by my recent talk at Oracle Cloud World in Vegas. The topic? You guessed it: Local LLMs in the cloud.

🌟 We’re so excited to share our latest tech Beats show with you🧡!

We hope you'll enjoy it!!!

Topics discussed:

  1. (00:00) Introduction
  2. (01:00) Why OpenAI Might Not Be Your BFF?
  3. (02:40) Local/Open LLMs to the Rescue!
  4. (03:38) What's Quantization!
  5. (04:30) Where to find these Open LLMs?
  6. (05:02) Inference Engines (Ollama)!
  7. (05:50) What's a modelfile!
  8. (06:40) What about deploying local AI to the cloud?(OKE/managed kubernetes)
  9. (07:30) From zero to cloud deployment Hero
  10. (08:28) What's Next (LLM ethic benchmark)
  11. (09:55) Outro.

Show Notes

  • My local LLM GitRepo: Ollama_lab
  • Helm leaderboard for model safety: Sandford Helm model leaderboard
  • My talks in Oracle cloud world 2024: OCW2024LLM
続きを読む 一部表示

Ep05: "Deploy Local LLMs 𝐢𝐧 the Cloud (𝟏𝟎𝟎% 𝐃𝐚𝐭𝐚 𝐏𝐫𝐢𝐯𝐚𝐜𝐲)"に寄せられたリスナーの声

カスタマーレビュー：以下のタブを選択することで、他のサイトのレビューをご覧になれます。

Audible.co.jp

Amazon.co.jp
レビューはまだありません。