Paul Couvert · @itsPaulAi

Qwen has just released a model on par with GPT-4o... And you can run it locally easily 🤯 Yep. GPT-4o level A...

查看 @itsPaulAi 在 2025年7月29日 20:48 发布的这条 X/Twitter 推文。 这条内容包含 3 个视频和 1 张图片。

发布时间
2025年7月29日 20:48
线程条目数
4
媒体数量
4

推文概览

查看 @itsPaulAi 在 2025年7月29日 20:48 发布的这条 X/Twitter 推文。 这条内容包含 3 个视频和 1 张图片。

Qwen has just released a model on par with GPT-4o...

And you can run it locally easily 🤯

Yep. GPT-4o level AI running offline on a laptop.

- Fully open source
- Only 3B active parameters
- 262k context length natively

Quick steps to run it on your machine and details below 
1. Download LM Studio and the model

- Install LM Studio for your OS (macOS, Windows, Linux)
- In the search tab type "Qwen3 30B A3B 2507"

I highly recommend the versions quantized by Unsloth, especially those marked "UD".

They're REALLY efficient. E.g.: Q4_K_XL Qwen3 30B A3B Instruct 2507 UD

Then just click on the download button.
2. Load the model

- Open the chat tab
- Select the model you've downloaded in the list
- Adjust the context length if you want
- Change the default parameters in the sidebar to:

  * Temperature=0.7
  * TopP=0.8
  * TopK=20
  * MinP=0

And you're good to go! 
Useful links:

- Try the model on Qwen Chat (non-locally): https://chat.qwen.ai/?model=Qwen3-30B-A3B-2507
- Hugging Face: https://huggingface.co/Qwen/Qwen3-30B-A3B-Instruct-2507
- LM Studio: https://lmstudio.ai/

Again... GPT-4o level but 100% locally on a laptop. That's just crazy when you think about it. 
Paul Couvert media

来自 @itsPaulAi 的更多内容

来自 Paul Couvert 的收录推文

查看全部

相关创作者

TwitFast

v1.4.88

Free Twitter video downloader. Top Twitter trends and hashtags list, Monitor, track hottest trending topics, hashtags.

© 2024 TwitFast 保留所有权利。