Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
🚀 Student Mode – Your AI Study Buddy! 📚🎓
Struggling with studies? AI is now your ultimate learning assistant! 🏆
✨ What can it do?
✅ Homework Help – Get explanations & answers instantly!
✅ Summarize Texts & Notes – Save time while studying!
✅ Answer Any Subject Questions – Math, Science, History & more!
💡 How to activate?
Simply type:
🔹 /mode – Select Student Mode for a smart study buddy!
🔹 Need help? @OpenAI_helpdesk
🔹 Join the discussion: https://t.me/chatgpt_officialchat
🔥 Ace your studies with AI-powered learning!
➖➖➖➖🔻
💎@Chatgpt_OfficialNews – Stay Updated! ⚡️
🧠 BOT: @Chatgpt_OfficialBOT
#️⃣#GPT4.5 #SmartAI#NextGenTech#AIUpgrade#GPTModel
➖➖➖➖🔺
Nearly 100% of cancer identified by new AI, easily outperforming doctors | In what's expected to soon be commonplace, AI is being harnessed to pick up signs of cancer more accurately than the trained human eye.
🔥 The ultimate all-in-one AI mode is here! Try it today!
➖➖➖➖🔻
💎@Chatgpt_OfficialNews – Stay Updated! ⚡️
🧠 BOT: @Chatgpt_OfficialBOT
#️⃣#GPT4.5 #SmartAI#NextGenTech#AIUpgrade#GPTModel
➖➖➖➖🔺
🚀 Standard Mode – The Perfect Balance! 🎯🤖
Need a reliable, well-rounded AI assistant? Standard Mode is here! 🏆
✨ What can it do?
✅ Great for everyday tasks – Chatting, answering questions, and quick research.
✅ Balanced Performance – No overcomplications, just smart AI!
✅ Perfect for casual and professional use – Your all-in-one AI assistant.
💡 How to activate?
Simply type:
🔹 /mode – Select Standard Mode for a smooth AI experience!
🔹 Need help? @OpenAI_helpdesk
🔹 Join the discussion: https://t.me/chatgpt_officialchat
🔥 The ultimate all-in-one AI mode is here! Try it today!
➖➖➖➖🔻
💎@Chatgpt_OfficialNews – Stay Updated! ⚡️
🧠 BOT: @Chatgpt_OfficialBOT
#️⃣#GPT4.5 #SmartAI#NextGenTech#AIUpgrade#GPTModel
➖➖➖➖🔺
🚀 The Next Leap – GPT-4.5 is Here! 🌍🔥
Welcome to the future of AI with GPT-4.5 – smarter, faster, and better than ever! 💡🤖
✨ Why Choose GPT-4.5?
✅ Reduced Hallucinations – More accurate responses!
✅ Enhanced Memory – AI that understands better!
✅ Next-Level Performance – Optimized for complex tasks!
💡 How to activate?
Simply type:
🔹 /model – Choose GPT-4.5 for peak performance!
🔹 Need help? @OpenAI_helpdesk
🔹 Join the discussion: https://t.me/chatgpt_officialchat
🔥 Unlock the power of GPT-4.5 today!
➖➖➖➖🔻
💎@Chatgpt_OfficialNews – Stay Updated! ⚡️
🧠 BOT: @Chatgpt_OfficialBOT
#️⃣#GPT4.5 #SmartAI#NextGenTech#AIUpgrade#GPTModel
➖➖➖➖🔺
🚀 Psychologist Mode – AI That Listens! 🧠💬
Need someone to talk to? Psychologist Mode is here for thoughtful, supportive conversations. 💖
✨ What can it do?
✅ Offers Emotional Support – AI that listens & responds with care.
✅ Stress & Anxiety Advice – Get helpful guidance anytime.
✅ Confidential & Non-Judgmental – Your personal AI therapist.
💡 How to activate?
Simply type:
🔹 /mode – Select Psychologist Mode for mindful AI conversations!
🔹 Need help? @OpenAI_helpdesk
🔹 Join the discussion: https://t.me/chatgpt_officialchat
🔥 Your AI support system is just one command away!
➖➖➖➖🔻
💎@Chatgpt_OfficialNews – Stay Updated! ⚡️
🧠 BOT: @Chatgpt_OfficialBOT
#️⃣#GPT4.5 #SmartAI#NextGenTech#Psychologue#GPTModel
➖➖➖➖🔺