Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
Let’s unlock all your Rat-Dex discoveries! Spot the signs early so we can stop them before they multiply. Help your neighbourhood stay rat-free by reporting signs of rat activity through the OneService app. #KeepSGClean
Don’t dump furniture at void decks or common areas.
🏢 HDB → Contact your Town Council
🏠 Private estate → Contact a public waste collector
Bulky items deserve proper disposal—keep our shared spaces safe & clean 🌍💚
#KeepSGClean
Cups and containers left behind in our shared spaces can trap water and turn into mozzie breeding spots. Pack up your litter, throw them into the bin and #KeepSGClean!
High-rise litter isn’t just messy; it’s dangerous. Let’s keep our shared spaces safe and clean. If you spot litterbugs, report them via the OneService app with details like date, time and location.
#KeepSGClean
Barbecue parties are fun, but piles of litter after aren’t. Food scraps & waste attract pests and make shared spaces unpleasant.
Let’s do our part and bin our waste. Spot someone leaving a mess? Report via the OneService app with date, time & exact location. Let’s keep our chill spots truly chill! #KeepSGClean
The food slapped 😋, but your leftovers? Not so much. Improper disposal of food waste = pests, smells, and fines up to $2,000. Let’s clear our mess before we leave and report littering via the OneService app with details such as date, time and precise location. #KeepSGClean
Your game might be 🔥 but leaving trash behind in public sports facilities is a major foul. Offenders can be fined up to $2,000 for first-time littering.
If you spot litterbugs, report them via the OneService app with details such as date, time and precise location. Let's keep our public sports facilities clean for everyone's game! #KeepSGClean
Pests, like rats, love their new homes within bulky waste. Do you? 🐀
To rid them of their new homes, keep public spaces clear of food and clutter!
HDB: Contact your Town Council
Private homes: Engage licensed collector 👉go.gov.sg/licensed-waste-collectors
Spot bulky waste left in common areas? Report via the OneService app with details such as date, time and precise location (block stack or column). Together, let’s #KeepSGClean!
Clean spaces protect our peace of mind ✨ Dispose of waste responsibly and help keep our shared areas uplifting for all.
Witness littering? Report it via the OneService app with details such as date, time and precise location. Together, let’s #KeepSGClean!