Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
#idioms
💥Let the 'side down (BrE)
○to disappoint your
family, friends, team, etc. by not being as
successful as they expect, or not helping or
supporting them.
☆ John would never let the side down.
☆ I knew I was letting the side down (=
disappointing my family, etc.) by not going to
college.
#idioms
💥Water off a duck's back
○criticism or unpleasant things have no effect on someone; they don't take it personally.
▪️ No matter how much they criticize her, it's like water off a duck's back — she just keeps going.
▪️ He laughed off all the negative comments, letting them be water off a duck's back.
#idioms
💥A BOOTLICKER
🔅Someone who flatters or obeys others in power to gain favour.
▪️Jeff is such a bootlicker, always agreeing with the boss no matter what.
#idioms
☆Crunch time
•The period of time just before a project has to be completed and everyone has to work hard .
●I’m not getting much sleep these days,
because it’s crunch time at work.
#idioms
☆Run on fumes
•To continue to stay awake when feeling exhausted .
●I really have to take a nap now. I haven’t slept for twenty hours and I’m
running on fumes.
#idioms
⚜Turn the clock back
●to return to a situation that existed in the past; to return to
old-fashioned methods or ideas.
●This new law is
an attempt to turn the clock back.
#idioms
💥 leave sb to their own devices
▪️to leave sb alone to do as they wish.
🔅Once I’ve explained things to him I tend to leave him to his own devices.
#Idioms
💢To pull out all the stops
♠️To make every possible effort to get something done
Ex:- The company pulled out all the stops to advertise their new product.
#idioms
💥in a bind | fix | jam
⚜If someone is in a bind, or in a jam, or in a fix, they're in a bad or difficult situation.
⚡️Jimmy's in a bind because he owes a lot of money to some mafia guys, and he hasn't got it.