Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
Meningitis can affect anyone at any age.
Seek medical attention immediately if you experience symptoms.
Symptoms include
➡️Fever/severe headache
➡️Vomiting
➡️Drowsiness
➡️Rash
➡️Seizures
➡️Muscle/joint pain
➡️Stiff neck
#DefeatMeningitis
#Meningitis can affect any age group but mostly occurs in children and young adults.
Visit a healthcare centre for immediate medical attention if you notice any of these symptoms in your young ones.
Let’s #DefeatMeningitis together.
#Meningitis spreads mostly from one person to another through respiratory droplets e.g. coughing, sneezing & close contact such as kissing
Seek immediate medical attention if you experience these symptoms
Let’s #DefeatMeningitis together.
#Meningitis spreads mostly from one person to another through respiratory droplets e.g. coughing, sneezing & close contact such as kissing
Meningitis can affect anyone at any age. Seek medical attention if you experience symptoms.
Let's take action to #DefeatMeningitis together.
#Meningitis spreads mostly from one person to another through respiratory droplets e.g. coughing, sneezing & close contact such as kissing
Meningitis can affect anyone at any age. Seek medical attention if you experience symptoms
Let's take action to #DefeatMeningitis together
#Meningitis is an inflammation of the membranes around the spinal cord & brain.
Seek medical attention when you experience signs & symptoms such as:
➡️Fever/severe headache
➡️Vomiting
➡️Drowsiness
➡️Rash
➡️Seizures
➡️Muscle/joint pain
➡️Stiff neck
#DefeatMeningitis
#Meningitis is a medical emergency that can be deadly & can cause long-lasting impacts such as brain damage, hearing loss, organ damage & limb loss.
Early recognition saves lives. Seek immediate medical attention if you experience associated symptoms.
#DefeatMeningitis
📌Meningitis is a vaccine-preventable disease but can progress rapidly and become life-threatening if not vaccinated early.
The best way to protect yourself and your loved ones is:
✅Early vaccination
✅Recognizing the signs early
✅Seek immediate medical care
✅Follow prevention measures.
Together, we can defeat meningitis💪
#DefeatMeningitis#StaySafe#NCDCNigeria
Across the world, meningitis kills 1 in 10 people & causes lifelong disability in 1 in 5 people who survive it.
This #WorldMeningitisDay aims to remind us to raise awareness of #meningitis, its signs & symptoms, available vaccines and the race we must make to #DefeatMeningitis
Vaccination is the best prevention measure against #CerebrospinalMeningitis.
Ensure you complete Nigeria's routine immunisation schedule for your children or wards to keep them safe and #healthy.
#DefeatMeningitis
Vaccination is the best prevention measure against #CerebrospinalMeningitis.
Ensure you complete Nigeria's routine immunisation schedule for your children or wards to keep them #safe from vaccine-preventable diseases.
#DefeatMeningitis
#WorldMeningitisDay