Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
🔍 Police found no fault in fatal car crash involving Sen. Menendez's wife. Investigation opened to ensure proper handling by officers. Victim was jaywalking with drugs and alcohol in his system. Dashcam audio suggests possible intoxication. Democrat senator facing separate bribery charges. Wife not criminally charged. Tragic accident under scrutiny. #Corruption#Politics#JusticeDelayed
https://www.foxnews.com/politics/democrat-sen-bob-menendezs-wife-2018-fatal-car-crash-nj-ags-microscope-reports
Subscribe to @BadVolfNews
This is a haunting question that cuts to the heart of Ethiopia’s ongoing cycle of political violence.
“What are we giving birth to through all this killing?”
In this powerful reflection from The Standard Signal EP.16, the conversation confronts the brutal reality of unresolved killings, missing justice, and the human cost of political conflict—from Negele Borena to Harar to Ambo.
Two years after the assassination of Bate Urgessa, the questions of accountability and justice remain painfully unanswered.
🎥 Watch the full episode of The Standard Signal on: https://www.youtube.com/watch?v=gAXvr9JN3Y8
#BateUrgessa#Ethiopia#JusticeDelayed#HumanRights#PoliticalViolence#TheStandardSignal#NeverForget
#Premiering_now: Two Years Without Justice: Remembering the BrutalAssassination of Bate Urgessa
April 9, 2024, a night that ended in a brutal execution a husband, a father of five, an intellectual and a peaceful politician.
Two years later, the questions remain.
Click here to watch: https://youtu.be/gAXvr9JN3Y8?si=q7C8otTOvcTw_fZ5
In this commemorative episode of The Standard Signal, host Tsedale Lemma discusses with Prof. Ezekiel Gebissa to revisit the life, final hours, and aftermath of Bate Urgessa’s brutal assassination by government forces, and examine what has (and hasn’t) changed since.
#BateUrgessa#Ethiopia#JusticeDelayed#HumanRights#Oromo#OLF#PoliticalViolence#Accountability#AfricaNews#HornOfAfrica#TheStandardSignal#NeverForget
The Standard Signal Ep 16| Two Years Without Justice: Remembering the Brutal Assassination of Bate Urgessa
On April 9, 2024, Bate Urgessa was brutally assassinated by government forces.
This special episode revisits the timeline, and what it reveals about justice and political space in Ethiopia today.
#TsedaleLemma in conversation with #EzekielGebissa
Premiers tonight at 7:30 PM EAT
Subscribe to watch: https://youtube.com/@addisstandard
#BateUrgessa#Ethiopia#Anniversary#JusticeDelayed#HumanRights#PoliticalViolence#Oromo#OLF#Accountability#HornOfAfrica#TheStandardSignal