Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
Mientras el mundo se moviliza por Palestina y tratar de desbloquear Gaza, EE.UU. aprovecha de atacar a Irán con impunidad.
Así negocia EE.UU.
Qué alivio saber que Donald Trump sigue comprometido con "la diplomacia"... a su manera. No hay mejor Acuerdo de Paz que advertirle a un país entero que será reducido a cenizas.
#iran
#gaza
#gazaunderattack
#breakthesiege
#usdiplomacy
#diplomacy
🚀 U.S. Vice President Vance Heads to Islamabad for U.S.-Iran Talks
U.S. Vice President Vance has departed for Islamabad, Pakistan, aboard Air Force Two to participate in negotiations between the United States and Iran. According to BlockBeats, accompanying him are U.S. Special Envoy for Middle East Affairs, Whitaker, and U.S. President Donald Trump's son-in-law, Kushner.
Before boarding, Vance expressed optimism about the upcoming talks with Iran, stating that he anticipates positive discussions in Islamabad. He emphasized that if Iran approaches the negotiations with sincerity, the United States will remain open-minded. However, he cautioned Iran against attempting to 'play games with the United States.' Vance noted that U.S. President Donald Trump has provided 'quite clear guidelines' for the negotiations.
#USVicePresident#Vance#Islamabad#USIranTalks#MiddleEastAffairs#Kushner#DonaldTrump#USDiplomacy#IranNegotiations
🚀 Israel-Hezbollah Conflict Complicates U.S.-Iran Relations
The ongoing conflict between Israel and the Iran-backed Lebanese militia Hezbollah is adding complexity to the United States' efforts to resolve its longstanding tensions with Iran. Bloomberg posted on X, highlighting the intricate geopolitical dynamics at play.
The hostilities between Israel and Hezbollah have intensified, with both sides engaging in military actions that threaten to escalate further. This situation is complicating U.S. diplomatic strategies aimed at de-escalating tensions with Iran, as Hezbollah's actions are closely linked to Iranian interests in the region.
The U.S. has been attempting to negotiate with Iran to address various issues, including nuclear capabilities and regional influence. However, the involvement of Hezbollah, a significant player in the Middle East conflict, poses challenges to these diplomatic efforts.
As the situation unfolds, the international community is closely monitoring developments, with concerns about potential broader implications for regional stability. The U.S. continues to navigate these complex relationships, seeking a resolution that addresses both its strategic interests and the security concerns of its allies in the region.
#Israel#Hezbollah#USIranRelations#MiddleEastConflict#Geopolitics#USDiplomacy#Iran#Lebanon#RegionalStability#NuclearNegotiations#MilitaryEscalation#InternationalRelations