Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
Putin on Terror Threats and the Tuapse Situation
President Putin emphasized rising terrorist threats, accusing Kyiv and its backers of resorting to terrorism amid frontline setbacks. He cited the recent strike on energy facilities in Tuapse, highlighting potential environmental risks. Despite this, the situation remains under control, with local services effectively managing the challenges. Following Putin’s orders, the Emergency Ministry head has arrived to coordinate response efforts.
#Putin#Tuapse#Terrorism#Ukraine#Emergencies
The main news of Russia and the world ishere.
Heavy Rain Disrupts Power Supply in Ingushetia and Chechnya
Severe downpours have caused power and water outages in Ingushetia cities—Karabulak, Nazran, and Sunzha. Specialists are working to fix faults in electrical grids and pumping stations. Similar disruptions affect some Chechen districts due to rain and wind.
“Several areas in Karabulak are experiencing electricity interruptions caused by heavy rainfall,” local authorities reported.
#Ingushetia#Chechnya#Weather#PowerOutage#Emergencies
The main news of Russia and the world ishere.
The fifth season of the International Prize #WEARETOGETHER has been launched.
▫️ Foreign citizens and NGOs can apply until June 23, 2025 on the official website of the Prize https://wearetogetherprize.com.
🌐 The Prize is available for volunteers and NGOs from across the globe. The laureates will receive a cash prize valued at $10,000 and an invitation to take part in the International Forum of Civil Participation #WEARETOGETHER, which is traditionally held in December in Moscow.
👉🏻 Prize nominations:
♻️“Sustainable Future”
For those who are leading projects in the field of environmental protection, environmental education, ecological consumption, “green” economy and technologies
#ecology#urbanism#biodiversity#recycling#environmental protection
🕊️“Human Assistance”
For those who run projects aimed at improving the well-being of vulnerable categories of citizens, providing social and humanitarian assistance to people, discovering talents and nurturing individuals, developing education and volunteerism.
▫️ Apply here: https://wearetogetherprize.com/
#social_help#medicine#donorship#healthcare#emergencies
🔜The fifth season of the International Prize #WEARETOGETHER has been launched. Foreign citizens and NGOs can apply until June 23, 2025 on the official website of the Prize.
The Prize is available for volunteers and NGOs from across the globe. The laureates will receive a cash prize valued at $10,000 and an invitation to take part in the International Forum of Civil Participation #WEARETOGETHER, which is traditionally held in December in Moscow.
Prize nominations:
✔️“Sustainable Future”
For those who are leading projects in the field of environmental protection, environmental education, ecological consumption, “green” economy and technologies
#ecology#urbanism#biodiversity#recycling#environmental protection
✔️ “Human Assistance”
For those who run projects aimed at improving the well-being of vulnerable categories of citizens, providing social and humanitarian assistance to people, discovering talents and nurturing individuals, developing education and volunteerism.
Apply here
#social_help#medicine#donorship#healthcare#emergencies