Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
Russian Defence Ministry (@mod_russia_en):
❗️Statement by Russian Defence Ministry
▪️ On March 14, at about 11.30 a.m. Moscow time, Tochka-U tactical missile was fired at a residential block of Donetsk city from the territory controlled by the Kiev nationalist regime.
▪️ The shelling of the city was carried out from the north-western direction, from the area of Krasnoarmeysk settlement, which is controlled by Ukrainian nationalist units.
▪️ As a result of the explosion of a cluster warhead in the center of Donetsk, 20 civilians were killed. Another 28 people, including children, were seriously injured and taken to medical institutions.
▪️ The use of such weapons on a town with no armed forces firing positions, i.e. deliberately targeting civilians, is a war crime.
#Ukraine#Donetsk#WarCrime
How a Secluded 1984 Conference Forged Israel’s Unprecedented Influence Over US Media
October 31st, 2024
By Kit Klarenberg
.
In the first week of January 2024, Israeli forces fired 355 bullets at a car containing a five-year-old, then shot at rescue workers who rushed to save her life.
An indisputible act of murder, a definite #WarCrime – yet, per many Western media headlines, she was simply a “girl killed in Gaza.”
The circumstances and perpetrators of her death, if mentioned at all, were invariably buried at the bottom of reports, well hidden from the 80% of the news-consuming public who only read headlines.
In contrast, on October 15 2024, Sky News was very keen that its viewers know the names and faces of four “teenage” #IDF soldiers “killed” in a “#Hezbollah#drone attack,” humanizing and infantilizing individuals who, by mere token of their service in Israel’s military, are by definition, guilty of genocide. ..... (read more....)
🇺🇸#USA
#US#Senator#LindseyGraham voices his fear that, due to the International Criminal Court's (#ICC) #WarCrime Charges against Israeli PM #Netanyahu, there might after all even be some adverse #legal consequences for both his own, and his country's, illegal War actions.
"If they'll do this to Israel, we're next."