Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
🌍 The Madagascar and Indian Ocean Islands hotspot is home to over 11,000 plant species, and about 80% of them exist nowhere else—an extraordinary concentration of unique life. ✨
#biodiversity⚡#islands⚡#conservation⚡#geography⚡#nature⚡#earth
👉subscribe Amazing Geography
👉more Channels
👆तेंदुए की दहाड़ से गूंजता जंगल।। 🐾🐆
8% की वृद्धि के साथ, 2022 में तेंदुए की आबादी संख्या 13,874 पहुंची, जो कि 2018 में 12,852 थी।
#Conservation
#Wildlife
🌎 On the plains of Mongolia, the Przewalski’s horse gallops wild—the only truly wild horse species left on Earth. Unlike domestic horses, it has never been tamed, boasting a stocky build, upright mane, and a unique history of survival after near-extinction in the wild. ✨
#wildlife⚡#conservation⚡#mammals
👉subscribe Interesting Planet
🌍 Costa Rica’s biodiversity hotspot holds more plant species in just one hectare than most European countries have nationwide, showcasing how concentrated life can be in these rare regions. ✨
#biodiversity⚡#conservation⚡#tropics⚡#geography⚡#nature⚡#earth
👉subscribe Amazing Geography
👉more Channels
Selamat Hari Raya Haji! ✨
In the first episode of our new series ‘Your POV’, see through the eyes – and lens – of photographer @izmyphotos📸
We’ll celebrate Hari Raya Haji while exploring Masjid Alkaff Upper Serangoon – a recipient of the Architectural Heritage Award (AHA) in 2015 for retaining the vision of the original architects 🕌
Curious about other AHA winners?
👉 Check it out here: go.gov.sg/AHA2024TG
#ExploreSingapore#Conservation#ArchitectureSG
🌍 The Sundaland region in Southeast Asia is a biodiversity hotspot where over 15,000 plant species are found, nearly half of which exist nowhere else on Earth. ✨
#biodiversity⚡#hotspots⚡#conservation⚡#geography⚡#nature⚡#earth
👉subscribe Amazing Geography
👉more Channels
🌍 The Eastern Arc Mountains in East Africa are a biodiversity hotspot where 75% of the area's plant species exist nowhere else on Earth—making it one of the planet’s most unique natural vaults. ✨
#biodiversity⚡#conservation⚡#ecology⚡#geography⚡#nature⚡#earth
👉subscribe Amazing Geography🌍
🌎 In the Gulf of California, the vaquita porpoise is the world’s rarest marine mammal, with fewer than 10 left. Its shy nature and distinctive dark eye rings make it unique, but illegal fishing nets threaten its survival. ✨
#vaquita⚡#conservation⚡#ocean
👉subscribe Interesting Planet
🌎 The Svalbard Global Seed Vault, buried deep in a Norwegian mountain, stores over a million seed varieties as a backup for global agriculture—safeguarding food diversity for future generations. ✨
#biodiversity⚡#conservation⚡#vault
👉subscribe Interesting Planet
🌎 The black robin of New Zealand bounced back from just five birds left in the world in 1980—thanks to devoted conservation, their population is now stable. This comeback highlights how careful human intervention can save even the rarest species from extinction. ✨
#conservation⚡#wildlife⚡#recovery
👉subscribe Interesting Planet
🌎 The Okavango Delta in Botswana transforms each year from dry savanna to a maze of wetlands due to annual flooding, but modern irrigation and water extraction upstream have reduced natural flows. This human impact threatens a UNESCO World Heritage site that supports over 400 bird species and large populations of elephants and hippos. ✨
#conservation⚡#wetlands⚡#Africa
👉subscribe Interesting Planet
👉more Channels
🌍 Nearly 10 million hectares of forest are lost each year, but new satellite tracking helps spot illegal logging and monitor regrowth, making large-scale forest recovery more achievable than ever. ✨
#deforestation⚡#satellites⚡#conservation⚡#geography⚡#nature⚡#earth
👉subscribe Amazing Geography🌍