Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
#Iceland🇮🇸
A special place in Iceland is considered to be the black beach. It was here that such cult movies as "The Lord of the Rings", "Game of Thrones" and "Star Wars" were filmed. The black beach was formed as a result of volcanic activity. This event happened many years ago
#Iceland, Gudlfoss 🇮🇸
Gyudlfoss is a waterfall in Iceland, in the Syudurland region.
The depth of the waterfall to the place of water falling in the valley is about 70 meters. The Güdlfoss itself consists of two steps - 21 meters and 11 meters high, dumped to each other at an angle of 90 °.
It is considered one of the most beautiful places in Iceland and is the most visited tourists.
🌟Breathtaking Views of Iceland!
🟠A mesmerizing landscape where a powerful waterfall meets silent green hills and dramatic clouds on the horizon.
🟠Nature here stuns with its beauty and scale, offering perfect spots for adventure seekers and photography enthusiasts. Feel the grandeur and tranquility of these magnificent landscapes!
#Iceland | @voyage
🗺 Iceland 🇮🇸
Following a recent volcanic eruption, the main highway to the Icelandic town of Grindavík is now impassable, and the surrounding area is covered in lava for several kilometers.
#Iceland | @voyage
Iceland🇮🇸
🟠A canyon located in the Jokuldalur Valley, Iceland.
🟠It is famous for its columnar basalt formations and blue-green water.
#Iceland | @voyage
Iceland🇮🇸
🟠A canyon located in the Jokuldalur Valley, Iceland.
🟠It is famous for its columnar basalt formations and blue-green water.
#Iceland | @voyage
Iceland 🇮🇸
🟠After the eruption of Eldfell volcano on Heimaey Island, a stunning natural wonder emerged — a rock formation shaped like an elephant drinking from the Atlantic.
📏
📏
📏
📏
📏
📏
📏
📏
#Iceland | @voyage
⚡️Hallgrímskirkja – a majestic church in the heart of Reykjavík! ✨🏔️
🟠Inside, it houses a massive pipe organ with 5,275 pipes, standing 15 meters tall and weighing 25 tons – a true musical masterpiece!
📏
📏
📏
📏
📏
📏
📏
📏
#Iceland | @voyage
✨ Hallgrímskirkja — the highest point in Reykjavik.
🟠Imagine a majestic church rising above the city like a guardian of time. Its unique architecture and panoramic views of Reykjavik make it a must-visit place.
📏
📏
📏
📏
📏
📏
📏
📏
#Iceland🇮🇸@voyage