Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
🚗✨Introducing the New Nissan Patrol & Armada!✨🚙
🌍 Available globally as the Patrol and in the USA as the Armada, these powerful SUVs are equipped with a robust 3.5L turbo V6 engine, delivering an impressive 425 HP and 700 Nm of torque! 💪🔧 (+7% power & +25% torque) paired with a smooth 9-speed automatic transmission.
📏 Built on the recently launched Infiniti QX80 platform, the Patrol has been slightly lengthened and widened while maintaining the same wheelbase. 🛠️ It now offers even more space for passengers, with an additional 145 mm in the third-row legroom, and a cargo capacity ranging from 578 to 2750 liters! 🧳📦
🌄 The all-wheel-drive system features a low range and optional rear differential lock for enhanced off-road capability. For the North American market, check out the rugged Armada Pro-4X variant, complete with air suspension, off-road bumpers, and all-terrain tires! 🌲🛤️
💰 Prices have been announced only for the UAE, starting at approximately $65,000.
Get ready for adventure with the new Nissan Patrol & Armada! 🚀🌟
#NissanPatrol#NissanArmada#SUV#OffRoad#AdventureAwaits#PowerfulPerformance#Auto
🚐✨Introducing the Luxurious Brabus Big Boy 1200 Motorhome!✨🚐
This stunning camper, priced at €1.26 million, measures an impressive 12 meters in length and is designed for a maximum of three residents. 🛏️👨👩👧
The Big Boy 1200 features several retractable modules that expand the living space during your stay, offering a spacious bedroom and a cozy living area that doubles as a dining room. 🛋️🍽️
In the bedroom, you'll find a full-size bed (160x200 cm), while an additional sleeping space for one person is cleverly located above the driver’s cabin. 💤🛌
Built on a robust three-axle Mercedes-Benz Actros chassis, this motorhome is powered by a 12.8-liter diesel engine that delivers an astonishing 530 hp and 2600 Nm of torque! 💪🚛
Get ready to travel in style and comfort! 🌍❤️
#Brabus#BigBoy1200#LuxuryMotorhome#VanLife#TravelInStyle#MercedesBenz#AdventureAwaits#Auto
🚗💨Introducing the Ford F-150 Raptor Shelby Baja Raptor!💥🔥
Get ready to unleash the power with an incredible 900-horsepower engine upgrade! 💪 The 3.5L V6 EcoBoost now roars at 550 hp, while the 5.2L V8 on the Raptor R delivers a staggering 730 hp with a new supercharger and custom exhaust! 🎉🔧
Key features include:
✨ Enhanced BDS suspension
✨ Massive 37-inch tires
✨ Custom hood with air intakes
✨ Heavy-duty bumpers and extra LED lights
✨ Robust cargo rack for the bed
Starting at just $51,995 (excluding the base truck price), this beast is ready to dominate any terrain! 🌍🏞️
#FordF150#Raptor#ShelbyBajaRaptor#OffRoad#Power#TruckLife#AdventureAwaits#CarEnthusiast#Auto