Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
💡 OpenAI Valuation Soars Above $100 Billion
OpenAI is reportedly in talks to raise new investments, pushing its valuation to over $100 billion. Thrive Capital is set to contribute $1 billion to this funding round, aimed at enhancing computing power and covering operational costs. OpenAI staff may get the chance to sell shares later this year. Despite the impressive valuation, the company faces potential losses of $5 billion in 2024, emphasizing the need for this capital infusion.
#AIInvestment#OpenAI#TechFunding
Ryvn Secures $500K Funding
Ryvn raises $500K to empower startups with on-prem SaaS deployment and management, streamlining operations from a single app.
#Funding#SaaS#Startups#OperationalManagement#TechFunding
Bureau Secures $30M Funding
Bureau, a trust network focused on identity verification, compliance, and fraud prevention for modern businesses, has raised $30 million. The funding round closed on December 18, 2024. 🏦
#Funding#IdentityVerification#Compliance#FraudPrevention#TechFunding#BusinessSolutions#Investment#Startups
Motion.io Secures $3.17M Funding
Motion.io raises $3.17M on December 18, 2024, to enhance their white-label client portals. The funding will support automating client onboarding and improving file, signature, and feedback collection processes.
#MotionIo#Funding#ClientPortals#Automation#Onboarding#TechFunding#Feedback#Signatures#WhiteLabel#Startup#Investment
Alvie Raises $2.19M for HUGO
Alvie has secured $2.19 million to advance HUGO, the first digital assistant aimed at optimizing the spraying of phytosanitary products and bio-controls, as announced on December 19, 2024.
#Alvie#HUGO#Funding#AgTech#DigitalAssistant#Phytosanitary#BioControls#Innovation#TechFunding#SustainableAgriculture
CreatorBid Raises $2.5M; Google Invests in AI
AI-driven platform CreatorBid raised $2.50M in a public sale, achieving a $25M FDV via Binance Wallet. Meanwhile, Google invests $1B in AI startup Anthropic as the company targets a $2B funding round. Notably, Nebius closely trails Yandex in market cap with worth of $9.3B. Significant movements highlight ongoing innovation in the AI and crypto sectors.
Full news: CreatorBid | Google Invest | Divvy Homes Sale | Nebius Market Cap
#AI#Crypto#VC#Fundraising#Google#Anthropic#CreatorBid#Investment#TechNews#Startups#MarketCap#DivvyHomes#Innovations#Binance#Stablecoins#TechFunding#Nebius
Mantis Robotics Secures $5M Funding
Mantis Robotics has raised $5M on December 16, 2024, to develop the Mantis Robot, touted as the fastest and safest industrial robot with physical intelligence.
#MantisRobotics#Funding#Industrialrobot#Investment#Technology#Innovation#Manufacturing#Robotics#Automation#AI#Safety#Fastest#PhysicalIntelligence#Engineering#RoboticSystems#TechFunding#Startup#RoboTech
CLO Virtual Fashion Raises $34.81M
CLO Virtual Fashion successfully raised $34.81 million in funding, with a funding round occurring on December 16, 2024. For more information, visit their website: CLO Virtual Fashion.
#Funding#CLOVirtualFashion#Investment#Fashion#Tech#3DModeling#VirtualReality#FashionTech#Innovation#Startup#TechFunding#Capital#December2024#Growth#Industry#Development#Design#FashionIndustry#DigitalFashion
Zhipu AI Raises $411.82M
Zhipu AI has raised $411.82 million as of December 17, 2024. The company co-developed the GLM-130B model, resulting in a dynamic knowledge engine termed the 'knowledge double wheel'. They also launched the cognitive model platform Bigmodel.ai, featuring products like CodeGeeX and CogView, which provide intelligent API services connecting users across various sectors.
#ZhipuAI#Funding#AI#Bigmodel#GLM130B#CodeGeeX#CogView#API#Tech#KnowledgeMap#CognitiveModels#Intelligence#DigitalHumans#MachineLearning#DataScience#Innovation#Research#TechFunding#Startups#Development
PulseAd Raises $2M Funding
PulseAd, an AI-powered global retail media platform, has secured $2 million in funding as of December 19, 2024. The platform is designed to enhance Amazon seller success.
#PulseAd#Funding#AI#RetailMedia#Amazon#GlobalMarket#ECommerce#TechStartup#MediaPlatform#SellerSuccess#Investment#DigitalMarketing#TechFunding#SaaS#OnlineRetail#Advertising#InnovativeTech#GrowthFunding#BusinessExpansion
MRI Simulator Secures $3.5M
Corsmed has successfully raised $3.50M to enhance its MRI simulator, which provides an affordable, realistic training solution for students and technicians. This technology allows hands-on experience for just 1% of the cost of traditional MRI scanners, expanding training opportunities significantly.
#Corsmed#MRI#Simulator#Healthcare#Training#EdTech#Innovation#Financing#MedicalTraining#TechFunding#Startup#Students#Technicians#AffordableHealthcare#HandsOnTraining#SkillsDevelopment#Technology#Upskilling#AffordableTech#MedicalEducation