Најди сличен содржај

Изворен канал @pythonotes · Post #425 · 20 апр.

Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках. Выглядело это примерно так: from fastapi.concurrency import run_in_threadpool async def execute(data: DataRequest) -> DataResponse: try: result = await run_in_threadpool(sync_function, data) return DataResponse(data=result) except Exception as e: return DataResponse( error=str(e), success=False, ) В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо. Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров). Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio: import anyio @asynccontextmanager async def lifespan(app: FastAPI): limiter = anyio.to_thread.current_default_thread_limiter() limiter.total_tokens = 100 yield # если вдруг нужно вернуть обратно limiter.total_tokens = 40 Зачем менять количество воркеров? - уменьшить, если оперативки мало (один тред занимает ~8мб) - увеличить чтобы выдержать нагрузку Если есть предложения получше при тех же вводных - предлагайте😉 #async

Hashtags

#async

Резултати

Пронајдени 3 слични објави

Пребарај: #aiterminology

当前筛选 #aiterminology清除筛选

AI & Law

@ai_and_law · Post #786 · 17.03.2026 г., 08:04

Најди слично Погледај

🌐OECD Report Seeks Clear Terminology for AI Agents and Agentic AI The Organisation for Economic Co-operation and Development (OECD) has published a report examining the concepts of “AI agents” and “agentic AI” and the distinction between them. The report analyses how both terms are used in existing literature and evaluates their meaning through the lens of the OECD definition of an AI system. The study aims to establish more precise and consistent terminology around these concepts. By reviewing current academic and policy discussions, the report highlights differences in how the terms are applied and seeks to clarify their use in the context of AI governance and research. #AI#AIGovernance#AITerminology#AIRegulation#OECD

Hashtags

#ai #aigovernance #aiterminology #airegulation #oecd

AI & Law

@ai_and_law · Post #167 · 17.11.2023 г., 08:04

Најди слично Погледај

EU and U.S. Release 65 Key AI Terms: Seeking Public Input Hello, dear subscribers! The European Union and the United States have unveiled 65 key AI terms crucial for comprehending risk-based AI approaches. As part of the Fourth EU-US Trade and Technology Council held in May 2023, the EU and U.S. have released essential AI terminology and taxonomy. The initiative aims to foster a shared understanding of risk management in the realm of Artificial Intelligence. Now, they are inviting public input. Comments on the completeness, relevance, and correctness of these definitions are encouraged. #AInews#EUUSTradeTech#AIterminology

Hashtags

#ainews #euustradetech #aiterminology

AI & Law

@ai_and_law · Post #42 · 29.06.2023 г., 07:04

Најди слично Погледај

EU-US draft Terminology and Taxonomy for artificial intelligence released The Trade and Technology Council has published a significant document called the "Draft EU-US Terminology and Taxonomy for Artificial Intelligence." This publication marks a crucial milestone in establishing a common understanding of AI systems between the European Union and the United States. The identified terms in this draft reflect a shared understanding of the technical, socio-technical, and values-based aspects of AI. They are designed to lay the groundwork for future definitions and facilitate transatlantic collaboration on AI terminology and taxonomy. It's important to note that this list is preliminary and is expected to evolve further. In the coming months, experts and stakeholders will provide their input to expand and validate the terminology. This collaborative effort ensures a comprehensive and inclusive approach to defining AI concepts. #AITerminology#AITaxonomy#TransatlanticCooperation#AI#Law

Hashtags

#aiterminology #aitaxonomy #transatlanticcooperation #ai #law