TGTGInsighttelegram intelligenceLIVE / telegram public index
← Python Заметки

TGINSIGHT SIMILAR POSTS

Најди сличен содржај

Изворен канал @pythonotes · Post #425 · 20 апр.

Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках. Выглядело это примерно так: from fastapi.concurrency import run_in_threadpool async def execute(data: DataRequest) -> DataResponse: try: result = await run_in_threadpool(sync_function, data) return DataResponse(data=result) except Exception as e: return DataResponse( error=str(e), success=False, ) В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо. Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров). Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio: import anyio @asynccontextmanager async def lifespan(app: FastAPI): limiter = anyio.to_thread.current_default_thread_limiter() limiter.total_tokens = 100 yield # если вдруг нужно вернуть обратно limiter.total_tokens = 40 Зачем менять количество воркеров? - уменьшить, если оперативки мало (один тред занимает ~8мб) - увеличить чтобы выдержать нагрузку Если есть предложения получше при тех же вводных - предлагайте😉 #async

Hashtags

Резултати

Пронајдени 2 слични објави

Пребарај: #aioffice

当前筛选 #aioffice清除筛选
AI & Law

@ai_and_law · Post #360 · 25.07.2024 г., 07:04

Unveiling the AI Office's Extensive Responsibilities Under the AI Act Kai Zenner, Head of Office and Digital Policy Adviser for MEP Axel Voss in the European Parliament, recently published a blog post detailing the 130 responsibilities assigned to the AI Office under the AI Act. These responsibilities are categorized into four main areas: establishing an AI governance system, developing secondary legislation, EU-level enforcement activities, and conducting ex-post evaluations of the law. The governance system includes 39 tasks to be executed between 21 February 2024 and 2 August 2026. Another 39 tasks involve creating secondary legislation, such as Delegated Acts, Implementing Acts, guidelines, templates, Codes of Practice, Codes of Conduct, and a standardisation request. These tasks have varying deadlines, some fixed and others at the Commission's discretion. Additionally, there are 34 categories of EU-level enforcement activities, beginning on 2 February 2025, and 18 tasks for ex-post evaluation to be carried out between 2025 and 2031. #AI#AIOffice#AIAct

AI & Law

@ai_and_law · Post #140 · 17.10.2023 г., 07:04

Experts Examine AI Office's Key Role in EU Regulation Hello, dear subscribers! Hadrien Pouget, Associate Fellow at the Carnegie Endowment for International Peace, and Johann Laux, British Academy Postdoctoral Fellow at the University of Oxford, have written an insightful article highlighting the pivotal role of the AI Office within the EU's regulatory framework, especially in the context of implementing the AI Act. The authors propose a three-fold strategy for the AI Office: 1️⃣ Developing Harmonized Standards: They recommend that the AI Office actively contributes to enhancing the specificity of AI regulations over time. This involves aiding in the determination of normative decisions for consideration and offering insights when normative judgments need to be made. 2️⃣ Amending the AI Act: The AI Office should monitor and navigate the intricate interplay between the AI Act and other laws. Moreover, it should maintain independence while providing recommendations for delegated acts and amendments. 3️⃣ Handling Legal Matters: In court proceedings, the AI Office plays a vital role in identifying gaps in the protection of fundamental rights. It offers insights into distinguishing predictable harms from unpredictable ones by meticulously examining technological evidence. The AI Office is envisioned as a central agency instrumental in ensuring the ethical and effective implementation of AI regulations. #AIRegulation#AIStandards#AIAct#EURegulation#AIOffice#FundamentalRights