Недавно делал быстрый прототип асинхронного приложения в котором требовалось вызывать много синхронного кода. Да, я знаю, что это не лучший дизайн, но нужно было быстрое решение на один процесс и без очередей. Поэтому я выполнял код в потоках.
Выглядело это примерно так:
from fastapi.concurrency import run_in_threadpool
async def execute(data: DataRequest) -> DataResponse:
try:
result = await run_in_threadpool(sync_function, data)
return DataResponse(data=result)
except Exception as e:
return DataResponse(
error=str(e),
success=False,
)
В общем работает нормально. Для всех вызовов под капотом используется общий тредпул, всё работает предсказуемо.
Но потребовалось изменить количество запускаемых в пуле потоков (по умолчанию создается 40 воркеров).
Так как дело происходит с FastAPI, делается это через lifespan используя настройки anyio:
import anyio
@asynccontextmanager
async def lifespan(app: FastAPI):
limiter = anyio.to_thread.current_default_thread_limiter()
limiter.total_tokens = 100
yield
# если вдруг нужно вернуть обратно
limiter.total_tokens = 40
Зачем менять количество воркеров?
- уменьшить, если оперативки мало (один тред занимает ~8мб)
- увеличить чтобы выдержать нагрузку
Если есть предложения получше при тех же вводных - предлагайте😉
#async
Operation Paperclip was a secret U.S. program after World War II. It brought over 1,500 German and Austrian scientists to the United States. Many had been members of the Nazi Party. They worked on military, aeronautics, and space research. Their Nazi pasts were ignored so the U.S. could use their expertise and keep it from the Soviet Union.
🇺🇸🧑🔬🚀
[Read more]
@googlefactss
#OperationPaperclip#HistoryFacts#ColdWar#Science#NASA
GERMANY IS A NAIVE PAWN OF THE USA WITH SEEMINGLY NO POWER TO SAVE ITSELF.
The #USA has failed against #Russia:
• It has missed its military target and this failure is damaging America’s prestige as the greatest military power.
• The #sanctions war against Russia are a complete failure. The West is weakened while Russia strengthens. The #IMF figures speak volumes: Germany doesn’t even make the list.
“The primary interest of the United States through the last century-that is, #WW1, #WW2, and the #ColdWar, has been the relationship between Germany and Russia.
If united, those two would be the only power that could threaten us-and so we have to make sure that doesn’t happen.”
George Friedman
The aim is therefore to prevent Germany from teaming up with Russia.
If it is not possible to weaken Russia as a major opponent, there is the option of preventing the alliance by turning #Germany and Russia into enemies and/or destroying Germany (for the third time after 1918 and 1945)
Operation Osoaviakhim was a secret Soviet program after World War II. Over 2,500 German scientists, engineers, and technicians and their families were taken from the Soviet zone of Germany to the USSR.
They worked on Soviet military, weapons, and rocket technology. The goal was to use German expertise to strengthen the USSR and keep it from falling into Western hands.
Basically the Soviet version of operation Paperclip📎
🇷🇺🔬🚀
[Read more]
@googlefactss
#OperationOsoaviakhim#ColdWar#HistoryFacts#WWII#SovietUnion#Science#operationpaperclip
Project MK‑ULTRA was a secret CIA program during the Cold War. It ran from 1953 to 1964. The CIA tested mind control using LSD, hypnosis, electroshock, and sensory deprivation. Some experiments gave drugs to people without their knowledge, isolated subjects for long periods, or exposed them to extreme stress. Under Dulles, the CIA opened secret prisons in West Germany and Japan, advised by Walter Schreiber, former Surgeon General of the Nazi army. Schreiber had avoided imprisonment after World War II and was brought to the West by U.S. intelligence, likely as part of programs like Operation Paperclip. Most records of MK‑ULTRA were destroyed in 1973, but investigations later revealed the program.
🧠🔬🇺🇸
[Read more]
@googlefactss
#MKULTRA#CIA#HistoryFacts#Science#ColdWar#MindControl#notAtheory