#python#deep_learning#inference#llm#nlp#pytorch#transformer
Nano-vLLM is a small, fast, and easy-to-understand tool for running large language models offline. It matches the speed of bigger systems like vLLM but uses only about 1,200 lines of clean Python code, making it simple to read and modify. It includes smart features like prefix caching and tensor parallelism to boost performance. You can install it easily and run models like Qwen3-0.6B on your own GPU. This tool is great if you want fast, efficient AI inference without complex setups, ideal for learning, research, or small deployments on limited hardware.
https://github.com/GeeeekExplorer/nano-vllm
Weekend
Let's begin,
Feet on feet
Following each other
Across the room,
Like a fleet
Unrequited and washed up
At shores
Unreachable and silent dead
Now pace up,
Reach my hand
Sigh
And burn
With violent fumes,
Find me a blink away
In carpeted elevators
Locked
In gaze
Finally,
Race me to the longest yard
At 3
Past midnight,
Rest on this hammock
Of tacit fears
And inhibitions,
Ask me
If I know myself,
I'll pause
And say
More each day
When I'm with you.
#review#poetry#ap
I've been thinking of life
And it was raining season
Life is worse than the hell
Why? Couldn't get reason
How and when will i get rid
From this unbearable pain
People can shouting loudly
I could not cry in the rain
#ap#review#shortpoem
Tanka : 57577
I'm alone at my place
Perhaps, someone will come here
A beautiful lady, and
Will take my hand in her hand
Maybe will say I'm with you.
#ap#review#tanka
Tanka : 57577
If I do any crime!
If I hurt you more before:
Will you forgive me?
Like you forgave me before;
I like you because of these.
#ap#tanka#review
I sniffed our wilted pink roses
When thy old letters, I dupp'd
Haue not rights to touch thou
To hug, To kiss thou forehead
#Ap#quatrain#review
Words : Old/Middle into Morden English
Thy - your
dupp'd -opened
Haue/Hast not - have not
Thou - you (subject)
• Quatrain •
The world can't see inside's pain
And, tears are hidden in the rain
Even if the world calls me stupid
But, Her voice affects like music
#ap#quatrain#review
#NATO
Jens #Stoltenberg (#Ap|S&D): “Onorato dalla decisione degli Stati NATO di estendere il mio mandato come Segretario Generale fino al 1° ottobre 2024. Il legame transatlantico tra Europa e Nord America ha garantito la nostra libertà e sicurezza per quasi 75 anni e, in un mondo più pericoloso, la nostra Alleanza è più importante che mai.”
@OsservatorioEsteri