XavierFok
← all posts

Modern AI on a seven year old GPU: what still works

2026-08-15 · by Xavier Fok

# Modern AI on a seven year old GPU: what still works

The graphics card that does my AI work every day is a GTX 1080 Ti. It is roughly seven years old, bought for gaming long before I cared about any of this, and never replaced. Every upgrade video says a card like this is obsolete. My daily schedule says otherwise, and I want to lay out both sides honestly: what the old card genuinely still does, where it clearly falls down, and the small set of habits that separate the two.

A lot of people stay frozen on the sidelines because they have convinced themselves they need to spend a fortune before they can even begin. That is a shame, because the entry bar sits far lower than the hype suggests, and hardware the internet has written off as obsolete can still ship real work.

How I ended up here

No clever plan. I bought the card for games, drifted into AI work, and every time an upgrade tempted me, the new cards were sold out or wildly overpriced or both. So I kept waiting. The longer I waited, the more the old card quietly handled without complaint, and the upgrade I kept almost buying turned out to be the answer to a problem I had not run into yet.

That is the theme of everything below. A newer card is faster, obviously. The question that actually matters is whether the card already in your machine is good enough for the specific jobs you run, and for a surprising number of jobs, an old card is plenty.

What it still does well

Video encoding first. The card carries a dedicated encoding chip for turning raw frames into finished video files, and that little block has barely aged. Every video I publish gets its final encode on this card, quickly and cleanly, with no real effort from me.

Local image generation second. I generate images on this card all the time. It is nowhere near instant, and it is completely usable in practice: I queue a batch, walk away, and come back to a folder full of results.

Smaller language models third. Chat sized models that fit comfortably in the card's memory run perfectly well for summarising, for drafting, for classifying, and for answering everyday questions.

And batch work, the category everyone forgets. Anything I can line up and run overnight does not care how old the card is. The queue grinds while I sleep, and hardware age becomes irrelevant.

Those four cover most of what I actually do in a week. Encoding, images, everyday language work and big patient batches are the core of the job for me rather than edge cases. Meanwhile the demos that sell new hardware are nearly always showing the one thing my card is worst at, fast interactive work, and that single category does a lot of lifting to make old cards look useless when they are still very usable.

Where it clearly falls down

The honest limits, because this card is no secret monster.

The truly large language models are out. The biggest, smartest open models simply do not fit in this card's memory, full stop, and no trick changes that wall.

The second limit is subtler. Newer cards run a fast, compact number format in hardware, and AI models love it: quicker math, more model per gigabyte of memory. My card lacks that path entirely, so a big slice of the speedups newer cards get for free never arrives here.

The third limit is raw speed. A job a new card finishes in seconds often takes my card minutes. The result comes out identical, just later. If your work depends on rapid back and forth, that gap will frustrate you daily, and I would be lying to pretend otherwise.

And a quieter fourth: power and heat. An old card draws a fair amount of electricity and runs warm, so long jobs show up in the room's temperature and a little on the bill. A newer card often does the same work on less energy. None of this is dramatic, and all of it is real. Together these limits mark out the shape of work this card is wrong for, and knowing that shape ahead of time saves a lot of wasted frustration.

The tricks that make it work

Nothing fancy here, just four moves.

I load models in compressed eight bit form. Far less memory, faster runs, and quality close enough for most everyday tasks. That one choice fits models onto the card that otherwise would never load.

I right size instead of maxing out. A model that sits comfortably in memory with headroom beats a bigger one crammed in to the last megabyte, on speed and on stability both. Fits and runs calmly wins over technically loads and crawls.

When a model is slightly too big anyway, I offload. Part of it stays on the card while the rest sits in ordinary system memory. It runs slower that way, and slower but working beats faster but crashing every single time.

And I lean on the dedicated encoder chip for all video work, so the main part of the card stays free for the AI jobs that genuinely need it.

What the speed actually feels like

Numbers without feel mislead, so here is the feel. An image costs a short wait each, a long way from the instant results in the slickest demos. A chat sized model produces words at a steady, readable pace, slower than the fast cloud services and completely fine for thinking and drafting. Real batch jobs live firmly in minutes, sometimes a lot of minutes.

For batch work, that almost never matters. A job kicked off before bed is done when I wake up, and I honestly could not tell you whether last night's run took twenty minutes or two hours, because nobody was waiting on it. Wall clock time is irrelevant when no one is watching the clock. Speed only stings when I am sitting there waiting on a single result, so I design the workflow to make sure I rarely am. Patient work goes to the old card. Impatient work goes to the cloud on the days it truly has to.

Match the job to the card

Seen that way, most of the frustration evaporates. A slow card is only slow when you insist on using it for the one thing it does worst, which is interactive work where a person sits and waits. So I stopped asking it to do that. Everything patient, repeatable and schedulable lands on the old card, where speed genuinely does not matter, and suddenly the hardware feels far more capable than its age suggests.

The card never got faster. I got better at assigning it work, and that mindset shift was worth more than any single setting I have ever changed.

What I would buy today

Starting fresh right now, I would probably skip a card like mine, since I arrived here by accident rather than by choosing it against today's options. Buying with real money, I would look hardest at memory per dollar, because memory is the wall you hit first in AI work, well before raw speed. I would also prefer a card with that fast compact number format built in, since that one feature opens up models and speed my card cannot touch. No specific model names or prices from me: those change constantly, and buying advice is a business I stay out of.

The reasoning behind memory first is blunt. A model that does not fit runs at no speed at all. A model that fits and runs slowly still runs. The expensive mistake I keep seeing is paying for raw speed that rarely gets used while skimping on the memory that decides what can be loaded in the first place. Get the ordering right, memory then format support then speed, and a card stays useful for years.

When the old card is the smart move

If you already own one, the smartest possible move is running it hard before spending anything new. Find out what it can and cannot do against your real workload instead of guessing from a spec sheet. You may find, like I did, that it covers far more than expected and the upgrade can wait a long while. On a tight budget, a capable older card from the used market makes a sensible entry point too, provided you accept the limits above and expect no miracles from the very largest models.

The worst move is the common one: a perfectly good card sitting idle while its owner saves for the perfect one. A card you actually use beats a better card you are still waiting to afford.

The verdict after years of this

A seven year old GPU is no toy and no miracle. It is a genuinely capable workhorse for video encoding, for local image generation, for smaller language models and for any patient batch job you can put on a schedule. It is the wrong tool for the largest models and for interactive work where seconds count, and pretending otherwise helps nobody.

The lesson that outlives the specific card is bigger. New hardware is an optimisation you reach for once you understand what you actually need, and most people reach for it years too early. The card already in your machine is almost certainly more capable than the upgrade thumbnails want you to believe. Use the thing you have. Push it until it genuinely breaks for your real work, and let that moment be the trigger to spend, instead of a feeling you got from a thumbnail.

Get new guides and videos first — join the Telegram channel.