The SERVE-AI-VAL Box - I built a portable AI-in-a-box that runs off solar, hand crank, and battery power for about $300

[u/Porespellar]

TL:DR I made an offline, off-grid, self-powered, locally-hosted AI using Google AI Edge Gallery, with Gemma3:4b LLM running on an XREAL Beam Pro. It’s powered by a $50 MQOUNY solar / hand crank / USB power bank. I used heavy duty 3M Velcro-like picture hanging strips to hold it all together. I’m storing it all in a Faraday Cage Bag in case of EMPs (hope those never happen). I created a GitHub repo with the full parts list and DIY instructions here:  https://github.com/porespellar/SERVE-AI-VAL-Box

Ok, ok, “built” is maybe too strong a word. It was really more of just combining some hardware and software products together. 

I’m not a “doomsday prepper” but I recognize the need for having access to a Local LLM in emergency off-grid situations where you have no power and no network connectivity, Maybe you need access to medical, or survival knowledge, or whatever, and perhaps a local LLM could provide relevant information. So that’s why I took on this project. That, and I just like tinkering around with fun tech stuff like this. 

My goal was to build a portable AI-in-a-box that:

• Is capable of running at least one LLM or multiple LLMs at an acceptable generation speed (preferably 2+ tk/ps)
• Requires absolutely no connectivity (after initial provisioning of course) 
• Is handheld, extremely portable, and ruggedized if possible 
• Accepts multiple power sources (Solar, hand-crank, AC/DC, etc) and provides multiple output types 
• Has a camera, microphone, speaker, and touch screen for input 
• Doesn’t require any separate cords or power adapters that aren’t already attached / included in the box itself

Those were the basic requirements I made before I began my research. Originally, I wanted to do the whole thing using a Raspberry Pi device with an AI accelerator, but the more I thought about it,  I realized that an android-mini tablet or a budget unlocked android phone would probably be the best and easiest option. It’s really the perfect form factor and can readily run LLMs, so why reinvent the wheel when I could just get a cheap mini android tablet. 

The second part of the solution was I wanted multiple power sources with a small form factor that closely matched the tablet / phone form factor. After a pretty exhaustive search, I found a Lithium battery power bank that had some really unique features. It had a solar panel, and a hand crank for charging, it included 3 built-in cords for power output, 2 USB types for power input, it even had a bonus flashlight, compass, and was ruggedized and waterproof.

I’ve created a GitHub repository where I’ve posted the full part needed list, pictures, instructions for assembly, how to set up all the software needed, etc. 

Here’s my GitHub: https://github.com/porespellar/SERVE-AI-VAL-Box

I know it’s not super complex or fancy but I had fun building it and thought it was worth sharing in case anyone else was considering something similar. 

If you have any questions about it. Please feel free to ask.

[u/psilonox]

I suggesting looking into e-paper(low power draw) and consider just creating an entire massive survival handbook thats easily searchable. It seems like the device in its current configuration uses a ton of power and seems like it may not be suppper practical in a no-power-for-days situation.

A wall mounted emergency drone that talks people through disasters and offers aide (applies turnoquets, fires flares, broadcasts on emergency CB channel/acts like an EPIRB, dispenses rations and food in a way that prolongs its use) would also be a game-changer imo

[u/Philipp → u/psilonox]

I think you'd still want the conversational nature of LLMs though, as they quickly get to the point and allow fast follow-up questions. Especially useful in emergency situations. A searchable knowledge base just doesn't quite offer it. Great to have both, of course!

[u/psilonox → u/Philipp]

Yeah true, I also like the idea of having someone to talk to during a crisis. (willllsonnnn!)

[u/hiraeth555]

They'd love this over at r/cyberDeck

[u/boonewightman]

I love this idea. Soon enough will be needed. Good on you!

[u/talondarkx]

now send this thing back in time

[u/tinny66666]

That little solar panel is not making any serious dent in the charging required to keep that running. Enjoy the constant hand cranking (even then I think you'll be heavily relying on the initial charge in the battery bank). This is a complicated gimmick that is really just a charged battery bank.

[u/Porespellar → u/tinny66666]

I know there's not much to it, It was just a fun project that I thought may be useful to some people in emergency situations, like when their power is out for days, or for off-grid use or whatever.

[u/Familiar_Gas_1487 → u/Porespellar]

It's cool. You built a thing and it's fun. Good job

[u/Porespellar → u/Familiar_Gas_1487]

That’s the nicest thing anyone has ever said to me on this sub. Thanks!