What if real AI at the edge didn’t drain your battery, overheat your device, or bloat your bill of materials? We pull back the curtain on EMASS, our edge AI system-on-chip built from the ground up to squeeze maximum intelligence out of milliwatts, not watts. The journey starts “from atoms to apps,” where device physics, circuits, architecture, and algorithms are tuned together—so every layer contributes to performance instead of fighting it.

We walk through the architecture: a RISC-V core that manages dataflow and OS tasks, plus two specialized AI accelerators that the compiler selects automatically based on workload. With SRAM and non-volatile memory on board, the chip preserves system state, then powers down aggressively and wakes in microseconds. Add model quantization, pruning, knowledge distillation, and coding, and you can shrink networks by up to 100x; a hardware weight decompressor restores precision just in time, preserving accuracy while slashing memory and bandwidth.

Performance isn’t just on paper. Fabricated at 22 nm and moving to 16 nm, XDOT hits up to 12 TOPS/W and around 30 GOPS at roughly 2 mW. Against public edge benchmarks, we match or beat latency while cutting energy by 20x to 200x. Developers can compile from TensorFlow or PyTorch and even remote-run on our boards—hosted in Singapore—so you see real hardware results from anywhere. Partnerships with Literal Labs yield dramatic speed and energy gains, while our Arrow Electronics modular boards let you stack sensors for predictive maintenance, biometrics, cold-chain tracking, storage, and wireless in minutes.

The standout use case: drones. Instead of piling on compute-heavy features, we target the battery subsystem with AI-driven control, extending flight endurance by up to 60% and, in some trials, even higher. That means longer missions on the same charge or more payload without sacrificing airtime. It’s a taste of what becomes possible when the entire stack is co-designed—wearables that last, IoT nodes that think locally, AR devices that stay cool, and fleets that fly farther.

If you’re building edge AI and want real results on real silicon, subscribe, share this episode with a teammate, and leave a review. Ready to test your model on hardware today? Reach out and try the remote run.

Send us Fan Mail

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

The fastest AI you’ll use today might already be in your pocket. We dive into how modern smartphones ship with dedicated MPUs that outperform CPUs and GPUs for inference while slashing power use, unlocking private, real‑time AI without a GPU cloud bill. Our roadmap shows how to turn that potential into products: optimize your model, compile for each vendor target, benchmark on 200+ devices, then drop in a generated runtime for iOS, Android, or mobile Linux.

We walk through a developer‑first workflow that starts with a simple upload and ends with a copy‑paste app. Scan a QR code to run your model on your phone and see real latency, accuracy, and power. Meanwhile, automated harnesses test across Apple, Qualcomm, and MediaTek devices to produce a credible performance report. For language models and agents, we compare quantization options like Q2, Q4, and Q8, measure tokens per second, and surface trade‑offs between footprint and quality so you can pick a configuration that feels instant, not sluggish.

Beyond the how, we explore why on‑device AI changes the game: zero recurring cloud compute, lower maintenance overhead, and stronger user trust through data locality. Real‑world applications include medical imaging in the operating room, offline audio features, and rugged field tools that work in tunnels, aircraft, or rural areas with poor connectivity. We also address vendor fragmentation and share how a unified SDK bridges iOS and Android, with Flutter and React Native support on the way. If you care about speed, privacy, and cost, this is your blueprint for running AI at the edge—reliably and at scale.

Subscribe for new deep dives, share this with a teammate wrestling with GPU bills, and leave a review to tell us which device you want benchmarked next.

Send us Fan Mail

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org

What if the next great leap in AI isn’t bigger models in bigger clouds, but millions of small, smart systems making decisions where the data is born?

Guy Tamir of Intel connects the dots from steam and electricity to today’s language-driven AI, then map the pattern that keeps repeating: parallelism, mobility, autonomy, and finally distributed swarms. Once machines learned our language with tokenization, embeddings, and attention, text unlocked human knowledge—and capability exploded so quickly that benchmarks now show models outscoring average humans on IQ-like tests. The shocking part isn’t just that they’re smart; it’s how fast it happened.

We break down why the future belongs to Edge AI. Factories don’t need round trips to the cloud to reject a faulty part. City cameras can detect crashes, alert responders, and create a green wave for ambulances in real time. Laptops can run personal copilots tuned to your style and goals, drawing on your emails and documents without exposing everything to a data center. That shift demands hardware built for tight power and heat budgets—heterogeneous chips mixing CPUs for control, GPUs for vision, NPUs for efficient inference, and media accelerators. On the software side, we cut through complexity with the open-edge platform: OpenVINO for cross-accelerator inference, Deep Learning Streamer for video pipelines, Scenescape for multi-camera 3D understanding, and Getty for fast, GUI-driven dataset creation and custom training.

Looking ahead, we outline four trends: models get smaller and more targeted, retrieval replaces stale memorization with live knowledge, continual fine-tuning adapts systems to local contexts, and cognition becomes personal and explanatory. Think a tutor that teaches the way you learn, or a car that becomes safer each night as it absorbs local edge data. Autonomy will grow, but trust must catch up through reliability, guardrails, and transparency before agents get the keys to your finances or schedule. If you’re building for the real world, this is your roadmap to put intelligence where it matters most.

If this conversation sparks ideas, follow and share it with a teammate who’s wrestling with edge deployments. Subscribe for more deep dives, and leave a review telling us your top edge use case—you’ll shape what we explore next.

Send us Fan Mail

Support the show

Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org