Léo Nonnenmacher | Platform Engineer & MLOps / Trainer / Entrepreneur

Compiling an LLM on a Hailo 10H, a Bottomless Shithole

Tue, 11 Aug 2026 18:00:00 +0200

Reverse-engineering Hailo's Dataflow Compiler and genai runtime, trying to get any HuggingFace LLM running on a Hailo-10H — not just the official catalog.

Legal Notice

Tue, 11 Aug 2026 00:00:00 +0000

Site publisher

This site is published, in a personal, non-professional capacity, by:

Léo Nonnenmacher Based in Strasbourg, France Contact: leo@nonnenmacher-logel.fr

Publication director

Léo Nonnenmacher, same contact details as above.

Hosting

This site is hosted by GitHub Pages, a service provided by:

GitHub B.V. Prins Bernhardplein 200 1097 JB Amsterdam Netherlands

(European subsidiary of GitHub, Inc., 88 Colin P. Kelly Jr. St., San Francisco, CA 94107, USA) github.com

Intellectual property

All content on this site (text, images, code) is the property of Léo Nonnenmacher, unless explicitly stated otherwise. Reproduction without prior authorization is prohibited, except for material explicitly published under an open-source license (see the repositories at github.com/l-nmch).

Privacy Policy

Tue, 11 Aug 2026 00:00:00 +0000

Data controller

Léo Nonnenmacher — leo@nonnenmacher-logel.fr

This site uses no cookies

Not for analytics, not for anything else. No tracker is stored on your device when you browse this site.

Audience measurement (Umami)

This site uses Umami, an analytics tool designed not to track visitors individually:

No cookies, no persistent identifier stored on your device.
No personally identifiable data collected. Umami cannot recognize you from one visit to the next, or track you across different sites.
The only information collected is aggregated and anonymized: the page viewed, the referring site, the browser, the operating system, the device type, and an approximate country of origin (derived from the IP address, which is itself not stored).
This data is processed by Umami’s cloud service (Umami Software, cloud.umami.is), acting as a technical subprocessor for hosting these statistics.

Because no tracker is stored on your device and no data allows you to be identified, this analytics tool falls outside the prior-consent requirement that applies to cookies and trackers under French law (Article 82 of the French Data Protection Act, which transposes the ePrivacy Directive) — that requirement only applies to mechanisms that read from or write to information already stored on your device. That’s not the case here.

Automating DNS Record Creation with Kubernetes and Cloudflare

Mon, 30 Jun 2025 13:32:18 +0200

How to install and use external-dns to create DNS records automatically

An AI Setup Cheaper Than Mario Kart World?

Sun, 29 Jun 2025 19:26:04 +0200

How to build an AI setup for next to nothing, and whether it's actually worth it.

Automatically Updating a K3s Cluster with System Upgrade Controller

Fri, 27 Jun 2025 23:49:00 +0200

Automatic updates for your K3s cluster?

My First Project With an NPU (Hailo‑8L): From MNIST to Embedded Inference

Fri, 27 Jun 2025 22:03:04 +0200

A nightmare of figuring out what an NPU actually is, my hardware and software setup, and how I got my own MNIST model running on a Hailo‑8L.

About me

Fri, 27 Jun 2025 00:00:00 +0000

Where most people see a wall — dead hardware, an unsupported configuration — I’ve seen a challenge since I was eight. Eventually it became my entire career.

How I learned

I’ve never learned anything from a manual. I learn by taking things apart — an object, a problem, a system — until it breaks, and only then does it make sense. Slower than a tutorial, and objectively more destructive, but far more instructive as far as I’m concerned.