A Rust-Python thing I am working on. Apache 2 licence

· systems design coding · Source ↗

TLDR

  • Nairobi OS is a Linux-only distributed data science runtime using Rust (io_uring, Huge Pages, D-Bus) with a fluent Python API.

Key Takeaways

  • Core is the Axum Refinery daemon using io_uring with SQPOLL and 1GB Huge Pages for zero-copy ingestion and sub-millisecond IPC.
  • D-Bus and memfd shared memory connect the Rust core to Nairobi Hub, Lagos Vision (wgpu/egui GPU renderer), and the Python bridge.
  • Python API wraps the full stack behind nairobi_os.connect() and SovereignFrame, hiding IPC and memory management complexity.
  • Requires Linux or WSL2 with kernel 5.10+; SQPOLL needs CAP_SYS_ADMIN or a permissive kernel config.
  • Apache 2.0 licensed; built with Maturin/PyO3, Polars, Rayon, zbus, and iceoryx2.

Hacker News Comment Review

  • The “OS” naming is seen as misleading; the project is a Rust/Python data processing library, not a kernel or operating system in any conventional sense.

Original | Discuss on HN