Skip to content
lyffsebaPublic

About

No description, website, or topics provided.

Resources

Stars

1 star

Watchers

0 watching

Forks

Latest commit

 

History

3 Commits

Folders and files

Repository files navigation

🧠 Arton: The Dual-Path AI Curriculum

Welcome to Arton. This project is the ultimate bridge between ML engineering and complete beginners. We are attacking the AI black box from both sides: building it from absolute scratch to understand the math, and using the fastest enterprise tools on the market to understand production.

🛤️ The Two Paths

🔬 Path 1: atomic_gpt/ (The Math & The Bare Metal)

We are building a Generative Pre-trained Transformer (GPT) model from absolute scratch.

  • Zero Deep Learning Dependencies. No PyTorch, no TensorFlow.
  • Pure Mojo. We get Python's readability but C/Rust's speed.
  • Understand Everything. We build the Autograd Engine, the Multi-Head Attention mechanism, and the Training Loop out in the open.

🚀 Path 2: production_max/ (The Market Standard & Extreme Speed)

Once you understand how the atomic model works, you need to know how the enterprise world deploys state-of-the-art models like Gemma 4.

  • Modular MAX Engine. We use the Modular Accelerated Xecution (MAX) engine—the fastest inference engine on the market.
  • Hardware Harmonization. Learn how MAX compiles models to run flawlessly across NVIDIA GPUs, AMD GPUs, and Apple Silicon without rewriting code.

📖 The Curriculum

1. The Workbench

Test the workbench by running: pixi run mojo hello_world.mojo

2. The Data & The Tokenizer (Atomic Path)

Computers don't read English; they read numbers. We use prepare_data.mojo to download our dataset (Tiny Shakespeare, 1MB). Then we build a Tokenizer (a secret decoder ring) to translate letters into numbers.

Get the book by running: pixi run mojo atomic_gpt/prepare_data.mojo See the Tokenizer: pixi run mojo atomic_gpt/tokenizer.mojo

3. Deploying Gemma with MAX (Production Path)

While we build the atomic model, we will simultaneously look at how Modular's MAX engine handles a massive Google model like Gemma.

See the deployment script: pixi run python production_max/run_gemma.py

(More phases coming soon...)

About

No description, website, or topics provided.

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages