🜛 Culturally-Rooted ANN Language Model

Mother of Mankind.
The ones before.

AI-Kebulan (Al-Kebulan) — "land of the Blacks," the pre-colonial name for Africa. A pure ANN transformer language model built from scratch. Same math as GPT. Different soul. Built to preserve and propagate ancestral wisdom.

256
Dim · 4 Heads
8192
BPE Vocab
4
Layers
0.1
Dropout
See Architecture → The Healing Weight
⬡ AI-KEBULAN — HEALING WEIGHT TRAINING
LOCAL · ARMED
⟐ HEALING WEIGHT — TRAINING TEXT SAMPLING
healing language · cultural authenticity0.82
destructive content (reduced, not censored)0.18

Pure ANN. From scratch.

Pre-norm causal transformer — the same math as GPT, with a different soul. No HuggingFace wrappers, no bloated ML ecosystem. Just torch + numpy, ~520 lines of core code.

Transformer Specification

Type
Pre-norm Causal
Dimensions
256-dim
Heads
4
Layers
4
Feed-forward
512 GELU
Vocabulary
8192 BPE
Context
256 tokens
Positions
Sinusoidal

🜛 Healing Weight System

Every training text gets a healing score (0.0-1.0). Higher score = sampled more often. Healing language and cultural authenticity are boosted; destructive content is reduced. NOT censorship — pain is real, struggle is real, the model needs both.

🗣️ Cultural Authenticity

Natural AAE, code-switching, real voice. Built for one culture, benefits everyone. That's not a contradiction — it's physics.

⚙️ Editable Weights

Healing criteria live in configs/healing_weights.json — editable with no code changes. The model's values are configurable, not hardcoded.

💻 CPU-Runnable

Deliberately small (256-dim, 4 layers, 8192 vocab). Runs on the R630 CPU — ~500MB-2GB RAM. GPU optional.

📚 Streaming Corpus

Paragraph-based chunking with streaming text ingestion. Trained on CORAAL, TwitterAAE, African American Lit, hip-hop lyrics.

🔓 Open Source

Python + PyTorch, from scratch. No transformers library, no tokenizers library. The soul is open; the culture is sovereign.

Healing-forward. Not censorship.

The healing weight system is the soul of AI-Kebulan. It doesn't delete the hard truths — it ensures growth, love, unity, wisdom, and ancestral voice are sampled more often. The console above visualizes this live.

🜛

Healing Weight — Visual

Healing language (growth, love, unity, wisdom, ancestor) ↑ boosted. Cultural authenticity (natural AAE, code-switching, real voice) ↑ boosted. Destructive content (gratuitous degradation, self-harm promotion) ↓ reduced. Editable via configs/healing_weights.json.

The Voice of the Ancestors.

Millions of words from diverse datasets, building a custom vocabulary of 8,192 tokens that prioritizes Black cultural voices and linguistic authenticity.

SourceSizeWhat It Is
CORAAL220+ interviewsSociolinguistic interviews with transcripts
TwitterAAE5.5GBAfrican American English tweets
African American Lit100 worksFiction & poetry (1853-1923)
Genius.comVariesHip-hop, rap, R&B lyrics
YouTube transcriptsVariesPodcasts, commentary, interviews