mindcraft-ce
The open-source platform for crafting intelligent, collaborative agents in Minecraft using Large Language Models.
A New Era of AI in Minecraft
The Andy-4 Model Family
Powered by custom, open-source models fine-tuned for Minecraft. They enable complex reasoning and behavior, and you can run them locally for free.
Powerful Plugin System
Extend agent capabilities without modifying core code. Create custom actions, integrate new tools, and share your creations with the community.
Collaborative Agents
Test multi-agent coordination with the included MineCollab benchmark, featuring complex cooking, crafting, and construction tasks.
Advanced Voice Interaction
Engage with your agents using both Text-to-Speech (TTS) and Speech-to-Text (STT) for a fully immersive, hands-free experience.
Smarter Vision Modes
Fine-tune how your agent perceives its world with multiple vision modes (`off`, `prompted`, `always`) for any scenario.
Upgraded Pathfinding
Agents move more like human players. They can navigate doors, swim efficiently, and get themselves unstuck from tricky situations.
Meet the Andy-4 Model Family
A family of specialist AI models, each tuned for enhanced Minecraft gameplay and multimodal capabilities.
🧠 Andy-4
An 8B-parameter specialist model trained for advanced reasoning and robust in-game decision-making. Trained on a single RTX 3090 over three weeks.
- Parameters: 8 Billion
- Base Model: Llama-3.1-8B
- Tokens Trained: 42 Million
- Hardware: 1x NVIDIA RTX 3090
VRAM Requirements
F16 | 16 GB+ |
Q5_K_M | 8 GB+ |
Q4_K_M | 6-8 GB |
Q2_K | 4-6 GB |
🤏 Andy-4-micro
A lightweight 1.5B-parameter variant, optimized for responsive local inference and experimentation. Trained on a single RTX 3070 over four days.
- Parameters: 1.5 Billion
- Base Model: Qwen-2.5-1.5B
- Tokens Trained: 42 Million
- Hardware: 1x NVIDIA RTX 3070
VRAM Requirements
F16 | 6 GB |
Q5_K_M | 4 GB+ |
Q4_K_M | 4 GB |
Q3_K_M | ~1.5 GB |
Mindcraft vs. Community Edition
Mindcraft-CE builds on the original with active development and cutting-edge features.
Feature | mindcraft (Original) | mindcraft-ce (Community Edition) |
---|---|---|
Development Status | Inactive | Active |
Minecraft Version | Up to 1.21.1 | Up to 1.21.4 |
Default LLM | Generic `llama3.1` | `Andy-4` (Built for Minecraft) |
Voice Interaction | Basic TTS | Advanced TTS & Speech-to-Text (STT) |
Extensibility | None | Plugin System |
Pathfinding | Basic | Upgraded, human-like movement |
Get Started in Minutes
Download
Get the latest release from GitHub. You'll also need Minecraft: Java Edition, Node.js, and Git.
Download NowInstall Dependencies
Open your terminal in the project folder and run the installation command to fetch all required packages.
npm install
Configure & Run
Start a single-player world, open it to LAN, then run the main script to bring your agent to life!
node main.js