mindcraft-ce

The open-source platform for crafting intelligent, collaborative agents in Minecraft using Large Language Models.

A New Era of AI in Minecraft

The Andy-4 Model Family

Powered by custom, open-source models fine-tuned for Minecraft. They enable complex reasoning and behavior, and you can run them locally for free.

Powerful Plugin System

Extend agent capabilities without modifying core code. Create custom actions, integrate new tools, and share your creations with the community.

Collaborative Agents

Test multi-agent coordination with the included MineCollab benchmark, featuring complex cooking, crafting, and construction tasks.

Advanced Voice Interaction

Engage with your agents using both Text-to-Speech (TTS) and Speech-to-Text (STT) for a fully immersive, hands-free experience.

Smarter Vision Modes

Fine-tune how your agent perceives its world with multiple vision modes (`off`, `prompted`, `always`) for any scenario.

Upgraded Pathfinding

Agents move more like human players. They can navigate doors, swim efficiently, and get themselves unstuck from tricky situations.

Meet the Andy-4 Model Family

A family of specialist AI models, each tuned for enhanced Minecraft gameplay and multimodal capabilities.

🧠 Andy-4

An 8B-parameter specialist model trained for advanced reasoning and robust in-game decision-making. Trained on a single RTX 3090 over three weeks.

  • Parameters: 8 Billion
  • Base Model: Llama-3.1-8B
  • Tokens Trained: 42 Million
  • Hardware: 1x NVIDIA RTX 3090

VRAM Requirements

F1616 GB+
Q5_K_M8 GB+
Q4_K_M6-8 GB
Q2_K4-6 GB

🤏 Andy-4-micro

A lightweight 1.5B-parameter variant, optimized for responsive local inference and experimentation. Trained on a single RTX 3070 over four days.

  • Parameters: 1.5 Billion
  • Base Model: Qwen-2.5-1.5B
  • Tokens Trained: 42 Million
  • Hardware: 1x NVIDIA RTX 3070

VRAM Requirements

F166 GB
Q5_K_M4 GB+
Q4_K_M4 GB
Q3_K_M~1.5 GB

Mindcraft vs. Community Edition

Mindcraft-CE builds on the original with active development and cutting-edge features.

Feature mindcraft (Original) mindcraft-ce (Community Edition)
Development Status Inactive Active
Minecraft Version Up to 1.21.1 Up to 1.21.4
Default LLM Generic `llama3.1` `Andy-4` (Built for Minecraft)
Voice Interaction Basic TTS Advanced TTS & Speech-to-Text (STT)
Extensibility None Plugin System
Pathfinding Basic Upgraded, human-like movement

Get Started in Minutes

1

Download

Get the latest release from GitHub. You'll also need Minecraft: Java Edition, Node.js, and Git.

Download Now
2

Install Dependencies

Open your terminal in the project folder and run the installation command to fetch all required packages.

npm install
3

Configure & Run

Start a single-player world, open it to LAN, then run the main script to bring your agent to life!

node main.js