← All projects

Reference solution, sample data

Shop-floor digital twin with an AI agent

A 3D production hall where an AI agent answers questions about the state of production and shows the answer on the model: it highlights the machine and moves the camera.

  • manufacturing
  • Three.js
  • AI agent

Problem

Information about the state of production is scattered: orders in the ERP, downtime in the maintenance log, quality inspection results in separate spreadsheets. Answering “why is line 2 stopped and which orders are at risk” means looking in several places.

Reports and dashboards show numbers, but rarely show where on the floor the problem is.

Solution

A 3D model of the hall with lines and machines that display their status. Next to it, a conversation with an AI agent that uses tools to answer: queries about orders, downtime and quality inspection results. Every answer also has an action in the scene, so you can see which machine it is about.

  • the agent uses only the data exposed through its tools, not general knowledge
  • a text answer plus an action in the scene: machine highlight, camera move
  • sample data: a fictional company, orders, downtime and quality inspection results
  • a recorded mode at no cost and a live mode with an API key, run locally

Try it

The application loads here as you scroll and needs JavaScript. You can also open it in a separate tab.

Questions about the hall. A few recorded scenarios, e.g. a question about downtime on a line and about orders at risk of delay. Recorded run: the application replays saved answers on sample data and makes no API calls.

Open the application in a new tab (opens in a new tab)

Stack

  • TypeScript
  • Three.js
  • Vite
  • Claude API (tool use)
  • Vitest

Repository

The repository is private for now; the code is available on request.

A similar problem on your side?

Tell us about it in a few clicks. You do not need a finished specification.

Tell us what you dream of

We usually reply within one business day. Prefer e-mail? Write to joanna@kokot.it.