Skip to content

Mode Virtual (V) — Judging

2025.1 rubric summary

See Competition → Rules & Scoring for current 2025.1 weights and the optional Edge‑AI Bonus. This page retains 2024 reference tables for context.

Algorithm-agnostic

Credit is based on outcomes and evidence; architecture choice (PID/MPC/RL; rules/CNN/LLM) is not scored directly, provided constraints and safety are met.

Innovation Uplift

Judges may award top-of-band within categories for documented novel contributions (hardware, sensing, control, HF/UX, data tooling, compression/efficiency) that improve outcomes, safety, or clarity. This does not exceed category maxima.

Small multimodal LLMs encouraged

  • Expectation: focus your effort on generating/fine-tuning data and optimizing compact multimodal models.
  • Inference‑only, offline, JSON outputs (e.g., Explain‑This‑Event or Rig‑State Textualizer).
  • Small‑model, edge‑deployable focus: teams may prototype with larger cloud‑hosted models during development, but final deliverables and performance are evaluated using locally run or on‑rig small models under limited inference hardware.
  • Suggested caps: ≤2 vCPU or ≤20 W GPU, ≤4–8 GB RAM (non‑LLM) and ≤8 vCPU or ≤1,150 W GPU, ≤16–64 GB RAM (LLM); ≤15 min total inference runtime. Rig compute otherwise open. All AI runs must be offline during judging; no PLC/actuator writes.
  • Custom task option: teams may propose a custom offline JSON task with objective ground truth and the same interface for pre‑approval (recommended deadline: 2026‑02‑01). Approved tasks use the same AI sub‑rubric and scale to +10.

Scoring criteria are defined in the 2024 guidelines and differ slightly by challenge. Judges may award bonus points for “above and beyond” achievements.