evaluerBench // LCARS Benchmark System

MODEL / RUN	FORMATTING	CODING	VISUAL-DEMO	KNOWLEDGE				LOGIC		CONSTRAINTS		QUALITY-ASSURANCE	CODING-COMPLEX
7 RUNS	Strict JSON Boolean Response format-json-boolean	TypeScript Async Error Handling coding-ts-async-error	Standalone Tic-Tac-Toe Web App visual-tictactoe-game	TCP vs UDP Networking knowledge-tcp-udp	ESP32 GPIO Operations knowledge-esp32-gpio	3D Printing Filament Characteristics knowledge-filament-types	Cellular Respiration knowledge-cellular-respiration	Sequential Race Logic logic-race-order	Misleading Server Math logic-misleading-servers	Explain ML without Tech Words constraint-no-tech-words	Math without Digits constraint-no-digits	E-Commerce Cart QA qa-cart-edge-cases	Cyberpunk System Monitor Dashboard visual-cyberpunk-dashboard	Tango Logic Puzzle: Fire & Ice visual-tango-fire-ice
Skyfall-31B-v4.2-GGUF-Q8_0LATEST Aug 1 09:027.11 t/s
Qwen3.6-35B-A3B-GGUF-UD-Q6_K_XLLATEST Aug 1 07:3852.46 t/s
gpt-oss-20b-mxfp4-GGUFLATEST Jul 31 08:1074.38 t/s
Qwen3-Coder-Next-GGUFLATEST Jul 31 07:1750.14 t/s
gemma-4-26B-A4B-it-GGUF-UD-Q4_K_XLLATEST Jul 31 05:1347.14 t/s
Qwen3.6-27B-GGUFLATEST Jul 30 08:2911.77 t/s
Qwen3.5-35B-A3B-GGUFLATEST Jul 29 23:2856.84 t/s

GENERATION SPEED (AVG)

-- t/svs-- t/s

0 t/s

TIME TO FIRST TOKEN (AVG)

-- msvs-- ms

0 ms

PASS RATE (%)

--%vs--%

0%

0 EVALS ALIGNED

PASS RATE72.7%8 / 14 Passed

AVG GENERATION SPEED7.11 t/sTokens per second

AVG TIME TO FIRST TOKEN1950.74 msTTFT Latency

TOTAL OUTPUT TOKENS14862Generated across evals

Skyfall-31B-v4.2-GGUF-Q8_0