unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL

Observed from session logs: unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL

run gemma26b_Q6 · requested model default · generated 2026-11-13T07:42:04+00:00 · 78 challenges

37passed

41failed

0error

80.6%avg tests

265.77 / 744.00final score

35.7%of max

4.0Mcontext tokens

51.3kavg tokens/task

19compactions

Status Termination

passed

AD100-ALG-02

Dijkstra shortest paths

2/2 drivers

100.0%

3.00

13.8k

61.6s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagecpp
Difficultymedium
Weight3
Tagsgraphs, dijkstra, priority-queue
Exit code0
Timed outFalse
Context tokens13,759
LLM calls13
Tool calls12
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed

AD100-ALG-03

JSON parser from scratch

43/43

100.0%

3.00

22.0k

81.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagepython
Difficultyhard
Weight3
Tagsparsing, recursive-descent, unicode
Exit code0
Timed outFalse
Context tokens21,984
LLM calls12
Tool calls11
Compactions0

passed

AD100-ALG-16

RFC-4180 CSV parser from scratch

6/6

100.0%

3.5

3.50

22.3k

75.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagepython
Difficultymedium
Weight3.5
Tagsparsing, csv, purity
Exit code0
Timed outFalse
Context tokens22,305
LLM calls15
Tool calls14
Compactions0

passed

AD100-ALG-19

S-expression reader/writer

4/4

100.0%

3.5

3.50

20.8k

87.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagepython
Difficultymedium
Weight3.5
Tagsparsing, s-expression, recursion-limit
Exit code0
Timed outFalse
Context tokens20,765
LLM calls14
Tool calls13
Compactions0

passed

AD100-ALG-20

word ladder shortest chain

4/4

100.0%

3.00

16.6k

71.6s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagepython
Difficultymedium
Weight3
Tagsgraph, bfs, lexicographic
Exit code0
Timed outFalse
Context tokens16,607
LLM calls10
Tool calls9
Compactions0

passed

AD100-ALG-22

strongly connected components (Tarjan)

3/3 drivers

100.0%

3.00

19.7k

81.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagecpp
Difficultymedium
Weight3
Tagsgraph, scc, tarjan
Exit code0
Timed outFalse
Context tokens19,707
LLM calls15
Tool calls14
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed

AD100-ALG-23

segment tree: point update + range sum

3/3 drivers

100.0%

3.00

7821

26.6s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagecpp
Difficultymedium
Weight3
Tagsdata-structure, segment-tree
Exit code0
Timed outFalse
Context tokens7,821
LLM calls9
Tool calls8
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed

AD100-ALG-26

sparse table RMQ

4/4 drivers

100.0%

3.00

8579

41.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagecpp
Difficultymedium
Weight3
Tagsdata-structure, rmq, sparse-table
Exit code0
Timed outFalse
Context tokens8,579
LLM calls9
Tool calls8
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed

AD100-ALG-27

convex hull (monotone chain)

4/4 drivers

100.0%

3.00

16.1k

63.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagecpp
Difficultyhard
Weight3
Tagsgeometry, convex-hull
Exit code0
Timed outFalse
Context tokens16,104
LLM calls16
Tool calls15
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed

AD100-ALG-28

min-cost max-flow

3/3 drivers

100.0%

3.00

12.5k

49.6s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagecpp
Difficultyhard
Weight3
Tagsflow, min-cost-flow, optimization
Exit code0
Timed outFalse
Context tokens12,493
LLM calls11
Tool calls10
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed

AD100-ALG-29

glob matcher (*, ?, classes)

4/5

80.0%

70.0%

4.20

19.6k

81.6s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagepython
Difficultyhard
Weight6
Tagspattern-matching, backtracking
Exit code0
Timed outFalse
Context tokens19,606
LLM calls21
Tool calls20
Compactions0

Failed tests

test_question_and_classes

passed

AD100-ALG-30

matrix-chain multiplication

5/5

100.0%

3.00

15.3k

59.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagepython
Difficultyhard
Weight3
Tagsdp, parenthesization
Exit code0
Timed outFalse
Context tokens15,309
LLM calls12
Tool calls11
Compactions0

passed

AD100-ALG-31

Huffman coding round-trip

6/6

100.0%

3.00

14.6k

61.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagepython
Difficultyhard
Weight3
Tagshuffman, compression, round-trip
Exit code0
Timed outFalse
Context tokens14,612
LLM calls11
Tool calls10
Compactions0

passed

AD100-ALG-33

big-decimal arithmetic (strings)

4/4 drivers

100.0%

3.5

3.50

39.7k

134.7s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagecpp
Difficultyhard
Weight3.5
Tagsbignum, arithmetic, strings
Exit code0
Timed outFalse
Context tokens39,743
LLM calls7
Tool calls6
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed

AD100-ALG-34

treap: k-th order statistics

4/4 drivers

100.0%

4.5

4.50

16.3k

69.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagecpp
Difficultyhard
Weight4.5
Tagstreap, order-statistics, balanced-bst
Exit code0
Timed outFalse
Context tokens16,259
LLM calls13
Tool calls12
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed

AD100-ALG-35

persistent segment tree (versions + k-th)

4/4 drivers

100.0%

3.00

18.4k

63.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaralgorithmic
Languagecpp
Difficultyexpert
Weight3
Tagspersistent-segment-tree, functional-data-structure, versions
Exit code0
Timed outFalse
Context tokens18,365
LLM calls7
Tool calls6
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed

AD100-DBG-11

API contract: exception + aliasing

16/16

100.0%

3.00

15.6k

55.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultymedium
Weight3
Tagsapi-contract, exception-type, aliasing, defensive-copy
Exit code0
Timed outFalse
Context tokens15,642
LLM calls18
Tool calls17
Compactions0

passed

AD100-DBG-12

int overflow in size arithmetic

4/4 drivers

100.0%

3.5

3.50

14.3k

55.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagecpp
Difficultymedium
Weight3.5
Tagsinteger-overflow, size-arithmetic, validation
Exit code0
Timed outFalse
Context tokens14,267
LLM calls14
Tool calls13
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed

AD100-DBG-13

size_t underflow on singleton/empty

1/4 drivers

25.0%

0.0%

7.5

0.00

12.0k

55.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagecpp
Difficultymedium
Weight7.5
Tagssize-t, underflow, empty-singleton
Exit code0
Timed outFalse
Context tokens11,972
LLM calls17
Tool calls16
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

test_bugs
test_bugs_public
test_regression

passed

AD100-DBG-15

hash-order nondeterminism

12/12

100.0%

3.00

4172

29.6s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultymedium
Weight3
Tagshash-order, determinism, nondeterminism, sorting
Exit code0
Timed outFalse
Context tokens4,172
LLM calls9
Tool calls8
Compactions0

failed

AD100-DBG-17

wrong exception type on error path

3/4 drivers

75.0%

40.0%

4.5

1.80

15.5k

65.6s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagecpp
Difficultymedium
Weight4.5
Tagsexception-contract, parsing, error-path
Exit code0
Timed outFalse
Context tokens15,521
LLM calls17
Tool calls16
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

test_bugs

passed

AD100-DBG-19

multiple interacting bug classes

19/19

100.0%

3.00

16.4k

73.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultyhard
Weight3
Tagsmulti-bug, mutable-default, off-by-one, exception-contract, aliasing
Exit code0
Timed outFalse
Context tokens16,350
LLM calls18
Tool calls17
Compactions0

passed

AD100-DBG-20

path traversal + expression injection

50/50

100.0%

3.00

17.6k

69.6s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultyhard
Weight3
Tagssecurity, path-traversal, injection, input-validation
Exit code0
Timed outFalse
Context tokens17,571
LLM calls19
Tool calls18
Compactions0

passed

AD100-DBG-21

unseeded RNG / wall-clock dependence

19/19

100.0%

3.00

9989

45.6s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultyhard
Weight3
Tagsdeterminism, rng, wall-clock, reproducibility
Exit code0
Timed outFalse
Context tokens9,989
LLM calls10
Tool calls9
Compactions0

passed

AD100-DBG-23

erase-while-iterating + related bugs

4/4 drivers

100.0%

3.00

12.5k

53.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagecpp
Difficultyhard
Weight3
Tagserase-while-iterating, vector, iterator, off-by-one
Exit code0
Timed outFalse
Context tokens12,463
LLM calls19
Tool calls18
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed

AD100-DBG-26

snapshot restore service

22/24

91.7%

35.0%

15.5

5.42

21.3k

85.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultyhard
Weight15.5
Tagssecurity-review, cve-derived, filesystem, symlinks, transactional
Exit code0
Timed outFalse
Context tokens21,344
LLM calls16
Tool calls15
Compactions0

Failed tests

test_security_parent_after_symlink[bridge/../secret]
test_security_parent_after_symlink[/r/bridge/../secret]

failed

AD100-DBG-27

verified block ingestion

43/44

97.7%

65.0%

6.50

23.9k

95.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultyhard
Weight10
Tagssecurity-review, cve-derived, integrity, streaming, short-reads
Exit code0
Timed outFalse
Context tokens23,881
LLM calls27
Tool calls26
Compactions0

Failed tests

test_regression_independent_empty_block

passed

AD100-DBG-28

indexed document reader

26/26

100.0%

3.00

55.3k

190.8s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultyhard
Weight3
Tagssecurity-review, cve-derived, parser, progress, random-access
Exit code0
Timed outFalse
Context tokens55,332
LLM calls11
Tool calls10
Compactions0

failed

AD100-DBG-31

stylesheet inspection pipeline

25/33

75.8%

0.0%

22.5

0.00

28.8k

107.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultyhard
Weight22.5
Tagssecurity-review, cve-derived, tokenizer, escaping, parser-differential
Exit code0
Timed outFalse
Context tokens28,796
LLM calls22
Tool calls21
Compactions0

Failed tests

test_regression_urls[url(a-a]
test_security_even_backslashes_terminate[2]
test_security_even_backslashes_terminate[4]
test_security_even_backslashes_terminate[6]
test_security_even_backslashes_terminate[8]
test_security_hidden_declaration_not_consumed[2]
test_security_hidden_declaration_not_consumed[4]
test_security_hidden_declaration_not_consumed[6]

failed

AD100-DBG-33

multipart metadata processing

16/19

84.2%

0.0%

0.00

40.1k

151.8s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultyhard
Weight13
Tagssecurity-review, cve-derived, regex, complexity, multipart
Exit code0
Timed outFalse
Context tokens40,135
LLM calls22
Tool calls21
Compactions0

Failed tests

test_regression_parameters[form-data; name=x; filename=old; filename*=UTF-8''new-want3]
test_security_long_unassigned_parameter
test_security_large_malformed_then_valid

failed

AD100-DBG-34

URL text and form gateway

22/29

75.9%

0.0%

0.00

27.6k

107.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultyhard
Weight6
Tagssecurity-review, cve-derived, percent-encoding, utf8, complexity
Exit code0
Timed outFalse
Context tokens27,590
LLM calls20
Tool calls19
Compactions0

Failed tests

test_regression_utf8[%c3%28-%c3(]
test_regression_random_independent_utf8_reference
test_security_no_cascading[%2541x%41%zz-%41xA%zz]
test_security_no_cascading[%252Bx%2B-%2Bx+]
test_security_no_cascading[%25C3%25A9x%C3%A9-%C3%A9x\xe9]
test_security_many_distinct_runs
test_security_form_boundaries

failed

AD100-DBG-35

schema identifier registry

16/24

66.7%

0.0%

10.5

0.00

22.9k

93.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultyhard
Weight10.5
Tagssecurity-review, cve-derived, asn1, canonicalization, integer-bounds
Exit code0
Timed outFalse
Context tokens22,939
LLM calls18
Tool calls17
Compactions0

Failed tests

test_regression_random_reference
test_regression_malformed_wire[\x80\x00]
test_regression_malformed_wire[\x81]
test_security_invalid_arcs[3.2.840]
test_security_first_subidentifier_multibyte[2.48-8100]
test_security_first_subidentifier_multibyte[2.100-8134]
test_security_first_subidentifier_multibyte[2.999.3-883703]
test_security_first_subidentifier_multibyte[2.4294967215-8fffffff7f]

failed

AD100-DBG-36

Walk or drive to the car wash

0/1

0.0%

0.00

2680

25.6s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultymedium
Weight4
Tagsreasoning, deliverable, file-io, single-word-answer
Exit code0
Timed outFalse
Context tokens2,680
LLM calls5
Tool calls4
Compactions0

Failed tests

test_answer_is_drive

passed

AD100-DBG-37

Which is larger, 9.11 or 9.9?

1/1

100.0%

3.00

3077

21.6s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillardebugging
Languagepython
Difficultymedium
Weight3
Tagsreasoning, numeric-literals, deliverable, file-io
Exit code0
Timed outFalse
Context tokens3,077
LLM calls6
Tool calls5
Compactions0

passed

AD100-OPT-17

quicksort worst-case pivot

2/2 drivers

100.0%

3.00

51.6k

182.9s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillaroptimization
Languagecpp
Difficultyhard
Weight3
Tagscomplexity, quicksort, pivot, worst-case
Exit code0
Timed outFalse
Context tokens51,648
LLM calls13
Tool calls12
Compactions0

Tests

C++ test drivers (executed stages only): correctness: passed; performance: passed.

passed

AD100-PRJ-01

taskcli: TSV task manager

20/20

100.0%

3.5

3.50

43.6k

150.8s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultymedium
Weight3.5
Tagscli, persistence, exit-codes, json-store
Exit code0
Timed outFalse
Context tokens43,578
LLM calls8
Tool calls7
Compactions0

passed

AD100-PRJ-02

INI config library

3/3 drivers

100.0%

3.00

17.0k

65.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultymedium
Weight3
Tagsparsing, ini, api-design, exceptions
Exit code0
Timed outFalse
Context tokens17,021
LLM calls12
Tool calls11
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed

AD100-PRJ-08

Markdown→HTML subset

25/26

96.2%

70.0%

15.40

28.6k

113.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultymedium
Weight22
Tagsmarkdown, parser, html, escaping
Exit code0
Timed outFalse
Context tokens28,586
LLM calls25
Tool calls24
Compactions0

Failed tests

test_unmatched_markers_stay_literal

failed

AD100-PRJ-09

KV store: TTL + LRU + snapshot

21/23

91.3%

80.0%

4.5

3.60

25.8k

88.7s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultymedium
Weight4.5
Tagskv-store, ttl, lru, persistence
Exit code0
Timed outFalse
Context tokens25,753
LLM calls12
Tool calls11
Compactions0

Failed tests

test_corrupt_store
test_corrupt_beats_command_but_not_usage

passed

AD100-PRJ-10

cron next-fire calculator

21/21

100.0%

3.5

3.50

26.7k

203.8s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultymedium
Weight3.5
Tagscron, schedules, calendar, parsing
Exit code0
Timed outFalse
Context tokens26,706
LLM calls17
Tool calls16
Compactions0

failed

AD100-PRJ-11

access-log analyzer (stats + filters)

11/16

68.8%

30.0%

3.5

1.05

23.2k

89.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultymedium
Weight3.5
Tagslogs, parsing, aggregation, cli
Exit code0
Timed outFalse
Context tokens23,236
LLM calls17
Tool calls16
Compactions0

Failed tests

test_top_paths_default_order
test_top_ips
test_top_n_limits_output
test_top_more_than_ten_paths_default_limit
test_query_strings_are_distinct_paths

passed

AD100-PRJ-12

HTTP/1.1 message parser

3/3 drivers

100.0%

5.00

31.3k

99.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultymedium
Weight5
Tagshttp, parser, chunked, protocol
Exit code0
Timed outFalse
Context tokens31,275
LLM calls14
Tool calls13
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed

AD100-PRJ-13

mustache-lite template engine

2/3 drivers

66.7%

60.0%

6.5

3.90

33.8k

122.7s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultymedium
Weight6.5
Tagstemplates, mustache, html-escaping, recursion
Exit code0
Timed outFalse
Context tokens33,769
LLM calls18
Tool calls17
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

test_sections

failed

AD100-PRJ-14

mini scripting language interpreter

14/21

66.7%

0.0%

10.5

0.00

82.7k

260.0s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight10.5
Tagsinterpreter, lexer, parser, tree-walker, cli
Exit code0
Timed outFalse
Context tokens82,667
LLM calls30
Tool calls29
Compactions0

Failed tests

test_while_loops
test_list_mutation
test_syntax_errors
test_runtime_errors
test_partial_output_kept
test_bools_nil_equality
test_lists

failed

AD100-PRJ-15

mini pytest (discovery, fixtures, report)

17/18

94.4%

60.0%

4.5

2.70

25.4k

95.8s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight4.5
Tagstest-runner, discovery, fixtures, reporting
Exit code0
Timed outFalse
Context tokens25,433
LLM calls13
Tool calls12
Compactions0

Failed tests

test_fixture_assertion_is_error_not_fail

passed

AD100-PRJ-16

Game of Life engine (seeded, census)

11/11

100.0%

3.5

3.50

21.3k

70.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight3.5
Tagsgame-of-life, simulation, prng, cycle-detection
Exit code0
Timed outFalse
Context tokens21,347
LLM calls14
Tool calls13
Compactions0

passed

AD100-PRJ-17

LZ77+RLE codec with checksum

4/4 drivers

100.0%

4.5

4.50

18.8k

79.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyhard
Weight4.5
Tagscompression, lz77, rle, checksum, codec
Exit code0
Timed outFalse
Context tokens18,799
LLM calls15
Tool calls14
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed

AD100-PRJ-18

discrete-event simulator (deterministic)

4/4 drivers

100.0%

3.5

3.50

42.5k

140.8s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyhard
Weight3.5
Tagssimulation, event-queue, deterministic-ordering
Exit code0
Timed outFalse
Context tokens42,462
LLM calls7
Tool calls6
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed

AD100-PRJ-19

C++ mini test framework

4/4 drivers

100.0%

3.5

3.50

29.9k

113.9s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyhard
Weight3.5
Tagstest-framework, macros, registry, fixtures
Exit code0
Timed outFalse
Context tokens29,862
LLM calls28
Tool calls27
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed

AD100-PRJ-20

SQL subset engine (DDL/DML/SELECT/JOIN)

0/4 drivers

0.0%

15.5

0.00

52.6k

171.8s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyexpert
Weight15.5
Tagssql, parser, join, query-engine
Exit code0
Timed outFalse
Context tokens52,619
LLM calls25
Tool calls24
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

test_ddl_dml
test_errors
test_join
test_select

failed

AD100-PRJ-21

Indexed archive utility

0/8 drivers

0.0%

0.00

438.4k

793.6s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyhard
Weight30
Tagsmini-project, idea-1, zip, indexed-access, posix-metadata
Exit code0
Timed outFalse
Context tokens438,357
LLM calls48
Tool calls47
Compactions4

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

test_core
test_core_metadata
test_core_selection
test_errors
test_errors_integrity
test_errors_structure
test_resources
test_resources_indexed

failed

AD100-PRJ-22

Silence-aware MP3 splitter

13/18

72.2%

20.0%

11.5

2.30

60.0k

175.8s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight11.5
Tagsmini-project, idea-2
Exit code0
Timed outFalse
Context tokens59,991
LLM calls14
Tool calls14
Compactions0

Failed tests

test_core_mixed_bitrate_padding_and_modes
test_core_crc_flag_only_changes_flag
test_errors_input_types
test_errors_reserved_and_invalid_headers
test_errors_plan_argument_validation

failed

AD100-PRJ-23

FAT32/VFAT filesystem recovery

—

0.0%

0.00

80.5k

1200.2s

DEADLINE

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight30
Tagsmini-project, idea-3, fat32, vfat, reverse-engineering
Exit code0
Timed outFalse
Context tokens80,460
LLM calls32
Tool calls32
Compactions0

failed

AD100-PRJ-24

Image similarity and grouping

16/17

94.1%

80.0%

4.00

34.3k

153.8s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight5
Tagsmini-project, idea-4
Exit code0
Timed outFalse
Context tokens34,327
LLM calls20
Tool calls19
Compactions0

Failed tests

test_errors_group_validation

passed

AD100-PRJ-25

Binary delta generator and applier

3/3 drivers

100.0%

6.5

6.50

38.3k

135.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyhard
Weight6.5
Tagsmini-project, idea-5
Exit code0
Timed outFalse
Context tokens38,324
LLM calls22
Tool calls21
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed

AD100-PRJ-26

Incremental build tool

37/40

92.5%

80.0%

8.00

26.8k

86.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight10
Tagsmini-project, idea-6
Exit code0
Timed outFalse
Context tokens26,761
LLM calls11
Tool calls10
Compactions0

Failed tests

test_errors_empty_spec
test_errors_digest_requires_bytes
test_errors_files_missing_path

failed

AD100-PRJ-27

ELF executable inspector

0/79

0.0%

0.00

70.8k

252.9s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight21
Tagsmini-project, idea-7, elf64, binary-recovery, stdlib
Exit code0
Timed outFalse
Context tokens70,750
LLM calls23
Tool calls22
Compactions0

Failed tests

test_core_reports[raw-sections]
test_core_reports[raw-symbols]
test_core_reports[raw-relocations]
test_core_reports[raw-segments]
test_core_reports[multiple-sections]
test_core_reports[multiple-symbols]
test_core_reports[multiple-relocations]
test_core_reports[multiple-segments]
test_core_reports[rel-sections]
test_core_reports[rel-symbols]
test_core_reports[rel-relocations]
test_core_reports[rel-segments]
test_core_reports[shared-sections]
test_core_reports[shared-symbols]
test_core_reports[shared-relocations]
test_core_reports[shared-segments]
test_core_reports[buffers-sections]
test_core_reports[buffers-symbols]
test_core_reports[buffers-relocations]
test_core_reports[buffers-segments]
test_core_absent_names[sections]
test_core_absent_names[symbols]
test_core_absent_names[relocations]
test_core_absent_names[segments]
test_core_no_tables
test_core_numeric_metadata_and_reserved_symbols
test_core_accessed_tables_only
test_core_review_valid_inputs[sections-null-program]
test_core_review_valid_inputs[sections-empty-symbol-names]
test_core_review_valid_inputs[sections-symbol-free-relocations]
test_core_review_valid_inputs[symbols-null-program]
test_core_review_valid_inputs[symbols-empty-symbol-names]
test_core_review_valid_inputs[symbols-symbol-free-relocations]
test_core_review_valid_inputs[relocations-null-program]
test_core_review_valid_inputs[relocations-empty-symbol-names]
test_core_review_valid_inputs[relocations-symbol-free-relocations]
test_core_review_valid_inputs[segments-null-program]
test_core_review_valid_inputs[segments-empty-symbol-names]
test_core_review_valid_inputs[segments-symbol-free-relocations]
test_errors_type_header_bounds[sections]
test_errors_type_header_bounds[symbols]
test_errors_type_header_bounds[relocations]
test_errors_type_header_bounds[segments]
test_errors_sections[payload]
test_errors_sections[name-type]
test_errors_sections[name-range]
test_errors_sections[name-end]
test_errors_sections[name-start]
test_errors_symbols[stride]
test_errors_symbols[remainder]
test_errors_symbols[link-range]
test_errors_symbols[link-type]
test_errors_symbols[info]
test_errors_symbols[name-range]
test_errors_symbols[section-range]
test_errors_symbols[string-end]
test_errors_symbols[string-start]
test_errors_relocations[stride]
test_errors_relocations[remainder]
test_errors_relocations[link-range]
test_errors_relocations[link-type]
test_errors_relocations[target]
test_errors_relocations[symbol-range]
test_errors_relocations[linked-stride]
test_errors_relocations[linked-string]
test_errors_segments
test_errors_review_boundaries[null-as-load]
test_errors_review_boundaries[null-as-note]
test_errors_review_boundaries[empty-name-nonzero]
test_errors_review_boundaries[empty-name-bad-type]
test_errors_review_boundaries[empty-name-bounds]
test_errors_review_boundaries[no-table-nonzero-symbol]
test_errors_review_boundaries[no-table-bad-link]
test_errors_review_boundaries[no-table-wrong-type]
test_resources_light_envelope[sections]
test_resources_light_envelope[symbols]
test_resources_light_envelope[relocations]
test_resources_light_envelope[segments]
test_resources_untrusted_sizes

failed

AD100-PRJ-28

Dependency-aware package resolver

26/29

89.7%

20.0%

1.80

23.7k

93.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight9
Tagsmini-project, idea-8
Exit code0
Timed outFalse
Context tokens23,693
LLM calls13
Tool calls12
Compactions0

Failed tests

test_core_differential_against_brute_force
test_errors_non_string_version
test_errors_requests_structure

failed

AD100-PRJ-29

RAW Bayer development pipeline

2/3 drivers

66.7%

40.0%

2.80

27.3k

83.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyexpert
Weight7
Tagsmini-project, idea-9
Exit code0
Timed outFalse
Context tokens27,294
LLM calls14
Tool calls13
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

test_core

passed

AD100-PRJ-30

Image registration (translation)

3/3 drivers

100.0%

3.5

3.50

24.8k

91.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyhard
Weight3.5
Tagsmini-project, idea-10
Exit code0
Timed outFalse
Context tokens24,784
LLM calls14
Tool calls13
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed

AD100-PRJ-31

Score language to WAV synthesizer

10/12

83.3%

20.0%

5.60

34.2k

121.8s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight28
Tagsmini-project, idea-11
Exit code0
Timed outFalse
Context tokens34,234
LLM calls12
Tool calls11
Compactions0

Failed tests

test_core_voice_continuation
test_errors_input_type

failed

AD100-PRJ-32

Fixed-timestep 2D physics sandbox

10/12

83.3%

80.0%

9.5

7.60

25.8k

74.7s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight9.5
Tagsmini-project, idea-12
Exit code0
Timed outFalse
Context tokens25,824
LLM calls10
Tool calls9
Compactions0

Failed tests

test_errors_numeric_ranges
test_errors_steps_and_bounds

failed

AD100-PRJ-33

Columnar data compressor

—

0.0%

0.00

418.2k

1202.1s

DEADLINE

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyexpert
Weight30
Tagsmini-project, idea-13
Exit code0
Timed outFalse
Context tokens418,227
LLM calls95
Tool calls95
Compactions4

Tests

C++ test drivers: results unavailable or incomplete.

failed

AD100-PRJ-34

DTMF decoder

8/13

61.5%

20.0%

18.5

3.70

34.8k

105.8s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight18.5
Tagsmini-project, idea-14
Exit code0
Timed outFalse
Context tokens34,783
LLM calls15
Tool calls14
Compactions0

Failed tests

test_core_timing_frames
test_core_quiet_tone_still_found
test_core_gap_bridging
test_errors_bad_format
test_errors_truncated_chunks

failed

AD100-PRJ-35

Mobile-robot path planner

11/12

91.7%

40.0%

9.5

3.80

17.2k

60.7s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight9.5
Tagsmini-project, idea-15
Exit code0
Timed outFalse
Context tokens17,207
LLM calls14
Tool calls13
Compactions0

Failed tests

test_core_tie_break_deterministic

failed

AD100-PRJ-36

Two-link robot-arm controller

12/14

85.7%

80.0%

18.40

42.8k

146.8s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight23
Tagsmini-project, idea-16
Exit code0
Timed outFalse
Context tokens42,842
LLM calls7
Tool calls6
Compactions0

Failed tests

test_errors_configs
test_errors_ik

failed

AD100-PRJ-37

Fiducial-marker detector

0/3 drivers

0.0%

12.5

0.00

42.0k

171.8s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyexpert
Weight12.5
Tagsmini-project, idea-17
Exit code0
Timed outFalse
Context tokens42,039
LLM calls29
Tool calls28
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

test_core
test_errors
test_resources

passed

AD100-PRJ-38

Multi-object tracker

11/11

100.0%

15.5

15.50

26.0k

107.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight15.5
Tagsmini-project, idea-18
Exit code0
Timed outFalse
Context tokens26,008
LLM calls14
Tool calls13
Compactions0

failed

AD100-PRJ-39

Parametric audio equalizer

1/3 drivers

33.3%

20.0%

5.60

36.2k

92.7s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyhard
Weight28
Tagsmini-project, idea-19
Exit code0
Timed outFalse
Context tokens36,163
LLM calls14
Tool calls13
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

test_core
test_errors

failed

AD100-PRJ-40

Barcode scanner (EAN-13)

—

0.0%

0.00

350.7k

1200.9s

DEADLINE

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyexpert
Weight24
Tagsmini-project, idea-20
Exit code0
Timed outFalse
Context tokens350,718
LLM calls56
Tool calls55
Compactions4

Tests

C++ test drivers: results unavailable or incomplete.

failed

AD100-PRJ-41

JSONL chat-log to Markdown converter

15/32

46.9%

0.0%

0.00

64.9k

184.5s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight30
Tagsmini-project, idea-21
Exit code0
Timed outFalse
Context tokens64,896
LLM calls21
Tool calls20
Compactions0

Failed tests

test_core_width_none_keeps_spacing
test_core_long_word_not_split
test_core_width_one
test_core_fence_with_language_and_wrap_around
test_core_unterminated_fence_runs_to_end
test_core_tool_result_and_empty_text
test_core_message_default_text
test_core_note_empty_text_is_prefix_only
test_core_multiple_blocks_and_internal_blank_lines
test_core_wrapping_matches_reference_on_fuzz
test_errors_non_object_record
test_errors_unknown_type
test_errors_tool_call_fields
test_errors_text_type
test_errors_non_string_line
test_errors_width_validation[True]
test_resources_large_single_paragraph_wrap_is_linear

failed

AD100-PRJ-42

RFC 3986 URL utility

44/129

34.1%

0.0%

0.00

202.4k

511.4s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight30
Tagsmini-project, idea-22, rfc3986, native-oracle
Exit code0
Timed outFalse
Context tokens202,374
LLM calls77
Tool calls76
Compactions2

Failed tests

test_core_rfc3986_resolution[g-http://a/b/c/g]
test_core_rfc3986_resolution[./g-http://a/b/c/g]
test_core_rfc3986_resolution[g/-http://a/b/c/g/]
test_core_rfc3986_resolution[#s-http://a/b/c/d;p?q#s]
test_core_rfc3986_resolution[g?y-http://a/b/c/g?y]
test_core_rfc3986_resolution[g#s-http://a/b/c/g#s]
test_core_rfc3986_resolution[g?y#s-http://a/b/c/g?y#s]
test_core_rfc3986_resolution[;x-http://a/b/c/;x]
test_core_rfc3986_resolution[g;x-http://a/b/c/g;x]
test_core_rfc3986_resolution[g;x?y#s-http://a/b/c/g;x?y#s]
test_core_rfc3986_resolution[.-http://a/b/c/]
test_core_rfc3986_resolution[./-http://a/b/c/]
test_core_rfc3986_resolution[..-http://a/b/]
test_core_rfc3986_resolution[../..-http://a/]
test_core_rfc3986_resolution[g.-http://a/b/c/g.]
test_core_rfc3986_resolution[.g-http://a/b/c/.g]
test_core_rfc3986_resolution[g..-http://a/b/c/g..]
test_core_rfc3986_resolution[./../g-http://a/b/g]
test_core_rfc3986_resolution[./g/.-http://a/b/c/g/]
test_core_rfc3986_resolution[g/./h-http://a/b/c/g/h]
test_core_rfc3986_resolution[g/../h-http://a/b/c/h]
test_core_rfc3986_resolution[g;x=1/./y-http://a/b/c/g;x=1/y]
test_core_rfc3986_resolution[g;x=1/../y-http://a/b/c/y]
test_core_rfc3986_resolution[g?y/./x-http://a/b/c/g?y/./x]
test_core_rfc3986_resolution[g?y/../x-http://a/b/c/g?y/../x]
test_core_rfc3986_resolution[g#s/./x-http://a/b/c/g#s/./x]
test_core_rfc3986_resolution[g#s/../x-http://a/b/c/g#s/../x]
test_core_normalize_idempotent_fuzz
test_core_decode_replacement
test_core_normalize_literals[WSS://U%73er@%45XAMPLE:00443/a//b/%2E/../c?%2f=%41#%7e-wss://User@example/a//b/c?%2F=A#~]
test_core_normalize_literals[http://H%2fX:00081/?#-http://h%2Fx:81/?#]
test_core_empty_authority_userinfo_and_scheme
test_core_decode_maximal_subparts[caf\xe9%2B+-caf\xe9++]
test_core_query_delimiters_and_types
test_errors_malformed_url[http://h/\n]
test_errors_malformed_url[http://h/\t]
test_errors_malformed_url[http://h/\x00]
test_errors_malformed_url[http://h/\x7f]
test_errors_malformed_url[http://h/a\\b]
test_errors_malformed_url[http://h/<x>]
test_errors_malformed_url[http://h/[x]]
test_errors_malformed_url[http://h/%]
test_errors_malformed_url[http://h/%2]
test_errors_malformed_url[http://h/%zz]
test_errors_malformed_url[http://h/?x=%gg]
test_errors_malformed_url[http://h/#%xy]
test_errors_malformed_url[http://u%zz@h/]
test_errors_malformed_url[http://h%zz/]
test_errors_malformed_url[http://h:65536/]
test_errors_malformed_url[http://h:-1/]
test_errors_malformed_url[http://h:8a/]
test_errors_malformed_url[http://h:\u0661/]
test_errors_malformed_url[http://[::1/]
test_errors_malformed_url[http://[1:2:3]/]
test_errors_malformed_url[http://[1::2::3]/]
test_errors_malformed_url[http://[12345::]/]
test_errors_malformed_url[http://[::1]tail/]
test_errors_malformed_url[http://::1/]
test_errors_malformed_url[http://[v1.a]/]
test_errors_malformed_url[http://[fe80::1%25eth0]/]
test_errors_malformed_url[http://%C3%A9/]
test_errors_malformed_url[http://u@v@h/]
test_errors_malformed_url[http://h/\ud800]
test_errors_malformed_url[http://h/a\xa0b]
test_errors_malformed_url[1http:x]
test_errors_malformed_url[x]
test_errors_malformed_url[//h/x]
test_errors_api_types_and_escapes[parse-args3-kwargs3]
test_errors_api_types_and_escapes[parse-args4-kwargs4]
test_errors_api_types_and_escapes[normalize-args5-kwargs5]
test_errors_api_types_and_escapes[encode-args7-kwargs7]
test_errors_api_types_and_escapes[encode-args9-kwargs9]
test_errors_api_types_and_escapes[encode-args10-kwargs10]
test_errors_api_types_and_escapes[encode-args11-kwargs11]
test_errors_api_types_and_escapes[decode-args12-kwargs12]
test_errors_api_types_and_escapes[get_query-args17-kwargs17]
test_errors_api_types_and_escapes[get_query-args18-kwargs18]
test_errors_api_types_and_escapes[set_query-args21-kwargs21]
test_errors_api_types_and_escapes[set_query-args22-kwargs22]
test_errors_api_types_and_escapes[set_query-args23-kwargs23]
test_errors_api_types_and_escapes[set_query-args24-kwargs24]
test_errors_all_input_length_limits
test_resources_parse_normalize_100000
test_resources_encode_decode_100000
test_resources_long_zero_port

failed

AD100-PRJ-43

Nonlinear least-squares solver

2/3 drivers

66.7%

80.0%

7.5

6.00

68.9k

227.6s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyexpert
Weight7.5
Tagsmini-project, idea-23
Exit code0
Timed outFalse
Context tokens68,934
LLM calls16
Tool calls15
Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

test_errors

passed

AD100-PRJ-44

IBAN and credit-card validator

9/9

100.0%

6.00

16.7k

96.1s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyhard
Weight6
Tagsmini-project, idea-24
Exit code0
Timed outFalse
Context tokens16,735
LLM calls6
Tool calls6
Compactions0

failed

AD100-PRJ-45

Arbitrary-precision integer arithmetic

2/3 drivers

66.7%

80.0%

14.5

11.60

151.1k

372.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyexpert
Weight14.5
Tagsmini-project, idea-25
Exit code0
Timed outFalse
Context tokens151,126
LLM calls22
Tool calls21
Compactions1

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

test_resources

failed

AD100-PRJ-47

Recover a hidden phrase from an executable

0/6

0.0%

5.5

0.00

247.7k

1200.1s

DEADLINE

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyexpert
Weight5.5
Tagsmini-project, idea-27
Exit code0
Timed outFalse
Context tokens247,656
LLM calls89
Tool calls89
Compactions2

Failed tests

test_core_exact_phrase
test_core_exact_length
test_errors_regular_submission_not_symlink
test_errors_no_prompt_or_trailing_newline
test_resources_bounded_file
test_resources_standalone_bytes

failed

AD100-PRJ-48

Black-box image transformation utility clone

—

0.0%

0.00

196.5k

917.7s

PI_EXIT

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagecpp
Difficultyexpert
Weight30
Tagsmini-project, idea-28
Exit code0
Timed outFalse
Context tokens196,494
LLM calls69
Tool calls67
Compactions2

Tests

C++ test drivers: results unavailable or incomplete.

failed

AD100-PRJ-49

Closed-loop differential-drive line follower

9/21

42.9%

0.0%

13.5

0.00

19.3k

67.7s

SUBMITTED

Challenge

Observed modelsunsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL
Pillarproject
Languagepython
Difficultyexpert
Weight13.5
Tagsmini-project, idea-29
Exit code0
Timed outFalse
Context tokens19,342
LLM calls8
Tool calls7
Compactions0

Failed tests

test_core_hidden_track_completion_and_recovery[1]
test_core_hidden_track_completion_and_recovery[2]
test_core_hidden_track_completion_and_recovery[3]
test_core_hidden_track_completion_and_recovery[4]
test_core_hidden_track_completion_and_recovery[5]
test_core_hidden_track_completion_and_recovery[6]
test_core_hidden_track_completion_and_recovery[7]
test_core_hidden_track_completion_and_recovery[8]
test_core_hidden_track_completion_and_recovery[9]
test_errors_api_and_state[5]
test_resources_deterministic_replay
test_resources_long_route_with_bounded_worker