unsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL

Observed from session logs: unsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL

run qwen3.6_35b_q4 · requested model default · generated 2026-11-13T07:42:07+00:00 · 78 challenges

36passed
42failed
0error
79.0%avg tests
274.25 / 744.00final score
36.9%of max
5.4Mcontext tokens
69.5kavg tokens/task
30compactions
passed
AD100-ALG-02
Dijkstra shortest paths
2/2 drivers
100.0%
100.0%
3
3.00
6095
14.7s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagecpp
  • Difficultymedium
  • Weight3
  • Tagsgraphs, dijkstra, priority-queue
  • Exit code0
  • Timed outFalse
  • Context tokens6,095
  • LLM calls7
  • Tool calls9
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-03
JSON parser from scratch
43/43
100.0%
100.0%
3
3.00
18.7k
55.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagsparsing, recursive-descent, unicode
  • Exit code0
  • Timed outFalse
  • Context tokens18,671
  • LLM calls27
  • Tool calls29
  • Compactions0
failed
AD100-ALG-16
RFC-4180 CSV parser from scratch
5/6
83.3%
70.0%
3.5
2.45
15.1k
40.9s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagepython
  • Difficultymedium
  • Weight3.5
  • Tagsparsing, csv, purity
  • Exit code0
  • Timed outFalse
  • Context tokens15,067
  • LLM calls18
  • Tool calls18
  • Compactions0

Failed tests

  • test_edge_quoting_and_separators
passed
AD100-ALG-19
S-expression reader/writer
4/4
100.0%
100.0%
3.5
3.50
75.7k
481.9s
DEADLINE

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagepython
  • Difficultymedium
  • Weight3.5
  • Tagsparsing, s-expression, recursion-limit
  • Exit code0
  • Timed outFalse
  • Context tokens75,681
  • LLM calls29
  • Tool calls30
  • Compactions0
passed
AD100-ALG-20
word ladder shortest chain
4/4
100.0%
100.0%
3
3.00
8001
35.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagepython
  • Difficultymedium
  • Weight3
  • Tagsgraph, bfs, lexicographic
  • Exit code0
  • Timed outFalse
  • Context tokens8,001
  • LLM calls11
  • Tool calls11
  • Compactions0
passed
AD100-ALG-22
strongly connected components (Tarjan)
3/3 drivers
100.0%
100.0%
3
3.00
8253
24.9s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagecpp
  • Difficultymedium
  • Weight3
  • Tagsgraph, scc, tarjan
  • Exit code0
  • Timed outFalse
  • Context tokens8,253
  • LLM calls12
  • Tool calls13
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-23
segment tree: point update + range sum
3/3 drivers
100.0%
100.0%
3
3.00
11.9k
34.9s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagecpp
  • Difficultymedium
  • Weight3
  • Tagsdata-structure, segment-tree
  • Exit code0
  • Timed outFalse
  • Context tokens11,887
  • LLM calls13
  • Tool calls14
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-26
sparse table RMQ
4/4 drivers
100.0%
100.0%
3
3.00
4699
25.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagecpp
  • Difficultymedium
  • Weight3
  • Tagsdata-structure, rmq, sparse-table
  • Exit code0
  • Timed outFalse
  • Context tokens4,699
  • LLM calls9
  • Tool calls10
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-27
convex hull (monotone chain)
4/4 drivers
100.0%
100.0%
3
3.00
10.5k
43.9s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyhard
  • Weight3
  • Tagsgeometry, convex-hull
  • Exit code0
  • Timed outFalse
  • Context tokens10,518
  • LLM calls9
  • Tool calls10
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-28
min-cost max-flow
3/3 drivers
100.0%
100.0%
3
3.00
24.7k
73.0s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyhard
  • Weight3
  • Tagsflow, min-cost-flow, optimization
  • Exit code0
  • Timed outFalse
  • Context tokens24,737
  • LLM calls15
  • Tool calls16
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-29
glob matcher (*, ?, classes)
5/5
100.0%
100.0%
6
6.00
22.2k
56.9s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagepython
  • Difficultyhard
  • Weight6
  • Tagspattern-matching, backtracking
  • Exit code0
  • Timed outFalse
  • Context tokens22,210
  • LLM calls28
  • Tool calls29
  • Compactions0
passed
AD100-ALG-30
matrix-chain multiplication
5/5
100.0%
100.0%
3
3.00
5182
27.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagsdp, parenthesization
  • Exit code0
  • Timed outFalse
  • Context tokens5,182
  • LLM calls7
  • Tool calls9
  • Compactions0
passed
AD100-ALG-31
Huffman coding round-trip
6/6
100.0%
100.0%
3
3.00
14.0k
30.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagshuffman, compression, round-trip
  • Exit code0
  • Timed outFalse
  • Context tokens13,956
  • LLM calls23
  • Tool calls24
  • Compactions0
passed
AD100-ALG-33
big-decimal arithmetic (strings)
4/4 drivers
100.0%
100.0%
3.5
3.50
28.4k
94.0s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyhard
  • Weight3.5
  • Tagsbignum, arithmetic, strings
  • Exit code0
  • Timed outFalse
  • Context tokens28,426
  • LLM calls29
  • Tool calls30
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-34
treap: k-th order statistics
4/4 drivers
100.0%
100.0%
4.5
4.50
18.1k
61.9s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyhard
  • Weight4.5
  • Tagstreap, order-statistics, balanced-bst
  • Exit code0
  • Timed outFalse
  • Context tokens18,129
  • LLM calls17
  • Tool calls18
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-35
persistent segment tree (versions + k-th)
4/4 drivers
100.0%
100.0%
3
3.00
16.8k
45.0s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyexpert
  • Weight3
  • Tagspersistent-segment-tree, functional-data-structure, versions
  • Exit code0
  • Timed outFalse
  • Context tokens16,802
  • LLM calls14
  • Tool calls16
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-DBG-11
API contract: exception + aliasing
16/16
100.0%
100.0%
3
3.00
4918
12.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultymedium
  • Weight3
  • Tagsapi-contract, exception-type, aliasing, defensive-copy
  • Exit code0
  • Timed outFalse
  • Context tokens4,918
  • LLM calls7
  • Tool calls7
  • Compactions0
failed
AD100-DBG-12
int overflow in size arithmetic
3/4 drivers
75.0%
40.0%
3.5
1.40
5189
25.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagecpp
  • Difficultymedium
  • Weight3.5
  • Tagsinteger-overflow, size-arithmetic, validation
  • Exit code0
  • Timed outFalse
  • Context tokens5,189
  • LLM calls10
  • Tool calls11
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_bugs
failed
AD100-DBG-13
size_t underflow on singleton/empty
2/4 drivers
50.0%
40.0%
7.5
3.00
6330
14.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagecpp
  • Difficultymedium
  • Weight7.5
  • Tagssize-t, underflow, empty-singleton
  • Exit code0
  • Timed outFalse
  • Context tokens6,330
  • LLM calls12
  • Tool calls15
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_bugs
  • test_bugs_public
passed
AD100-DBG-15
hash-order nondeterminism
12/12
100.0%
100.0%
3
3.00
3365
6.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultymedium
  • Weight3
  • Tagshash-order, determinism, nondeterminism, sorting
  • Exit code0
  • Timed outFalse
  • Context tokens3,365
  • LLM calls6
  • Tool calls6
  • Compactions0
passed
AD100-DBG-17
wrong exception type on error path
4/4 drivers
100.0%
100.0%
4.5
4.50
8468
22.9s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagecpp
  • Difficultymedium
  • Weight4.5
  • Tagsexception-contract, parsing, error-path
  • Exit code0
  • Timed outFalse
  • Context tokens8,468
  • LLM calls10
  • Tool calls12
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-DBG-19
multiple interacting bug classes
19/19
100.0%
100.0%
3
3.00
5196
10.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagsmulti-bug, mutable-default, off-by-one, exception-contract, aliasing
  • Exit code0
  • Timed outFalse
  • Context tokens5,196
  • LLM calls9
  • Tool calls9
  • Compactions0
failed
AD100-DBG-20
path traversal + expression injection
49/50
98.0%
40.0%
3
1.20
8610
20.9s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagssecurity, path-traversal, injection, input-validation
  • Exit code0
  • Timed outFalse
  • Context tokens8,610
  • LLM calls10
  • Tool calls10
  • Compactions0

Failed tests

  • test_evaluate_arithmetic[-10 / 3--4]
passed
AD100-DBG-21
unseeded RNG / wall-clock dependence
19/19
100.0%
100.0%
3
3.00
4697
10.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagsdeterminism, rng, wall-clock, reproducibility
  • Exit code0
  • Timed outFalse
  • Context tokens4,697
  • LLM calls7
  • Tool calls7
  • Compactions0
passed
AD100-DBG-23
erase-while-iterating + related bugs
4/4 drivers
100.0%
100.0%
3
3.00
5297
10.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagecpp
  • Difficultyhard
  • Weight3
  • Tagserase-while-iterating, vector, iterator, off-by-one
  • Exit code0
  • Timed outFalse
  • Context tokens5,297
  • LLM calls7
  • Tool calls9
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-DBG-26
snapshot restore service
24/24
100.0%
100.0%
15.5
15.50
61.2k
196.3s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight15.5
  • Tagssecurity-review, cve-derived, filesystem, symlinks, transactional
  • Exit code0
  • Timed outFalse
  • Context tokens61,164
  • LLM calls67
  • Tool calls74
  • Compactions0
failed
AD100-DBG-27
verified block ingestion
43/44
97.7%
65.0%
10
6.50
39.4k
124.2s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight10
  • Tagssecurity-review, cve-derived, integrity, streaming, short-reads
  • Exit code0
  • Timed outFalse
  • Context tokens39,423
  • LLM calls36
  • Tool calls41
  • Compactions0

Failed tests

  • test_regression_independent_empty_block
passed
AD100-DBG-28
indexed document reader
26/26
100.0%
100.0%
3
3.00
38.0k
119.2s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagssecurity-review, cve-derived, parser, progress, random-access
  • Exit code0
  • Timed outFalse
  • Context tokens37,977
  • LLM calls6
  • Tool calls10
  • Compactions0
failed
AD100-DBG-31
stylesheet inspection pipeline
26/33
78.8%
35.0%
22.5
7.87
137.0k
424.1s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight22.5
  • Tagssecurity-review, cve-derived, tokenizer, escaping, parser-differential
  • Exit code0
  • Timed outFalse
  • Context tokens136,992
  • LLM calls38
  • Tool calls56
  • Compactions1

Failed tests

  • test_security_even_backslashes_terminate[2]
  • test_security_even_backslashes_terminate[4]
  • test_security_even_backslashes_terminate[6]
  • test_security_even_backslashes_terminate[8]
  • test_security_hidden_declaration_not_consumed[2]
  • test_security_hidden_declaration_not_consumed[4]
  • test_security_hidden_declaration_not_consumed[6]
failed
AD100-DBG-33
multipart metadata processing
17/19
89.5%
35.0%
13
4.55
168.4k
501.3s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight13
  • Tagssecurity-review, cve-derived, regex, complexity, multipart
  • Exit code0
  • Timed outFalse
  • Context tokens168,381
  • LLM calls76
  • Tool calls83
  • Compactions1

Failed tests

  • test_security_long_unassigned_parameter
  • test_security_large_malformed_then_valid
failed
AD100-DBG-34
URL text and form gateway
24/29
82.8%
35.0%
6
2.10
125.8k
360.0s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight6
  • Tagssecurity-review, cve-derived, percent-encoding, utf8, complexity
  • Exit code0
  • Timed outFalse
  • Context tokens125,757
  • LLM calls42
  • Tool calls105
  • Compactions1

Failed tests

  • test_security_no_cascading[%2541x%41%zz-%41xA%zz]
  • test_security_no_cascading[%252Bx%2B-%2Bx+]
  • test_security_no_cascading[%25C3%25A9x%C3%A9-%C3%A9x\xe9]
  • test_security_many_distinct_runs
  • test_security_form_boundaries
failed
AD100-DBG-35
schema identifier registry
17/24
70.8%
0.0%
10.5
0.00
34.9k
112.0s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight10.5
  • Tagssecurity-review, cve-derived, asn1, canonicalization, integer-bounds
  • Exit code0
  • Timed outFalse
  • Context tokens34,867
  • LLM calls32
  • Tool calls55
  • Compactions0

Failed tests

  • test_regression_random_reference
  • test_regression_malformed_wire[\x80\x00]
  • test_regression_malformed_wire[\x81]
  • test_security_first_subidentifier_multibyte[2.48-8100]
  • test_security_first_subidentifier_multibyte[2.100-8134]
  • test_security_first_subidentifier_multibyte[2.999.3-883703]
  • test_security_first_subidentifier_multibyte[2.4294967215-8fffffff7f]
failed
AD100-DBG-36
Walk or drive to the car wash
0/1
0.0%
0.0%
4
0.00
2542
6.7s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultymedium
  • Weight4
  • Tagsreasoning, deliverable, file-io, single-word-answer
  • Exit code0
  • Timed outFalse
  • Context tokens2,542
  • LLM calls2
  • Tool calls2
  • Compactions0

Failed tests

  • test_answer_is_drive
passed
AD100-DBG-37
Which is larger, 9.11 or 9.9?
1/1
100.0%
100.0%
3
3.00
3140
4.7s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillardebugging
  • Languagepython
  • Difficultymedium
  • Weight3
  • Tagsreasoning, numeric-literals, deliverable, file-io
  • Exit code0
  • Timed outFalse
  • Context tokens3,140
  • LLM calls5
  • Tool calls5
  • Compactions0
passed
AD100-OPT-17
quicksort worst-case pivot
2/2 drivers
100.0%
100.0%
3
3.00
8104
33.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillaroptimization
  • Languagecpp
  • Difficultyhard
  • Weight3
  • Tagscomplexity, quicksort, pivot, worst-case
  • Exit code0
  • Timed outFalse
  • Context tokens8,104
  • LLM calls11
  • Tool calls12
  • Compactions0

Tests

C++ test drivers (executed stages only): correctness: passed; performance: passed.

passed
AD100-PRJ-01
taskcli: TSV task manager
20/20
100.0%
100.0%
3.5
3.50
9050
39.9s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight3.5
  • Tagscli, persistence, exit-codes, json-store
  • Exit code0
  • Timed outFalse
  • Context tokens9,050
  • LLM calls10
  • Tool calls13
  • Compactions0
passed
AD100-PRJ-02
INI config library
3/3 drivers
100.0%
100.0%
3
3.00
9366
30.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultymedium
  • Weight3
  • Tagsparsing, ini, api-design, exceptions
  • Exit code0
  • Timed outFalse
  • Context tokens9,366
  • LLM calls9
  • Tool calls10
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-PRJ-08
Markdown→HTML subset
25/26
96.2%
70.0%
22
15.40
34.2k
124.1s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight22
  • Tagsmarkdown, parser, html, escaping
  • Exit code0
  • Timed outFalse
  • Context tokens34,191
  • LLM calls46
  • Tool calls50
  • Compactions0

Failed tests

  • test_unmatched_markers_stay_literal
failed
AD100-PRJ-09
KV store: TTL + LRU + snapshot
22/23
95.7%
80.0%
4.5
3.60
63.1k
238.4s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight4.5
  • Tagskv-store, ttl, lru, persistence
  • Exit code0
  • Timed outFalse
  • Context tokens63,061
  • LLM calls148
  • Tool calls151
  • Compactions0

Failed tests

  • test_corrupt_beats_command_but_not_usage
passed
AD100-PRJ-10
cron next-fire calculator
21/21
100.0%
100.0%
3.5
3.50
49.4k
176.3s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight3.5
  • Tagscron, schedules, calendar, parsing
  • Exit code0
  • Timed outFalse
  • Context tokens49,415
  • LLM calls110
  • Tool calls143
  • Compactions0
passed
AD100-PRJ-11
access-log analyzer (stats + filters)
16/16
100.0%
100.0%
3.5
3.50
32.1k
106.0s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight3.5
  • Tagslogs, parsing, aggregation, cli
  • Exit code0
  • Timed outFalse
  • Context tokens32,073
  • LLM calls42
  • Tool calls78
  • Compactions0
failed
AD100-PRJ-12
HTTP/1.1 message parser
0/3 drivers
0.0%
0.0%
5
0.00
74.2k
220.3s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultymedium
  • Weight5
  • Tagshttp, parser, chunked, protocol
  • Exit code0
  • Timed outFalse
  • Context tokens74,232
  • LLM calls46
  • Tool calls47
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_basic
  • test_edge
  • test_errors
failed
AD100-PRJ-13
mustache-lite template engine
2/3 drivers
66.7%
60.0%
6.5
3.90
58.1k
208.2s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultymedium
  • Weight6.5
  • Tagstemplates, mustache, html-escaping, recursion
  • Exit code0
  • Timed outFalse
  • Context tokens58,095
  • LLM calls62
  • Tool calls63
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_sections
failed
AD100-PRJ-14
mini scripting language interpreter
14/21
66.7%
0.0%
10.5
0.00
120.3k
354.0s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight10.5
  • Tagsinterpreter, lexer, parser, tree-walker, cli
  • Exit code0
  • Timed outFalse
  • Context tokens120,258
  • LLM calls215
  • Tool calls216
  • Compactions1

Failed tests

  • test_list_mutation
  • test_syntax_errors
  • test_runtime_errors
  • test_call_depth
  • test_partial_output_kept
  • test_bools_nil_equality
  • test_lists
passed
AD100-PRJ-15
mini pytest (discovery, fixtures, report)
18/18
100.0%
100.0%
4.5
4.50
39.3k
125.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight4.5
  • Tagstest-runner, discovery, fixtures, reporting
  • Exit code0
  • Timed outFalse
  • Context tokens39,338
  • LLM calls77
  • Tool calls81
  • Compactions0
failed
AD100-PRJ-16
Game of Life engine (seeded, census)
9/11
81.8%
30.0%
3.5
1.05
23.9k
105.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight3.5
  • Tagsgame-of-life, simulation, prng, cycle-detection
  • Exit code0
  • Timed outFalse
  • Context tokens23,900
  • LLM calls41
  • Tool calls56
  • Compactions0

Failed tests

  • test_report_matches_oracle
  • test_births_deaths_sum_consistent
failed
AD100-PRJ-17
LZ77+RLE codec with checksum
1/4 drivers
25.0%
25.0%
4.5
1.12
59.1k
201.7s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight4.5
  • Tagscompression, lz77, rle, checksum, codec
  • Exit code0
  • Timed outFalse
  • Context tokens59,132
  • LLM calls29
  • Tool calls30
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_decode
  • test_errors
  • test_roundtrip
passed
AD100-PRJ-18
discrete-event simulator (deterministic)
4/4 drivers
100.0%
100.0%
3.5
3.50
26.6k
68.7s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight3.5
  • Tagssimulation, event-queue, deterministic-ordering
  • Exit code0
  • Timed outFalse
  • Context tokens26,614
  • LLM calls17
  • Tool calls18
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-PRJ-19
C++ mini test framework
4/4 drivers
100.0%
100.0%
3.5
3.50
23.0k
77.7s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight3.5
  • Tagstest-framework, macros, registry, fixtures
  • Exit code0
  • Timed outFalse
  • Context tokens23,012
  • LLM calls17
  • Tool calls18
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-PRJ-20
SQL subset engine (DDL/DML/SELECT/JOIN)
0/4 drivers
0.0%
0.0%
15.5
0.00
339.2k
934.7s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight15.5
  • Tagssql, parser, join, query-engine
  • Exit code0
  • Timed outFalse
  • Context tokens339,247
  • LLM calls254
  • Tool calls253
  • Compactions3

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_ddl_dml
  • test_errors
  • test_join
  • test_select
failed
AD100-PRJ-21
Indexed archive utility
0/8 drivers
0.0%
0.0%
30
0.00
263.0k
425.1s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight30
  • Tagsmini-project, idea-1, zip, indexed-access, posix-metadata
  • Exit code0
  • Timed outFalse
  • Context tokens262,980
  • LLM calls34
  • Tool calls33
  • Compactions2

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_core_metadata
  • test_core_selection
  • test_errors
  • test_errors_integrity
  • test_errors_structure
  • test_resources
  • test_resources_indexed
failed
AD100-PRJ-22
Silence-aware MP3 splitter
16/18
88.9%
20.0%
11.5
2.30
151.4k
391.2s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight11.5
  • Tagsmini-project, idea-2
  • Exit code0
  • Timed outFalse
  • Context tokens151,443
  • LLM calls41
  • Tool calls42
  • Compactions1

Failed tests

  • test_core_mixed_bitrate_padding_and_modes
  • test_errors_plan_argument_validation
failed
AD100-PRJ-23
FAT32/VFAT filesystem recovery
3/24
12.5%
0.0%
30
0.00
526.0k
935.7s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight30
  • Tagsmini-project, idea-3, fat32, vfat, reverse-engineering
  • Exit code0
  • Timed outFalse
  • Context tokens526,019
  • LLM calls89
  • Tool calls100
  • Compactions5

Failed tests

  • test_core_independent_trees[41]
  • test_core_independent_trees[1337]
  • test_core_independent_trees[2027]
  • test_core_root_and_lfn_across_fragmented_clusters
  • test_core_unicode_short_escape_and_full_lfn_parts
  • test_core_deep_directory_tree
  • test_core_reserved_high_bits_and_inactive_fat
  • test_core_deleted_entries_volume_label_and_empty_directory
  • test_errors_geometry[fat16]
  • test_errors_geometry[small]
  • test_errors_geometry[fat-capacity]
  • test_errors_geometry[active]
  • test_errors_geometry[fsinfo]
  • test_errors_geometry[truncated]
  • test_errors_chain_markers_and_file_size
  • test_errors_cycles_and_cross_links
  • test_errors_lfn_records
  • test_errors_namespace_and_depth_limits
  • test_errors_mirror_disagreement_and_invalid_alias
  • test_resources_large_fragmented_file
  • test_resources_many_files_standalone_and_memory
passed
AD100-PRJ-24
Image similarity and grouping
17/17
100.0%
100.0%
5
5.00
63.1k
174.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight5
  • Tagsmini-project, idea-4
  • Exit code0
  • Timed outFalse
  • Context tokens63,082
  • LLM calls24
  • Tool calls25
  • Compactions0
failed
AD100-PRJ-25
Binary delta generator and applier
1/3 drivers
33.3%
20.0%
6.5
1.30
158.1k
730.5s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight6.5
  • Tagsmini-project, idea-5
  • Exit code0
  • Timed outFalse
  • Context tokens158,125
  • LLM calls63
  • Tool calls65
  • Compactions1

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_errors
failed
AD100-PRJ-26
Incremental build tool
36/40
90.0%
80.0%
10
8.00
55.3k
187.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight10
  • Tagsmini-project, idea-6
  • Exit code0
  • Timed outFalse
  • Context tokens55,341
  • LLM calls28
  • Tool calls29
  • Compactions0

Failed tests

  • test_errors_unknown_dependency
  • test_errors_empty_spec
  • test_errors_digest_requires_bytes
  • test_errors_files_missing_path
failed
AD100-PRJ-27
ELF executable inspector
43/79
54.4%
0.0%
21
0.00
111.8k
214.9s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight21
  • Tagsmini-project, idea-7, elf64, binary-recovery, stdlib
  • Exit code0
  • Timed outFalse
  • Context tokens111,822
  • LLM calls45
  • Tool calls52
  • Compactions1

Failed tests

  • test_core_reports[multiple-symbols]
  • test_core_reports[rel-relocations]
  • test_core_absent_names[sections]
  • test_core_absent_names[symbols]
  • test_core_absent_names[relocations]
  • test_core_no_tables
  • test_errors_type_header_bounds[sections]
  • test_errors_type_header_bounds[symbols]
  • test_errors_type_header_bounds[relocations]
  • test_errors_type_header_bounds[segments]
  • test_errors_sections[payload]
  • test_errors_sections[name-type]
  • test_errors_sections[name-end]
  • test_errors_sections[name-start]
  • test_errors_symbols[stride]
  • test_errors_symbols[info]
  • test_errors_symbols[name-range]
  • test_errors_symbols[section-range]
  • test_errors_symbols[string-end]
  • test_errors_symbols[string-start]
  • test_errors_relocations[link-range]
  • test_errors_relocations[link-type]
  • test_errors_relocations[target]
  • test_errors_relocations[symbol-range]
  • test_errors_relocations[linked-stride]
  • test_errors_relocations[linked-string]
  • test_errors_segments
  • test_errors_review_boundaries[null-as-load]
  • test_errors_review_boundaries[null-as-note]
  • test_errors_review_boundaries[empty-name-nonzero]
  • test_errors_review_boundaries[empty-name-bad-type]
  • test_errors_review_boundaries[empty-name-bounds]
  • test_errors_review_boundaries[no-table-nonzero-symbol]
  • test_errors_review_boundaries[no-table-bad-link]
  • test_errors_review_boundaries[no-table-wrong-type]
  • test_resources_untrusted_sizes
failed
AD100-PRJ-28
Dependency-aware package resolver
28/29
96.5%
40.0%
9
3.60
60.0k
218.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight9
  • Tagsmini-project, idea-8
  • Exit code0
  • Timed outFalse
  • Context tokens60,045
  • LLM calls30
  • Tool calls30
  • Compactions0

Failed tests

  • test_core_conflict_with_constraint
passed
AD100-PRJ-29
RAW Bayer development pipeline
3/3 drivers
100.0%
100.0%
7
7.00
33.1k
62.7s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight7
  • Tagsmini-project, idea-9
  • Exit code0
  • Timed outFalse
  • Context tokens33,122
  • LLM calls14
  • Tool calls15
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-PRJ-30
Image registration (translation)
2/3 drivers
66.7%
40.0%
3.5
1.40
73.0k
234.9s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight3.5
  • Tagsmini-project, idea-10
  • Exit code0
  • Timed outFalse
  • Context tokens72,990
  • LLM calls49
  • Tool calls50
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
failed
AD100-PRJ-31
Score language to WAV synthesizer
0/12
0.0%
0.0%
28
0.00
37.1k
120.8s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight28
  • Tagsmini-project, idea-11
  • Exit code0
  • Timed outFalse
  • Context tokens37,074
  • LLM calls3
  • Tool calls4
  • Compactions0

Failed tests

  • test_core_reference_match
  • test_core_voice_continuation
  • test_core_tempo_per_voice
  • test_core_envelope_zero_at_end
  • test_core_quantization_bounds
  • test_core_all_waves_present
  • test_errors_syntax
  • test_errors_input_type
  • test_errors_conflicting_rate
  • test_errors_nan_values
  • test_resources_long_score
  • test_resources_many_voices
failed
AD100-PRJ-32
Fixed-timestep 2D physics sandbox
11/12
91.7%
80.0%
9.5
7.60
33.7k
99.7s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight9.5
  • Tagsmini-project, idea-12
  • Exit code0
  • Timed outFalse
  • Context tokens33,695
  • LLM calls21
  • Tool calls22
  • Compactions0

Failed tests

  • test_errors_numeric_ranges
failed
AD100-PRJ-33
Columnar data compressor
1/3 drivers
33.3%
20.0%
30
6.00
140.4k
446.2s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight30
  • Tagsmini-project, idea-13
  • Exit code0
  • Timed outFalse
  • Context tokens140,406
  • LLM calls107
  • Tool calls109
  • Compactions1

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_errors
failed
AD100-PRJ-34
DTMF decoder
0/13
0.0%
0.0%
18.5
0.00
43.7k
136.7s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight18.5
  • Tagsmini-project, idea-14
  • Exit code0
  • Timed outFalse
  • Context tokens43,659
  • LLM calls4
  • Tool calls6
  • Compactions0

Failed tests

  • test_core_all_twelve_symbols
  • test_core_timing_frames
  • test_core_quiet_tone_still_found
  • test_core_very_quiet_tone_ignored
  • test_core_noise_tolerant
  • test_core_distractor_frequency_ignored
  • test_core_short_blip_rejected
  • test_core_gap_bridging
  • test_core_sample_rate_16000
  • test_errors_bad_container
  • test_errors_bad_format
  • test_errors_truncated_chunks
  • test_resources_one_minute_audio
failed
AD100-PRJ-35
Mobile-robot path planner
11/12
91.7%
80.0%
9.5
7.60
13.4k
32.6s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight9.5
  • Tagsmini-project, idea-15
  • Exit code0
  • Timed outFalse
  • Context tokens13,354
  • LLM calls12
  • Tool calls14
  • Compactions0

Failed tests

  • test_errors_start_goal
failed
AD100-PRJ-36
Two-link robot-arm controller
13/14
92.9%
80.0%
23
18.40
36.5k
96.7s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight23
  • Tagsmini-project, idea-16
  • Exit code0
  • Timed outFalse
  • Context tokens36,514
  • LLM calls23
  • Tool calls23
  • Compactions0

Failed tests

  • test_errors_configs
failed
AD100-PRJ-37
Fiducial-marker detector
—
—
0.0%
12.5
0.00
37.3k
118.7s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight12.5
  • Tagsmini-project, idea-17
  • Exit code0
  • Timed outFalse
  • Context tokens37,343
  • LLM calls3
  • Tool calls5
  • Compactions0

Tests

C++ test drivers: unavailable because the build failed or timed out; tests did not run.

failed
AD100-PRJ-38
Multi-object tracker
9/11
81.8%
20.0%
15.5
3.10
69.2k
208.9s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight15.5
  • Tagsmini-project, idea-18
  • Exit code0
  • Timed outFalse
  • Context tokens69,235
  • LLM calls40
  • Tool calls40
  • Compactions0

Failed tests

  • test_core_crossing_identity_swap
  • test_errors_frames
failed
AD100-PRJ-39
Parametric audio equalizer
1/3 drivers
33.3%
20.0%
28
5.60
69.2k
241.9s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight28
  • Tagsmini-project, idea-19
  • Exit code0
  • Timed outFalse
  • Context tokens69,242
  • LLM calls39
  • Tool calls40
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_errors
failed
AD100-PRJ-40
Barcode scanner (EAN-13)
—
—
0.0%
24
0.00
44.8k
128.8s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight24
  • Tagsmini-project, idea-20
  • Exit code0
  • Timed outFalse
  • Context tokens44,761
  • LLM calls9
  • Tool calls11
  • Compactions0

Tests

C++ test drivers: results unavailable or incomplete.

failed
AD100-PRJ-41
JSONL chat-log to Markdown converter
17/32
53.1%
0.0%
30
0.00
125.5k
343.1s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight30
  • Tagsmini-project, idea-21
  • Exit code0
  • Timed outFalse
  • Context tokens125,541
  • LLM calls12
  • Tool calls20
  • Compactions1

Failed tests

  • test_core_width_none_keeps_spacing
  • test_core_long_word_not_split
  • test_core_width_one
  • test_core_fence_with_language_and_wrap_around
  • test_core_unterminated_fence_runs_to_end
  • test_core_tool_result_and_empty_text
  • test_core_message_default_text
  • test_core_note_empty_text_is_prefix_only
  • test_core_unicode_preserved
  • test_core_one_shot_iterator_input
  • test_core_wrapping_matches_reference_on_fuzz
  • test_errors_unknown_type
  • test_errors_tool_call_fields
  • test_errors_text_type
  • test_resources_many_records
failed
AD100-PRJ-42
RFC 3986 URL utility
81/129
62.8%
0.0%
30
0.00
165.0k
310.9s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight30
  • Tagsmini-project, idea-22, rfc3986, native-oracle
  • Exit code0
  • Timed outFalse
  • Context tokens165,019
  • LLM calls133
  • Tool calls342
  • Compactions1

Failed tests

  • test_core_rfc3986_resolution[/g-http://a/g]
  • test_core_rfc3986_resolution[-http://a/b/c/d;p?q]
  • test_core_rfc3986_resolution[.-http://a/b/c/]
  • test_core_rfc3986_resolution[..-http://a/b/]
  • test_core_rfc3986_resolution[/./g-http://a/g]
  • test_core_rfc3986_resolution[/../g-http://a/g]
  • test_core_rfc3986_resolution[./g/.-http://a/b/c/g/]
  • test_core_rfc3986_resolution[g?y/./x-http://a/b/c/g?y/./x]
  • test_core_rfc3986_resolution[g?y/../x-http://a/b/c/g?y/../x]
  • test_core_rfc3986_resolution[g#s/./x-http://a/b/c/g#s/./x]
  • test_core_rfc3986_resolution[g#s/../x-http://a/b/c/g#s/../x]
  • test_core_decode_replacement
  • test_core_normalize_literals[WSS://U%73er@%45XAMPLE:00443/a//b/%2E/../c?%2f=%41#%7e-wss://User@example/a//b/c?%2F=A#~]
  • test_core_normalize_literals[http://H%2fX:00081/?#-http://h%2Fx:81/?#]
  • test_core_normalize_literals[file:///a/../../b-file:///b]
  • test_core_empty_authority_userinfo_and_scheme
  • test_core_utf8_and_ipv6_profile
  • test_core_decode_maximal_subparts[caf\xe9%2B+-caf\xe9++]
  • test_core_query_delimiters_and_types
  • test_errors_malformed_url[http://h/\n]
  • test_errors_malformed_url[http://h/\t]
  • test_errors_malformed_url[http://h/\x00]
  • test_errors_malformed_url[http://h/\x7f]
  • test_errors_malformed_url[http://h/a\\b]
  • test_errors_malformed_url[http://h/<x>]
  • test_errors_malformed_url[http://h/[x]]
  • test_errors_malformed_url[http://h/%]
  • test_errors_malformed_url[http://h/%2]
  • test_errors_malformed_url[http://h/%zz]
  • test_errors_malformed_url[http://h/?x=%gg]
  • test_errors_malformed_url[http://h/#%xy]
  • test_errors_malformed_url[http://u%zz@h/]
  • test_errors_malformed_url[http://u@v@h/]
  • test_errors_api_types_and_escapes[parse-args4-kwargs4]
  • test_errors_api_types_and_escapes[encode-args7-kwargs7]
  • test_errors_api_types_and_escapes[encode-args9-kwargs9]
  • test_errors_api_types_and_escapes[encode-args10-kwargs10]
  • test_errors_api_types_and_escapes[encode-args11-kwargs11]
  • test_errors_api_types_and_escapes[decode-args12-kwargs12]
  • test_errors_api_types_and_escapes[set_query-args22-kwargs22]
  • test_errors_api_types_and_escapes[set_query-args23-kwargs23]
  • test_errors_api_types_and_escapes[set_query-args24-kwargs24]
  • test_errors_api_types_and_escapes[set_query-args25-kwargs25]
  • test_errors_api_types_and_escapes[set_query-args26-kwargs26]
  • test_errors_all_input_length_limits
  • test_resources_parse_normalize_100000
  • test_resources_encode_decode_100000
  • test_resources_long_zero_port
passed
AD100-PRJ-43
Nonlinear least-squares solver
3/3 drivers
100.0%
100.0%
7.5
7.50
63.6k
200.8s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight7.5
  • Tagsmini-project, idea-23
  • Exit code0
  • Timed outFalse
  • Context tokens63,595
  • LLM calls19
  • Tool calls22
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-PRJ-44
IBAN and credit-card validator
8/9
88.9%
40.0%
6
2.40
27.3k
68.7s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight6
  • Tagsmini-project, idea-24
  • Exit code0
  • Timed outFalse
  • Context tokens27,324
  • LLM calls27
  • Tool calls28
  • Compactions0

Failed tests

  • test_core_all_countries
failed
AD100-PRJ-45
Arbitrary-precision integer arithmetic
1/3 drivers
33.3%
20.0%
14.5
2.90
70.4k
1202.1s
DEADLINE

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight14.5
  • Tagsmini-project, idea-25
  • Exit code0
  • Timed outFalse
  • Context tokens70,358
  • LLM calls42
  • Tool calls44
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_resources
passed
AD100-PRJ-47
Recover a hidden phrase from an executable
6/6
100.0%
100.0%
5.5
5.50
557.4k
972.8s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyexpert
  • Weight5.5
  • Tagsmini-project, idea-27
  • Exit code0
  • Timed outFalse
  • Context tokens557,359
  • LLM calls180
  • Tool calls195
  • Compactions6
failed
AD100-PRJ-48
Black-box image transformation utility clone
—
—
0.0%
30
0.00
444.4k
779.5s
PI_EXIT

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight30
  • Tagsmini-project, idea-28
  • Exit code0
  • Timed outFalse
  • Context tokens444,382
  • LLM calls82
  • Tool calls87
  • Compactions4

Tests

C++ test drivers: results unavailable or incomplete.

failed
AD100-PRJ-49
Closed-loop differential-drive line follower
13/21
61.9%
40.0%
13.5
5.40
25.5k
71.7s

Challenge

  • Observed modelsunsloth/Qwen3.6-35B-A3B-MTP-GGUF:UD-Q4_K_XL
  • Pillarproject
  • Languagepython
  • Difficultyexpert
  • Weight13.5
  • Tagsmini-project, idea-29
  • Exit code0
  • Timed outFalse
  • Context tokens25,525
  • LLM calls28
  • Tool calls30
  • Compactions0

Failed tests

  • test_core_hidden_track_completion_and_recovery[1]
  • test_core_hidden_track_completion_and_recovery[2]
  • test_core_hidden_track_completion_and_recovery[3]
  • test_core_hidden_track_completion_and_recovery[4]
  • test_core_hidden_track_completion_and_recovery[5]
  • test_core_hidden_track_completion_and_recovery[6]
  • test_core_hidden_track_completion_and_recovery[8]
  • test_core_hidden_track_completion_and_recovery[9]