Apexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M

Observed from session logs: Apexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M

run Apex-35B-V1.0-Q4 · requested model default · generated 2026-11-13T07:42:03+00:00 · 78 challenges

22passed
56failed
0error
49.6%avg tests
142.37 / 744.00final score
19.1%of max
6.4Mcontext tokens
81.6kavg tokens/task
31compactions
passed
AD100-ALG-02
Dijkstra shortest paths
2/2 drivers
100.0%
100.0%
3
3.00
31.4k
72.7s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyeasy
  • Weight3
  • Tagsgraphs, dijkstra, priority-queue
  • Exit code0
  • Timed outFalse
  • Context tokens31,441
  • LLM calls26
  • Tool calls28
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-03
JSON parser from scratch
43/43
100.0%
100.0%
3
3.00
53.8k
901.9s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultyeasy
  • Weight3
  • Tagsparsing, recursive-descent, unicode
  • Exit code0
  • Timed outFalse
  • Context tokens53,840
  • LLM calls23
  • Tool calls25
  • Compactions0
failed
AD100-ALG-16
RFC-4180 CSV parser from scratch
4/6
66.7%
45.0%
3.5
1.57
41.4k
193.8s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultyeasy
  • Weight3.5
  • Tagsparsing, csv, purity
  • Exit code0
  • Timed outFalse
  • Context tokens41,437
  • LLM calls20
  • Tool calls20
  • Compactions0

Failed tests

  • test_edge_quoting_and_separators
  • test_property_vs_stdlib
failed
AD100-ALG-19
S-expression reader/writer
0/4
0.0%
0.0%
3.5
0.00
36.0k
158.9s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultyeasy
  • Weight3.5
  • Tagsparsing, s-expression, recursion-limit
  • Exit code0
  • Timed outFalse
  • Context tokens36,010
  • LLM calls3
  • Tool calls3
  • Compactions0

Failed tests

  • test_basic_parse_dump
  • test_edge_errors_and_atoms
  • test_property_random_roundtrip
  • test_scale_depth_5000
passed
AD100-ALG-20
word ladder shortest chain
4/4
100.0%
100.0%
3
3.00
20.3k
481.2s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultyeasy
  • Weight3
  • Tagsgraph, bfs, lexicographic
  • Exit code0
  • Timed outFalse
  • Context tokens20,343
  • LLM calls19
  • Tool calls21
  • Compactions0
passed
AD100-ALG-22
strongly connected components (Tarjan)
3/3 drivers
100.0%
100.0%
3
3.00
51.9k
205.9s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyeasy
  • Weight3
  • Tagsgraph, scc, tarjan
  • Exit code0
  • Timed outFalse
  • Context tokens51,878
  • LLM calls28
  • Tool calls29
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-ALG-23
segment tree: point update + range sum
0/3 drivers
0.0%
0.0%
3
0.00
35.9k
136.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyeasy
  • Weight3
  • Tagsdata-structure, segment-tree
  • Exit code0
  • Timed outFalse
  • Context tokens35,873
  • LLM calls3
  • Tool calls4
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_basic
  • test_edge
  • test_scale
passed
AD100-ALG-26
sparse table RMQ
4/4 drivers
100.0%
100.0%
3
3.00
8073
16.6s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyeasy
  • Weight3
  • Tagsdata-structure, rmq, sparse-table
  • Exit code0
  • Timed outFalse
  • Context tokens8,073
  • LLM calls9
  • Tool calls8
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-ALG-27
convex hull (monotone chain)
0/4 drivers
0.0%
0.0%
3
0.00
36.8k
136.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyeasy
  • Weight3
  • Tagsgeometry, convex-hull
  • Exit code0
  • Timed outFalse
  • Context tokens36,791
  • LLM calls4
  • Tool calls5
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_basic
  • test_edge
  • test_property
  • test_scale
failed
AD100-ALG-28
min-cost max-flow
0/3 drivers
0.0%
0.0%
3
0.00
36.1k
142.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyeasy
  • Weight3
  • Tagsflow, min-cost-flow, optimization
  • Exit code0
  • Timed outFalse
  • Context tokens36,115
  • LLM calls4
  • Tool calls4
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_basic
  • test_property
  • test_scale
failed
AD100-ALG-29
glob matcher (*, ?, classes)
0/5
0.0%
0.0%
6
0.00
36.0k
144.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultyeasy
  • Weight6
  • Tagspattern-matching, backtracking
  • Exit code0
  • Timed outFalse
  • Context tokens36,046
  • LLM calls3
  • Tool calls4
  • Compactions0

Failed tests

  • test_basic_patterns
  • test_question_and_classes
  • test_edge_cases
  • test_property_vs_fnmatch
  • test_scale_many_stars_long_text
passed
AD100-ALG-30
matrix-chain multiplication
5/5
100.0%
100.0%
3
3.00
58.8k
210.9s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultyeasy
  • Weight3
  • Tagsdp, parenthesization
  • Exit code0
  • Timed outFalse
  • Context tokens58,834
  • LLM calls40
  • Tool calls40
  • Compactions0
passed
AD100-ALG-31
Huffman coding round-trip
6/6
100.0%
100.0%
3
3.00
41.4k
481.2s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultyeasy
  • Weight3
  • Tagshuffman, compression, round-trip
  • Exit code0
  • Timed outFalse
  • Context tokens41,368
  • LLM calls23
  • Tool calls24
  • Compactions0
failed
AD100-ALG-33
big-decimal arithmetic (strings)
0/4 drivers
0.0%
0.0%
3.5
0.00
36.6k
138.7s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyeasy
  • Weight3.5
  • Tagsbignum, arithmetic, strings
  • Exit code0
  • Timed outFalse
  • Context tokens36,599
  • LLM calls3
  • Tool calls4
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_basic
  • test_edge
  • test_property
  • test_scale
failed
AD100-ALG-34
treap: k-th order statistics
0/4 drivers
0.0%
0.0%
4.5
0.00
35.9k
144.7s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyeasy
  • Weight4.5
  • Tagstreap, order-statistics, balanced-bst
  • Exit code0
  • Timed outFalse
  • Context tokens35,931
  • LLM calls3
  • Tool calls2
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_basic
  • test_edge
  • test_property
  • test_scale
passed
AD100-ALG-35
persistent segment tree (versions + k-th)
4/4 drivers
100.0%
100.0%
3
3.00
75.2k
320.0s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyeasy
  • Weight3
  • Tagspersistent-segment-tree, functional-data-structure, versions
  • Exit code0
  • Timed outFalse
  • Context tokens75,242
  • LLM calls62
  • Tool calls61
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-DBG-11
API contract: exception + aliasing
16/16
100.0%
100.0%
3
3.00
8856
32.7s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyeasy
  • Weight3
  • Tagsapi-contract, exception-type, aliasing, defensive-copy
  • Exit code0
  • Timed outFalse
  • Context tokens8,856
  • LLM calls9
  • Tool calls9
  • Compactions0
failed
AD100-DBG-12
int overflow in size arithmetic
3/4 drivers
75.0%
40.0%
3.5
1.40
83.7k
274.0s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagecpp
  • Difficultyeasy
  • Weight3.5
  • Tagsinteger-overflow, size-arithmetic, validation
  • Exit code0
  • Timed outFalse
  • Context tokens83,693
  • LLM calls55
  • Tool calls59
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_bugs
failed
AD100-DBG-13
size_t underflow on singleton/empty
1/4 drivers
25.0%
0.0%
7.5
0.00
20.9k
481.4s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagecpp
  • Difficultymedium
  • Weight7.5
  • Tagssize-t, underflow, empty-singleton
  • Exit code0
  • Timed outFalse
  • Context tokens20,885
  • LLM calls17
  • Tool calls19
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_bugs
  • test_bugs_public
  • test_regression
passed
AD100-DBG-15
hash-order nondeterminism
12/12
100.0%
100.0%
3
3.00
6472
31.7s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyeasy
  • Weight3
  • Tagshash-order, determinism, nondeterminism, sorting
  • Exit code0
  • Timed outFalse
  • Context tokens6,472
  • LLM calls15
  • Tool calls15
  • Compactions0
passed
AD100-DBG-17
wrong exception type on error path
4/4 drivers
100.0%
100.0%
4.5
4.50
55.1k
481.5s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagecpp
  • Difficultyeasy
  • Weight4.5
  • Tagsexception-contract, parsing, error-path
  • Exit code0
  • Timed outFalse
  • Context tokens55,065
  • LLM calls19
  • Tool calls21
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-DBG-19
multiple interacting bug classes
19/19
100.0%
100.0%
3
3.00
32.9k
153.8s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyeasy
  • Weight3
  • Tagsmulti-bug, mutable-default, off-by-one, exception-contract, aliasing
  • Exit code0
  • Timed outFalse
  • Context tokens32,921
  • LLM calls42
  • Tool calls42
  • Compactions0
failed
AD100-DBG-20
path traversal + expression injection
34/50
68.0%
0.0%
3
0.00
167.3k
481.2s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyeasy
  • Weight3
  • Tagssecurity, path-traversal, injection, input-validation
  • Exit code0
  • Timed outFalse
  • Context tokens167,293
  • LLM calls360
  • Tool calls363
  • Compactions1

Failed tests

  • test_read_entry_rejects_bad_names[..]
  • test_read_entry_rejects_bad_names[.]
  • test_evaluate_arithmetic[1 + 2 * 3-7]
  • test_evaluate_arithmetic[(1 + 2) * 3-9]
  • test_evaluate_arithmetic[10 / 3-3]
  • test_evaluate_arithmetic[-10 / 3--4]
  • test_evaluate_arithmetic[10 % 3-1]
  • test_evaluate_arithmetic[-7 % 3-2]
  • test_evaluate_arithmetic[2 * 3 % 4-2]
  • test_evaluate_arithmetic[100 / 10 / 2-5]
  • test_evaluate_arithmetic[((2))-2]
  • test_evaluate_malformed_allowed_chars[1 / 0 ]
  • test_evaluates_arithmetic
  • test_evaluate_is_pure_and_reusable
  • test_evaluate_large_values
  • test_evaluates_arithmetic
passed
AD100-DBG-21
unseeded RNG / wall-clock dependence
19/19
100.0%
100.0%
3
3.00
33.0k
128.8s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyeasy
  • Weight3
  • Tagsdeterminism, rng, wall-clock, reproducibility
  • Exit code0
  • Timed outFalse
  • Context tokens32,961
  • LLM calls14
  • Tool calls14
  • Compactions0
passed
AD100-DBG-23
erase-while-iterating + related bugs
4/4 drivers
100.0%
100.0%
3
3.00
39.5k
153.8s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagecpp
  • Difficultyeasy
  • Weight3
  • Tagserase-while-iterating, vector, iterator, off-by-one
  • Exit code0
  • Timed outFalse
  • Context tokens39,452
  • LLM calls29
  • Tool calls31
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-DBG-26
snapshot restore service
22/24
91.7%
35.0%
15.5
5.42
37.7k
135.8s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight15.5
  • Tagssecurity-review, cve-derived, filesystem, symlinks, transactional
  • Exit code0
  • Timed outFalse
  • Context tokens37,667
  • LLM calls118
  • Tool calls119
  • Compactions0

Failed tests

  • test_security_parent_after_symlink[bridge/../secret]
  • test_security_parent_after_symlink[/r/bridge/../secret]
passed
AD100-DBG-27
verified block ingestion
44/44
100.0%
100.0%
10
10.00
64.8k
279.9s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight10
  • Tagssecurity-review, cve-derived, integrity, streaming, short-reads
  • Exit code0
  • Timed outFalse
  • Context tokens64,767
  • LLM calls28
  • Tool calls32
  • Compactions0
passed
AD100-DBG-28
indexed document reader
26/26
100.0%
100.0%
3
3.00
143.5k
566.3s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyeasy
  • Weight3
  • Tagssecurity-review, cve-derived, parser, progress, random-access
  • Exit code0
  • Timed outFalse
  • Context tokens143,512
  • LLM calls65
  • Tool calls68
  • Compactions1
failed
AD100-DBG-31
stylesheet inspection pipeline
26/33
78.8%
35.0%
22.5
7.87
210.3k
718.5s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyexpert
  • Weight22.5
  • Tagssecurity-review, cve-derived, tokenizer, escaping, parser-differential
  • Exit code0
  • Timed outFalse
  • Context tokens210,327
  • LLM calls78
  • Tool calls77
  • Compactions2

Failed tests

  • test_security_even_backslashes_terminate[2]
  • test_security_even_backslashes_terminate[4]
  • test_security_even_backslashes_terminate[6]
  • test_security_even_backslashes_terminate[8]
  • test_security_hidden_declaration_not_consumed[2]
  • test_security_hidden_declaration_not_consumed[4]
  • test_security_hidden_declaration_not_consumed[6]
failed
AD100-DBG-33
multipart metadata processing
0/2
0.0%
0.0%
13
0.00
65.6k
1440.4s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultymedium
  • Weight13
  • Tagssecurity-review, cve-derived, regex, complexity, multipart
  • Exit code0
  • Timed outFalse
  • Context tokens65,639
  • LLM calls18
  • Tool calls24
  • Compactions0

Failed tests

  • test_public
  • test_regression_metadata
failed
AD100-DBG-34
URL text and form gateway
16/29
55.2%
0.0%
6
0.00
127.7k
721.6s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultymedium
  • Weight6
  • Tagssecurity-review, cve-derived, percent-encoding, utf8, complexity
  • Exit code0
  • Timed outFalse
  • Context tokens127,658
  • LLM calls99
  • Tool calls108
  • Compactions1

Failed tests

  • test_unicode
  • test_regression_utf8[%E2%82%AC-\u20ac]
  • test_regression_utf8[%F0%9F%98%80-\U0001f600]
  • test_regression_utf8[%c3%28-%c3(]
  • test_regression_plus_and_encoded_delimiters
  • test_regression_roundtrips[\u96ea/\xe9]
  • test_regression_roundtrips[\U0001f600]
  • test_regression_random_independent_utf8_reference
  • test_security_no_cascading[%2541x%41%zz-%41xA%zz]
  • test_security_no_cascading[%252Bx%2B-%2Bx+]
  • test_security_no_cascading[%25C3%25A9x%C3%A9-%C3%A9x\xe9]
  • test_security_many_distinct_runs
  • test_security_form_boundaries
failed
AD100-DBG-35
schema identifier registry
9/24
37.5%
0.0%
10.5
0.00
37.8k
140.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultymedium
  • Weight10.5
  • Tagssecurity-review, cve-derived, asn1, canonicalization, integer-bounds
  • Exit code0
  • Timed outFalse
  • Context tokens37,827
  • LLM calls4
  • Tool calls9
  • Compactions0

Failed tests

  • test_regression_random_reference
  • test_regression_malformed_wire[\x80\x00]
  • test_regression_malformed_wire[\x81]
  • test_regression_import_atomic_export_remove
  • test_security_invalid_arcs[0.40]
  • test_security_invalid_arcs[0.42.840.113549.1.1.1]
  • test_security_invalid_arcs[1.40.1]
  • test_security_invalid_arcs[3.2.840]
  • test_security_invalid_arcs[4294977127.18.840.113549.1.1.1]
  • test_security_invalid_arcs[2.4294967216]
  • test_security_no_registry_alias_from_invalid_text
  • test_security_first_subidentifier_multibyte[2.48-8100]
  • test_security_first_subidentifier_multibyte[2.100-8134]
  • test_security_first_subidentifier_multibyte[2.999.3-883703]
  • test_security_first_subidentifier_multibyte[2.4294967215-8fffffff7f]
failed
AD100-DBG-36
Walk or drive to the car wash
0/1
0.0%
0.0%
4
0.00
3224
6.6s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyeasy
  • Weight4
  • Tagsreasoning, deliverable, file-io, single-word-answer
  • Exit code0
  • Timed outFalse
  • Context tokens3,224
  • LLM calls4
  • Tool calls3
  • Compactions0

Failed tests

  • test_answer_is_drive
passed
AD100-DBG-37
Which is larger, 9.11 or 9.9?
1/1
100.0%
100.0%
3
3.00
3249
4.6s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyeasy
  • Weight3
  • Tagsreasoning, numeric-literals, deliverable, file-io
  • Exit code0
  • Timed outFalse
  • Context tokens3,249
  • LLM calls4
  • Tool calls3
  • Compactions0
passed
AD100-OPT-17
quicksort worst-case pivot
2/2 drivers
100.0%
100.0%
3
3.00
58.9k
230.9s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillaroptimization
  • Languagecpp
  • Difficultyeasy
  • Weight3
  • Tagscomplexity, quicksort, pivot, worst-case
  • Exit code0
  • Timed outFalse
  • Context tokens58,922
  • LLM calls27
  • Tool calls28
  • Compactions0

Tests

C++ test drivers (executed stages only): correctness: passed; performance: passed.

failed
AD100-PRJ-01
taskcli: TSV task manager
0/20
0.0%
0.0%
3.5
0.00
37.3k
146.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyeasy
  • Weight3.5
  • Tagscli, persistence, exit-codes, json-store
  • Exit code0
  • Timed outFalse
  • Context tokens37,291
  • LLM calls3
  • Tool calls6
  • Compactions0

Failed tests

  • test_add_defaults_tag
  • test_ids_increment_and_list_sorted
  • test_done_idempotent
  • test_tag_filter
  • test_empty_store_list_is_quiet_success
  • test_titles_with_special_chars
  • test_unknown_command
  • test_add_missing_title
  • test_add_extra_args
  • test_add_tag_without_value
  • test_add_empty_title
  • test_file_flag_after_command_is_usage_error
  • test_done_missing_arg
  • test_done_unknown_id
  • test_corrupt_store_invalid_json
  • test_corrupt_store_bad_schema
  • test_ids_continue_across_invocations
  • test_file_flag_creates_isolated_stores
  • test_store_schema_after_operations
  • test_done_does_not_reorder
passed
AD100-PRJ-02
INI config library
3/3 drivers
100.0%
100.0%
3
3.00
53.0k
225.9s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyeasy
  • Weight3
  • Tagsparsing, ini, api-design, exceptions
  • Exit code0
  • Timed outFalse
  • Context tokens53,049
  • LLM calls41
  • Tool calls41
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-PRJ-08
Markdown→HTML subset
24/26
92.3%
70.0%
22
15.40
74.7k
277.9s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight22
  • Tagsmarkdown, parser, html, escaping
  • Exit code0
  • Timed outFalse
  • Context tokens74,651
  • LLM calls68
  • Tool calls80
  • Compactions0

Failed tests

  • test_unmatched_markers_stay_literal
  • test_asterisks_inside_code_span_untouched
failed
AD100-PRJ-09
KV store: TTL + LRU + snapshot
22/23
95.7%
75.0%
4.5
3.38
52.8k
211.9s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyeasy
  • Weight4.5
  • Tagskv-store, ttl, lru, persistence
  • Exit code0
  • Timed outFalse
  • Context tokens52,778
  • LLM calls30
  • Tool calls32
  • Compactions0

Failed tests

  • test_expire_then_ttl_counts_down
passed
AD100-PRJ-10
cron next-fire calculator
21/21
100.0%
100.0%
3.5
3.50
51.4k
190.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyeasy
  • Weight3.5
  • Tagscron, schedules, calendar, parsing
  • Exit code0
  • Timed outFalse
  • Context tokens51,445
  • LLM calls28
  • Tool calls32
  • Compactions0
failed
AD100-PRJ-11
access-log analyzer (stats + filters)
15/16
93.8%
70.0%
3.5
2.45
65.6k
243.9s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyeasy
  • Weight3.5
  • Tagslogs, parsing, aggregation, cli
  • Exit code0
  • Timed outFalse
  • Context tokens65,624
  • LLM calls56
  • Tool calls58
  • Compactions0

Failed tests

  • test_usage_errors
failed
AD100-PRJ-12
HTTP/1.1 message parser
0/3 drivers
0.0%
0.0%
5
0.00
37.1k
146.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyeasy
  • Weight5
  • Tagshttp, parser, chunked, protocol
  • Exit code0
  • Timed outFalse
  • Context tokens37,104
  • LLM calls4
  • Tool calls4
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_basic
  • test_edge
  • test_errors
failed
AD100-PRJ-13
mustache-lite template engine
0/3 drivers
0.0%
0.0%
6.5
0.00
37.4k
142.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultymedium
  • Weight6.5
  • Tagstemplates, mustache, html-escaping, recursion
  • Exit code0
  • Timed outFalse
  • Context tokens37,424
  • LLM calls4
  • Tool calls4
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_basic
  • test_edge
  • test_sections
failed
AD100-PRJ-14
mini scripting language interpreter
2/21
9.5%
0.0%
10.5
0.00
37.7k
148.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight10.5
  • Tagsinterpreter, lexer, parser, tree-walker, cli
  • Exit code0
  • Timed outFalse
  • Context tokens37,653
  • LLM calls3
  • Tool calls6
  • Compactions0

Failed tests

  • test_if_elif_else
  • test_while_loops
  • test_nested_while
  • test_functions_and_recursion
  • test_scoping
  • test_list_mutation
  • test_single_line_blocks
  • test_syntax_errors
  • test_runtime_errors
  • test_call_depth
  • test_partial_output_kept
  • test_empty_program
  • test_arithmetic_precedence
  • test_division_semantics
  • test_strings
  • test_bools_nil_equality
  • test_lists
  • test_variables
  • test_comments
failed
AD100-PRJ-15
mini pytest (discovery, fixtures, report)
17/18
94.4%
60.0%
4.5
2.70
65.3k
244.9s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyeasy
  • Weight4.5
  • Tagstest-runner, discovery, fixtures, reporting
  • Exit code0
  • Timed outFalse
  • Context tokens65,338
  • LLM calls57
  • Tool calls60
  • Compactions0

Failed tests

  • test_fixture_assertion_is_error_not_fail
failed
AD100-PRJ-16
Game of Life engine (seeded, census)
1/11
9.1%
0.0%
3.5
0.00
36.8k
160.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyeasy
  • Weight3.5
  • Tagsgame-of-life, simulation, prng, cycle-detection
  • Exit code0
  • Timed outFalse
  • Context tokens36,781
  • LLM calls3
  • Tool calls4
  • Compactions0

Failed tests

  • test_report_matches_oracle
  • test_repeat_detected_for_known_cycle
  • test_determinism_same_seed_same_output
  • test_gens_zero_three_lines
  • test_births_deaths_sum_consistent
  • test_next_rand_spec_values
  • test_wrap_rule
  • test_step_rule_blinker
  • test_step_rule_block_still_life
  • test_initial_board_counts_and_shape
failed
AD100-PRJ-17
LZ77+RLE codec with checksum
3/4 drivers
75.0%
65.0%
4.5
2.93
94.7k
481.2s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyeasy
  • Weight4.5
  • Tagscompression, lz77, rle, checksum, codec
  • Exit code0
  • Timed outFalse
  • Context tokens94,711
  • LLM calls32
  • Tool calls32
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_roundtrip
failed
AD100-PRJ-18
discrete-event simulator (deterministic)
2/4 drivers
50.0%
50.0%
3.5
1.75
50.6k
481.2s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyeasy
  • Weight3.5
  • Tagssimulation, event-queue, deterministic-ordering
  • Exit code0
  • Timed outFalse
  • Context tokens50,564
  • LLM calls23
  • Tool calls26
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_control
  • test_retransmission
passed
AD100-PRJ-19
C++ mini test framework
4/4 drivers
100.0%
100.0%
3.5
3.50
49.7k
167.8s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyeasy
  • Weight3.5
  • Tagstest-framework, macros, registry, fixtures
  • Exit code0
  • Timed outFalse
  • Context tokens49,665
  • LLM calls52
  • Tool calls53
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-PRJ-20
SQL subset engine (DDL/DML/SELECT/JOIN)
0/4 drivers
0.0%
0.0%
15.5
0.00
37.5k
152.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight15.5
  • Tagssql, parser, join, query-engine
  • Exit code0
  • Timed outFalse
  • Context tokens37,534
  • LLM calls4
  • Tool calls4
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_ddl_dml
  • test_errors
  • test_join
  • test_select
failed
AD100-PRJ-21
Indexed archive utility
0/8 drivers
0.0%
0.0%
30
0.00
322.8k
1202.1s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight30
  • Tagsmini-project, idea-1, zip, indexed-access, posix-metadata
  • Exit code0
  • Timed outFalse
  • Context tokens322,802
  • LLM calls55
  • Tool calls63
  • Compactions3

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_core_metadata
  • test_core_selection
  • test_errors
  • test_errors_integrity
  • test_errors_structure
  • test_resources
  • test_resources_indexed
failed
AD100-PRJ-22
Silence-aware MP3 splitter
0/18
0.0%
0.0%
11.5
0.00
37.2k
140.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight11.5
  • Tagsmini-project, idea-2
  • Exit code0
  • Timed outFalse
  • Context tokens37,226
  • LLM calls3
  • Tool calls3
  • Compactions0

Failed tests

  • test_core_versions_and_sizes
  • test_core_mixed_bitrate_padding_and_modes
  • test_core_crc_flag_only_changes_flag
  • test_core_coverage_and_offsets
  • test_core_plan_pause_midpoints
  • test_core_plan_min_pause_filters_short_runs
  • test_core_plan_min_track_merges_and_leading_trailing_silence
  • test_core_plan_track_fields_and_duration
  • test_core_emit_frame_aligned_slices
  • test_core_empty_stream
  • test_errors_input_types
  • test_errors_leading_garbage_and_trailing_bytes
  • test_errors_truncated_frame
  • test_errors_reserved_and_invalid_headers
  • test_errors_plan_argument_validation
  • test_errors_emit_alignment
  • test_resources_large_stream_parse_and_plan
  • test_resources_many_small_tracks_emit
failed
AD100-PRJ-23
FAT32/VFAT filesystem recovery
0/24
0.0%
0.0%
30
0.00
188.3k
1121.9s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyexpert
  • Weight30
  • Tagsmini-project, idea-3, fat32, vfat, reverse-engineering
  • Exit code0
  • Timed outFalse
  • Context tokens188,310
  • LLM calls27
  • Tool calls28
  • Compactions1

Failed tests

  • test_core_independent_trees[41]
  • test_core_independent_trees[1337]
  • test_core_independent_trees[2027]
  • test_core_root_and_lfn_across_fragmented_clusters
  • test_core_unicode_short_escape_and_full_lfn_parts
  • test_core_deep_directory_tree
  • test_core_reserved_high_bits_and_inactive_fat
  • test_core_fsinfo_hints_and_primary_boot_authority
  • test_core_deleted_entries_volume_label_and_empty_directory
  • test_errors_geometry[boot]
  • test_errors_geometry[fat16]
  • test_errors_geometry[small]
  • test_errors_geometry[fat-capacity]
  • test_errors_geometry[root]
  • test_errors_geometry[active]
  • test_errors_geometry[fsinfo]
  • test_errors_geometry[truncated]
  • test_errors_chain_markers_and_file_size
  • test_errors_cycles_and_cross_links
  • test_errors_lfn_records
  • test_errors_namespace_and_depth_limits
  • test_errors_mirror_disagreement_and_invalid_alias
  • test_resources_large_fragmented_file
  • test_resources_many_files_standalone_and_memory
failed
AD100-PRJ-24
Image similarity and grouping
0/17
0.0%
0.0%
5
0.00
36.9k
146.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyeasy
  • Weight5
  • Tagsmini-project, idea-4
  • Exit code0
  • Timed outFalse
  • Context tokens36,902
  • LLM calls4
  • Tool calls4
  • Compactions0

Failed tests

  • test_core_gradient_descriptor_exact
  • test_core_non_divisible_grid
  • test_core_tiny_image_empty_cells
  • test_core_distance_symmetry_and_triangular_values
  • test_core_grouping_transitive_chain
  • test_core_grouping_threshold_zero_and_empty
  • test_core_grouping_sorting
  • test_core_descriptor_independent_of_size
  • test_core_distance_known_value
  • test_errors_parse_input_types
  • test_errors_bad_magic_and_maxval
  • test_errors_truncated_and_trailing
  • test_errors_bad_dimensions
  • test_errors_distance_validation
  • test_errors_group_validation
  • test_resources_many_images_group
  • test_resources_large_image_describe
failed
AD100-PRJ-25
Binary delta generator and applier
0/3 drivers
0.0%
0.0%
6.5
0.00
38.1k
160.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyeasy
  • Weight6.5
  • Tagsmini-project, idea-5
  • Exit code0
  • Timed outFalse
  • Context tokens38,056
  • LLM calls3
  • Tool calls5
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_errors
  • test_resources
failed
AD100-PRJ-26
Incremental build tool
1/40
2.5%
0.0%
10
0.00
37.2k
150.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight10
  • Tagsmini-project, idea-6
  • Exit code0
  • Timed outFalse
  • Context tokens37,194
  • LLM calls4
  • Tool calls4
  • Compactions0

Failed tests

  • test_core_diamond_waves_sorted
  • test_core_recipe_change_rebuilds_dependents
  • test_core_transitive_stale_without_own_inputs
  • test_core_input_digests_and_outputs_recorded
  • test_core_multiple_roots_and_subset
  • test_core_state_input_not_mutated
  • test_core_up_to_date_with_records_is_empty
  • test_core_parse_details
  • test_core_plan_string_target_and_dup_list
  • test_core_waves_after_failure_report_full_plan
  • test_core_deep_chain_plan
  • test_errors_cycles[a: a]
  • test_errors_cycles[a: b\nb: a]
  • test_errors_cycles[x: y\ny: z\nz: x\n]
  • test_errors_unknown_dependency
  • test_errors_unknown_plan_target
  • test_errors_duplicate_target
  • test_errors_malformed_spec[justtext\n]
  • test_errors_malformed_spec[ orphaned\n]
  • test_errors_malformed_spec[a: | x | y\n]
  • test_errors_invalid_target_name[]
  • test_errors_invalid_target_name[has space]
  • test_errors_invalid_target_name[cafe\u0301]
  • test_errors_empty_spec
  • test_errors_missing_input_file
  • test_errors_max_jobs_validation[0]
  • test_errors_max_jobs_validation[-1]
  • test_errors_max_jobs_validation[65]
  • test_errors_max_jobs_validation[True]
  • test_errors_max_jobs_validation[False]
  • test_errors_max_jobs_validation[1.5]
  • test_errors_max_jobs_validation[4]
  • test_errors_runner_must_return_bytes
  • test_errors_runner_must_be_callable
  • test_errors_digest_requires_bytes
  • test_errors_files_missing_path
  • test_resources_deep_chain_plan_and_execute
  • test_resources_wide_graph_plan
  • test_resources_large_spec_parse
failed
AD100-PRJ-27
ELF executable inspector
0/79
0.0%
0.0%
21
0.00
387.7k
1200.0s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight21
  • Tagsmini-project, idea-7, elf64, binary-recovery, stdlib
  • Exit code0
  • Timed outFalse
  • Context tokens387,734
  • LLM calls175
  • Tool calls177
  • Compactions4

Failed tests

  • test_core_reports[raw-sections]
  • test_core_reports[raw-symbols]
  • test_core_reports[raw-relocations]
  • test_core_reports[raw-segments]
  • test_core_reports[multiple-sections]
  • test_core_reports[multiple-symbols]
  • test_core_reports[multiple-relocations]
  • test_core_reports[multiple-segments]
  • test_core_reports[rel-sections]
  • test_core_reports[rel-symbols]
  • test_core_reports[rel-relocations]
  • test_core_reports[rel-segments]
  • test_core_reports[shared-sections]
  • test_core_reports[shared-symbols]
  • test_core_reports[shared-relocations]
  • test_core_reports[shared-segments]
  • test_core_reports[buffers-sections]
  • test_core_reports[buffers-symbols]
  • test_core_reports[buffers-relocations]
  • test_core_reports[buffers-segments]
  • test_core_absent_names[sections]
  • test_core_absent_names[symbols]
  • test_core_absent_names[relocations]
  • test_core_absent_names[segments]
  • test_core_no_tables
  • test_core_numeric_metadata_and_reserved_symbols
  • test_core_accessed_tables_only
  • test_core_review_valid_inputs[sections-null-program]
  • test_core_review_valid_inputs[sections-empty-symbol-names]
  • test_core_review_valid_inputs[sections-symbol-free-relocations]
  • test_core_review_valid_inputs[symbols-null-program]
  • test_core_review_valid_inputs[symbols-empty-symbol-names]
  • test_core_review_valid_inputs[symbols-symbol-free-relocations]
  • test_core_review_valid_inputs[relocations-null-program]
  • test_core_review_valid_inputs[relocations-empty-symbol-names]
  • test_core_review_valid_inputs[relocations-symbol-free-relocations]
  • test_core_review_valid_inputs[segments-null-program]
  • test_core_review_valid_inputs[segments-empty-symbol-names]
  • test_core_review_valid_inputs[segments-symbol-free-relocations]
  • test_errors_type_header_bounds[sections]
  • test_errors_type_header_bounds[symbols]
  • test_errors_type_header_bounds[relocations]
  • test_errors_type_header_bounds[segments]
  • test_errors_sections[payload]
  • test_errors_sections[name-type]
  • test_errors_sections[name-range]
  • test_errors_sections[name-end]
  • test_errors_sections[name-start]
  • test_errors_symbols[stride]
  • test_errors_symbols[remainder]
  • test_errors_symbols[link-range]
  • test_errors_symbols[link-type]
  • test_errors_symbols[info]
  • test_errors_symbols[name-range]
  • test_errors_symbols[section-range]
  • test_errors_symbols[string-end]
  • test_errors_symbols[string-start]
  • test_errors_relocations[stride]
  • test_errors_relocations[remainder]
  • test_errors_relocations[link-range]
  • test_errors_relocations[link-type]
  • test_errors_relocations[target]
  • test_errors_relocations[symbol-range]
  • test_errors_relocations[linked-stride]
  • test_errors_relocations[linked-string]
  • test_errors_segments
  • test_errors_review_boundaries[null-as-load]
  • test_errors_review_boundaries[null-as-note]
  • test_errors_review_boundaries[empty-name-nonzero]
  • test_errors_review_boundaries[empty-name-bad-type]
  • test_errors_review_boundaries[empty-name-bounds]
  • test_errors_review_boundaries[no-table-nonzero-symbol]
  • test_errors_review_boundaries[no-table-bad-link]
  • test_errors_review_boundaries[no-table-wrong-type]
  • test_resources_light_envelope[sections]
  • test_resources_light_envelope[symbols]
  • test_resources_light_envelope[relocations]
  • test_resources_light_envelope[segments]
  • test_resources_untrusted_sizes
failed
AD100-PRJ-28
Dependency-aware package resolver
0/29
0.0%
0.0%
9
0.00
37.1k
154.7s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight9
  • Tagsmini-project, idea-8
  • Exit code0
  • Timed outFalse
  • Context tokens37,122
  • LLM calls4
  • Tool calls5
  • Compactions0

Failed tests

  • test_core_differential_against_brute_force
  • test_core_dependency_cycle_is_allowed
  • test_core_request_order_decides_preference
  • test_core_conflict_with_constraint
  • test_core_transitive_dependency_constraints
  • test_core_empty_request
  • test_core_bare_name_and_pair_requests_equivalent
  • test_core_satisfies_tuple_and_string
  • test_errors_malformed_versions[1.2]
  • test_errors_malformed_versions[1.2.3.4]
  • test_errors_malformed_versions[01.2.3]
  • test_errors_malformed_versions[1.2.x]
  • test_errors_malformed_versions[]
  • test_errors_malformed_versions[1..3]
  • test_errors_malformed_versions[-1.2.3]
  • test_errors_malformed_constraints[>>1.0.0]
  • test_errors_malformed_constraints[=1.0.0]
  • test_errors_malformed_constraints[>= 1.0.0]
  • test_errors_malformed_constraints[1.0.0]
  • test_errors_malformed_constraints[>=1.0,]
  • test_errors_malformed_constraints[>=1.0,,<2.0]
  • test_errors_malformed_constraints[><1.0.0]
  • test_errors_malformed_constraints[>=1.0.0.0]
  • test_errors_non_string_version
  • test_errors_catalog_structure
  • test_errors_requests_structure
  • test_resources_deep_chain
  • test_resources_wide_backtracking
  • test_resources_no_solution_detected
failed
AD100-PRJ-29
RAW Bayer development pipeline
2/3 drivers
66.7%
40.0%
7
2.80
305.6k
1202.1s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyeasy
  • Weight7
  • Tagsmini-project, idea-9
  • Exit code0
  • Timed outFalse
  • Context tokens305,645
  • LLM calls90
  • Tool calls92
  • Compactions3

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
passed
AD100-PRJ-30
Image registration (translation)
3/3 drivers
100.0%
100.0%
3.5
3.50
158.2k
488.1s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyeasy
  • Weight3.5
  • Tagsmini-project, idea-10
  • Exit code0
  • Timed outFalse
  • Context tokens158,170
  • LLM calls52
  • Tool calls53
  • Compactions1

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-PRJ-31
Score language to WAV synthesizer
0/12
0.0%
0.0%
28
0.00
38.6k
150.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyexpert
  • Weight28
  • Tagsmini-project, idea-11
  • Exit code0
  • Timed outFalse
  • Context tokens38,649
  • LLM calls4
  • Tool calls5
  • Compactions0

Failed tests

  • test_core_reference_match
  • test_core_voice_continuation
  • test_core_tempo_per_voice
  • test_core_envelope_zero_at_end
  • test_core_quantization_bounds
  • test_core_all_waves_present
  • test_errors_syntax
  • test_errors_input_type
  • test_errors_conflicting_rate
  • test_errors_nan_values
  • test_resources_long_score
  • test_resources_many_voices
failed
AD100-PRJ-32
Fixed-timestep 2D physics sandbox
0/12
0.0%
0.0%
9.5
0.00
37.8k
140.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight9.5
  • Tagsmini-project, idea-12
  • Exit code0
  • Timed outFalse
  • Context tokens37,827
  • LLM calls4
  • Tool calls4
  • Compactions0

Failed tests

  • test_core_reference_scenarios
  • test_core_bounds_reflection
  • test_core_deterministic_replay
  • test_core_initial_overlap_push_out
  • test_core_corner_contact
  • test_core_zero_steps_identity
  • test_core_bodies_do_not_collide
  • test_errors_input_types
  • test_errors_numeric_ranges
  • test_errors_steps_and_bounds
  • test_resources_many_bodies
  • test_resources_long_trajectory
failed
AD100-PRJ-33
Columnar data compressor
0/3 drivers
0.0%
0.0%
30
0.00
253.8k
1200.1s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight30
  • Tagsmini-project, idea-13
  • Exit code0
  • Timed outFalse
  • Context tokens253,807
  • LLM calls166
  • Tool calls171
  • Compactions2

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_errors
  • test_resources
failed
AD100-PRJ-34
DTMF decoder
0/13
0.0%
0.0%
18.5
0.00
37.2k
144.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight18.5
  • Tagsmini-project, idea-14
  • Exit code0
  • Timed outFalse
  • Context tokens37,230
  • LLM calls4
  • Tool calls5
  • Compactions0

Failed tests

  • test_core_all_twelve_symbols
  • test_core_timing_frames
  • test_core_quiet_tone_still_found
  • test_core_very_quiet_tone_ignored
  • test_core_noise_tolerant
  • test_core_distractor_frequency_ignored
  • test_core_short_blip_rejected
  • test_core_gap_bridging
  • test_core_sample_rate_16000
  • test_errors_bad_container
  • test_errors_bad_format
  • test_errors_truncated_chunks
  • test_resources_one_minute_audio
failed
AD100-PRJ-35
Mobile-robot path planner
11/12
91.7%
80.0%
9.5
7.60
117.1k
1202.1s
DEADLINE

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight9.5
  • Tagsmini-project, idea-15
  • Exit code0
  • Timed outFalse
  • Context tokens117,113
  • LLM calls51
  • Tool calls52
  • Compactions1

Failed tests

  • test_errors_start_goal
failed
AD100-PRJ-36
Two-link robot-arm controller
12/14
85.7%
20.0%
23
4.60
41.6k
151.8s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyexpert
  • Weight23
  • Tagsmini-project, idea-16
  • Exit code0
  • Timed outFalse
  • Context tokens41,555
  • LLM calls26
  • Tool calls30
  • Compactions0

Failed tests

  • test_core_collision_endpoint_and_distance
  • test_errors_configs
failed
AD100-PRJ-37
Fiducial-marker detector
—
—
0.0%
12.5
0.00
38.1k
146.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultymedium
  • Weight12.5
  • Tagsmini-project, idea-17
  • Exit code0
  • Timed outFalse
  • Context tokens38,112
  • LLM calls3
  • Tool calls3
  • Compactions0

Tests

C++ test drivers: unavailable because the build failed or timed out; tests did not run.

failed
AD100-PRJ-38
Multi-object tracker
0/11
0.0%
0.0%
15.5
0.00
36.5k
150.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight15.5
  • Tagsmini-project, idea-18
  • Exit code0
  • Timed outFalse
  • Context tokens36,466
  • LLM calls4
  • Tool calls4
  • Compactions0

Failed tests

  • test_core_gap_then_reappear
  • test_core_gap_within_max_misses
  • test_core_gating_creates_new_track
  • test_core_spurious_detection_short_track
  • test_core_crossing_identity_swap
  • test_core_max_misses_zero
  • test_core_greedy_prefers_global_order
  • test_core_random_consistency
  • test_errors_frames
  • test_errors_params
  • test_resources_many_frames
failed
AD100-PRJ-39
Parametric audio equalizer
0/3 drivers
0.0%
0.0%
28
0.00
249.2k
752.6s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight28
  • Tagsmini-project, idea-19
  • Exit code0
  • Timed outFalse
  • Context tokens249,161
  • LLM calls140
  • Tool calls141
  • Compactions2

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_errors
  • test_resources
failed
AD100-PRJ-40
Barcode scanner (EAN-13)
—
—
0.0%
24
0.00
38.1k
148.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight24
  • Tagsmini-project, idea-20
  • Exit code0
  • Timed outFalse
  • Context tokens38,082
  • LLM calls3
  • Tool calls5
  • Compactions0

Tests

C++ test drivers: unavailable because the build failed or timed out; tests did not run.

failed
AD100-PRJ-41
JSONL chat-log to Markdown converter
0/32
0.0%
0.0%
30
0.00
340.5k
901.7s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyexpert
  • Weight30
  • Tagsmini-project, idea-21
  • Exit code0
  • Timed outFalse
  • Context tokens340,495
  • LLM calls33
  • Tool calls36
  • Compactions3

Failed tests

  • test_core_width_none_keeps_spacing
  • test_core_long_word_not_split
  • test_core_width_one
  • test_core_fence_with_language_and_wrap_around
  • test_core_unterminated_fence_runs_to_end
  • test_core_tool_result_and_empty_text
  • test_core_message_default_text
  • test_core_note_empty_text_is_prefix_only
  • test_core_arguments_default_and_sorting
  • test_core_unicode_preserved
  • test_core_multiple_blocks_and_internal_blank_lines
  • test_core_one_shot_iterator_input
  • test_core_trailing_newlines_stripped
  • test_core_wrapping_matches_reference_on_fuzz
  • test_errors_invalid_json_line_number
  • test_errors_blank_line
  • test_errors_non_object_record
  • test_errors_unknown_type
  • test_errors_missing_role
  • test_errors_empty_role
  • test_errors_tool_call_fields
  • test_errors_tool_result_call
  • test_errors_text_type
  • test_errors_non_string_line
  • test_errors_width_validation[0]
  • test_errors_width_validation[-3]
  • test_errors_width_validation[True]
  • test_errors_width_validation[2.5]
  • test_errors_width_validation[40]
  • test_resources_large_single_paragraph_wrap_is_linear
  • test_resources_many_records
  • test_resources_one_shot_generator_and_large_fence
failed
AD100-PRJ-42
RFC 3986 URL utility
0/129
0.0%
0.0%
30
0.00
356.8k
1075.9s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyexpert
  • Weight30
  • Tagsmini-project, idea-22, rfc3986, native-oracle
  • Exit code0
  • Timed outFalse
  • Context tokens356,757
  • LLM calls51
  • Tool calls54
  • Compactions3

Failed tests

  • test_core_rfc3986_resolution[g:h-g:h]
  • test_core_rfc3986_resolution[g-http://a/b/c/g]
  • test_core_rfc3986_resolution[./g-http://a/b/c/g]
  • test_core_rfc3986_resolution[g/-http://a/b/c/g/]
  • test_core_rfc3986_resolution[/g-http://a/g]
  • test_core_rfc3986_resolution[//g-http://g]
  • test_core_rfc3986_resolution[?y-http://a/b/c/d;p?y]
  • test_core_rfc3986_resolution[#s-http://a/b/c/d;p?q#s]
  • test_core_rfc3986_resolution[g?y-http://a/b/c/g?y]
  • test_core_rfc3986_resolution[g#s-http://a/b/c/g#s]
  • test_core_rfc3986_resolution[g?y#s-http://a/b/c/g?y#s]
  • test_core_rfc3986_resolution[;x-http://a/b/c/;x]
  • test_core_rfc3986_resolution[g;x-http://a/b/c/g;x]
  • test_core_rfc3986_resolution[g;x?y#s-http://a/b/c/g;x?y#s]
  • test_core_rfc3986_resolution[-http://a/b/c/d;p?q]
  • test_core_rfc3986_resolution[.-http://a/b/c/]
  • test_core_rfc3986_resolution[./-http://a/b/c/]
  • test_core_rfc3986_resolution[..-http://a/b/]
  • test_core_rfc3986_resolution[../-http://a/b/]
  • test_core_rfc3986_resolution[../g-http://a/b/g]
  • test_core_rfc3986_resolution[../..-http://a/]
  • test_core_rfc3986_resolution[../../-http://a/]
  • test_core_rfc3986_resolution[../../g-http://a/g]
  • test_core_rfc3986_resolution[../../../g-http://a/g]
  • test_core_rfc3986_resolution[../../../../g-http://a/g]
  • test_core_rfc3986_resolution[/./g-http://a/g]
  • test_core_rfc3986_resolution[/../g-http://a/g]
  • test_core_rfc3986_resolution[g.-http://a/b/c/g.]
  • test_core_rfc3986_resolution[.g-http://a/b/c/.g]
  • test_core_rfc3986_resolution[g..-http://a/b/c/g..]
  • test_core_rfc3986_resolution[..g-http://a/b/c/..g]
  • test_core_rfc3986_resolution[./../g-http://a/b/g]
  • test_core_rfc3986_resolution[./g/.-http://a/b/c/g/]
  • test_core_rfc3986_resolution[g/./h-http://a/b/c/g/h]
  • test_core_rfc3986_resolution[g/../h-http://a/b/c/h]
  • test_core_rfc3986_resolution[g;x=1/./y-http://a/b/c/g;x=1/y]
  • test_core_rfc3986_resolution[g;x=1/../y-http://a/b/c/y]
  • test_core_rfc3986_resolution[g?y/./x-http://a/b/c/g?y/./x]
  • test_core_rfc3986_resolution[g?y/../x-http://a/b/c/g?y/../x]
  • test_core_rfc3986_resolution[g#s/./x-http://a/b/c/g#s/./x]
  • test_core_rfc3986_resolution[g#s/../x-http://a/b/c/g#s/../x]
  • test_core_rfc3986_resolution[http:g-http:g]
  • test_core_parse_tricky
  • test_core_normalize_specific
  • test_core_normalize_idempotent_fuzz
  • test_core_encode_component_presets
  • test_core_decode_replacement
  • test_core_get_query_plus_and_repeats
  • test_core_set_query_empty_and_bare
  • test_core_normalize_literals[WSS://U%73er@%45XAMPLE:00443/a//b/%2E/../c?%2f=%41#%7e-wss://User@example/a//b/c?%2F=A#~]
  • test_core_normalize_literals[http://H%2fX:00081/?#-http://h%2Fx:81/?#]
  • test_core_normalize_literals[custom://H:80-custom://h:80/]
  • test_core_normalize_literals[file:///a/../../b-file:///b]
  • test_core_empty_authority_userinfo_and_scheme
  • test_core_utf8_and_ipv6_profile
  • test_core_decode_maximal_subparts[%E2%82-\ufffd]
  • test_core_decode_maximal_subparts[%ED%A0%80-\ufffd\ufffd\ufffd]
  • test_core_decode_maximal_subparts[%C0%AF%F4%90%80%80-\ufffd\ufffd\ufffd\ufffd\ufffd\ufffd]
  • test_core_decode_maximal_subparts[caf\xe9%2B+-caf\xe9++]
  • test_core_query_delimiters_and_types
  • test_core_encode_full_ascii_and_safe_percent
  • test_errors_malformed_url[http://h/\n]
  • test_errors_malformed_url[http://h/\t]
  • test_errors_malformed_url[http://h/\x00]
  • test_errors_malformed_url[http://h/\x7f]
  • test_errors_malformed_url[http://h/a b]
  • test_errors_malformed_url[http://h/a\\b]
  • test_errors_malformed_url[http://h/<x>]
  • test_errors_malformed_url[http://h/[x]]
  • test_errors_malformed_url[http://h/%]
  • test_errors_malformed_url[http://h/%2]
  • test_errors_malformed_url[http://h/%zz]
  • test_errors_malformed_url[http://h/?x=%gg]
  • test_errors_malformed_url[http://h/#%xy]
  • test_errors_malformed_url[http://u%zz@h/]
  • test_errors_malformed_url[http://h%zz/]
  • test_errors_malformed_url[http://h:65536/]
  • test_errors_malformed_url[http://h:-1/]
  • test_errors_malformed_url[http://h:8a/]
  • test_errors_malformed_url[http://h:\u0661/]
  • test_errors_malformed_url[http://[::1/]
  • test_errors_malformed_url[http://[1:2:3]/]
  • test_errors_malformed_url[http://[1::2::3]/]
  • test_errors_malformed_url[http://[12345::]/]
  • test_errors_malformed_url[http://[::1]tail/]
  • test_errors_malformed_url[http://::1/]
  • test_errors_malformed_url[http://[v1.a]/]
  • test_errors_malformed_url[http://[fe80::1%25eth0]/]
  • test_errors_malformed_url[http://ex\xe4mple/]
  • test_errors_malformed_url[http://%C3%A9/]
  • test_errors_malformed_url[http://u@v@h/]
  • test_errors_malformed_url[http://h/\ud800]
  • test_errors_malformed_url[http://h/a\xa0b]
  • test_errors_malformed_url[1http:x]
  • test_errors_malformed_url[x]
  • test_errors_malformed_url[//h/x]
  • test_errors_api_types_and_escapes[parse-args0-kwargs0]
  • test_errors_api_types_and_escapes[parse-args1-kwargs1]
  • test_errors_api_types_and_escapes[parse-args2-kwargs2]
  • test_errors_api_types_and_escapes[parse-args3-kwargs3]
  • test_errors_api_types_and_escapes[parse-args4-kwargs4]
  • test_errors_api_types_and_escapes[normalize-args5-kwargs5]
  • test_errors_api_types_and_escapes[normalize-args6-kwargs6]
  • test_errors_api_types_and_escapes[encode-args7-kwargs7]
  • test_errors_api_types_and_escapes[encode-args8-kwargs8]
  • test_errors_api_types_and_escapes[encode-args9-kwargs9]
  • test_errors_api_types_and_escapes[encode-args10-kwargs10]
  • test_errors_api_types_and_escapes[encode-args11-kwargs11]
  • test_errors_api_types_and_escapes[decode-args12-kwargs12]
  • test_errors_api_types_and_escapes[decode-args13-kwargs13]
  • test_errors_api_types_and_escapes[decode-args14-kwargs14]
  • test_errors_api_types_and_escapes[decode-args15-kwargs15]
  • test_errors_api_types_and_escapes[get_query-args16-kwargs16]
  • test_errors_api_types_and_escapes[get_query-args17-kwargs17]
  • test_errors_api_types_and_escapes[get_query-args18-kwargs18]
  • test_errors_api_types_and_escapes[get_query-args19-kwargs19]
  • test_errors_api_types_and_escapes[set_query-args20-kwargs20]
  • test_errors_api_types_and_escapes[set_query-args21-kwargs21]
  • test_errors_api_types_and_escapes[set_query-args22-kwargs22]
  • test_errors_api_types_and_escapes[set_query-args23-kwargs23]
  • test_errors_api_types_and_escapes[set_query-args24-kwargs24]
  • test_errors_api_types_and_escapes[set_query-args25-kwargs25]
  • test_errors_api_types_and_escapes[set_query-args26-kwargs26]
  • test_errors_api_types_and_escapes[set_query-args27-kwargs27]
  • test_errors_all_input_length_limits
  • test_resources_parse_normalize_100000
  • test_resources_encode_decode_100000
  • test_resources_query_100000
  • test_resources_long_zero_port
failed
AD100-PRJ-43
Nonlinear least-squares solver
2/3 drivers
66.7%
40.0%
7.5
3.00
145.4k
480.2s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultymedium
  • Weight7.5
  • Tagsmini-project, idea-23
  • Exit code0
  • Timed outFalse
  • Context tokens145,407
  • LLM calls54
  • Tool calls55
  • Compactions1

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
failed
AD100-PRJ-44
IBAN and credit-card validator
8/9
88.9%
40.0%
6
2.40
77.6k
271.0s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyeasy
  • Weight6
  • Tagsmini-project, idea-24
  • Exit code0
  • Timed outFalse
  • Context tokens77,568
  • LLM calls35
  • Tool calls39
  • Compactions0

Failed tests

  • test_core_all_countries
failed
AD100-PRJ-45
Arbitrary-precision integer arithmetic
—
—
0.0%
14.5
0.00
40.3k
150.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight14.5
  • Tagsmini-project, idea-25
  • Exit code0
  • Timed outFalse
  • Context tokens40,290
  • LLM calls5
  • Tool calls7
  • Compactions0

Tests

C++ test drivers: unavailable because the build failed or timed out; tests did not run.

failed
AD100-PRJ-47
Recover a hidden phrase from an executable
3/6
50.0%
20.0%
5.5
1.10
211.7k
830.6s

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight5.5
  • Tagsmini-project, idea-27
  • Exit code0
  • Timed outFalse
  • Context tokens211,702
  • LLM calls57
  • Tool calls60
  • Compactions2

Failed tests

  • test_core_exact_phrase
  • test_core_exact_length
  • test_resources_standalone_bytes
failed
AD100-PRJ-48
Black-box image transformation utility clone
—
—
0.0%
30
0.00
98.3k
859.6s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight30
  • Tagsmini-project, idea-28
  • Exit code0
  • Timed outFalse
  • Context tokens98,302
  • LLM calls49
  • Tool calls52
  • Compactions0

Tests

C++ test drivers: results unavailable or incomplete.

failed
AD100-PRJ-49
Closed-loop differential-drive line follower
1/21
4.8%
0.0%
13.5
0.00
41.2k
152.8s
PI_EXIT

Challenge

  • Observed modelsApexintelligence-AI/Apex-35B-V1.0-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight13.5
  • Tagsmini-project, idea-29
  • Exit code0
  • Timed outFalse
  • Context tokens41,171
  • LLM calls5
  • Tool calls5
  • Compactions0

Failed tests

  • test_core_hidden_track_completion_and_recovery[0]
  • test_core_hidden_track_completion_and_recovery[1]
  • test_core_hidden_track_completion_and_recovery[2]
  • test_core_hidden_track_completion_and_recovery[3]
  • test_core_hidden_track_completion_and_recovery[4]
  • test_core_hidden_track_completion_and_recovery[5]
  • test_core_hidden_track_completion_and_recovery[6]
  • test_core_hidden_track_completion_and_recovery[7]
  • test_core_hidden_track_completion_and_recovery[8]
  • test_core_hidden_track_completion_and_recovery[9]
  • test_errors_api_and_state[0]
  • test_errors_api_and_state[1]
  • test_errors_api_and_state[2]
  • test_errors_api_and_state[3]
  • test_errors_api_and_state[4]
  • test_errors_api_and_state[5]
  • test_errors_api_and_state[6]
  • test_errors_api_and_state[7]
  • test_resources_deterministic_replay
  • test_resources_long_route_with_bounded_worker