bartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M

Observed from session logs: bartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M

run ornith1.5_35b_q4 · requested model default · generated 2026-11-13T07:42:07+00:00 · 78 challenges

41passed
37failed
0error
84.9%avg tests
337.72 / 744.00final score
45.4%of max
4.9Mcontext tokens
62.5kavg tokens/task
32compactions
passed
AD100-ALG-02
Dijkstra shortest paths
2/2 drivers
100.0%
100.0%
3
3.00
7298
41.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultymedium
  • Weight3
  • Tagsgraphs, dijkstra, priority-queue
  • Exit code0
  • Timed outFalse
  • Context tokens7,298
  • LLM calls13
  • Tool calls12
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-ALG-03
JSON parser from scratch
42/43
97.7%
60.0%
3
1.80
12.0k
56.0s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagsparsing, recursive-descent, unicode
  • Exit code0
  • Timed outFalse
  • Context tokens12,007
  • LLM calls15
  • Tool calls14
  • Compactions0

Failed tests

  • test_string_escapes
passed
AD100-ALG-16
RFC-4180 CSV parser from scratch
6/6
100.0%
100.0%
3.5
3.50
9146
48.2s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultymedium
  • Weight3.5
  • Tagsparsing, csv, purity
  • Exit code0
  • Timed outFalse
  • Context tokens9,146
  • LLM calls10
  • Tool calls9
  • Compactions0
failed
AD100-ALG-19
S-expression reader/writer
3/4
75.0%
70.0%
3.5
2.45
23.2k
101.2s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultymedium
  • Weight3.5
  • Tagsparsing, s-expression, recursion-limit
  • Exit code0
  • Timed outFalse
  • Context tokens23,162
  • LLM calls33
  • Tool calls37
  • Compactions0

Failed tests

  • test_edge_errors_and_atoms
passed
AD100-ALG-20
word ladder shortest chain
4/4
100.0%
100.0%
3
3.00
4912
481.9s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultymedium
  • Weight3
  • Tagsgraph, bfs, lexicographic
  • Exit code0
  • Timed outFalse
  • Context tokens4,912
  • LLM calls5
  • Tool calls5
  • Compactions0
passed
AD100-ALG-22
strongly connected components (Tarjan)
3/3 drivers
100.0%
100.0%
3
3.00
5805
481.8s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultymedium
  • Weight3
  • Tagsgraph, scc, tarjan
  • Exit code0
  • Timed outFalse
  • Context tokens5,805
  • LLM calls8
  • Tool calls8
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-23
segment tree: point update + range sum
3/3 drivers
100.0%
100.0%
3
3.00
4542
14.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultymedium
  • Weight3
  • Tagsdata-structure, segment-tree
  • Exit code0
  • Timed outFalse
  • Context tokens4,542
  • LLM calls8
  • Tool calls7
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-26
sparse table RMQ
4/4 drivers
100.0%
100.0%
3
3.00
4868
29.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultymedium
  • Weight3
  • Tagsdata-structure, rmq, sparse-table
  • Exit code0
  • Timed outFalse
  • Context tokens4,868
  • LLM calls9
  • Tool calls10
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-27
convex hull (monotone chain)
4/4 drivers
100.0%
100.0%
3
3.00
7324
44.0s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyhard
  • Weight3
  • Tagsgeometry, convex-hull
  • Exit code0
  • Timed outFalse
  • Context tokens7,324
  • LLM calls9
  • Tool calls8
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-28
min-cost max-flow
3/3 drivers
100.0%
100.0%
3
3.00
5589
21.0s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyhard
  • Weight3
  • Tagsflow, min-cost-flow, optimization
  • Exit code0
  • Timed outFalse
  • Context tokens5,589
  • LLM calls7
  • Tool calls6
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-ALG-29
glob matcher (*, ?, classes)
5/5
100.0%
100.0%
6
6.00
21.6k
179.4s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultyhard
  • Weight6
  • Tagspattern-matching, backtracking
  • Exit code0
  • Timed outFalse
  • Context tokens21,579
  • LLM calls24
  • Tool calls23
  • Compactions0
passed
AD100-ALG-30
matrix-chain multiplication
5/5
100.0%
100.0%
3
3.00
6922
27.0s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagsdp, parenthesization
  • Exit code0
  • Timed outFalse
  • Context tokens6,922
  • LLM calls15
  • Tool calls14
  • Compactions0
passed
AD100-ALG-31
Huffman coding round-trip
6/6
100.0%
100.0%
3
3.00
17.4k
57.1s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagshuffman, compression, round-trip
  • Exit code0
  • Timed outFalse
  • Context tokens17,394
  • LLM calls22
  • Tool calls22
  • Compactions0
passed
AD100-ALG-33
big-decimal arithmetic (strings)
4/4 drivers
100.0%
100.0%
3.5
3.50
63.3k
118.2s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyhard
  • Weight3.5
  • Tagsbignum, arithmetic, strings
  • Exit code0
  • Timed outFalse
  • Context tokens63,349
  • LLM calls16
  • Tool calls15
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-ALG-34
treap: k-th order statistics
3/4 drivers
75.0%
75.0%
4.5
3.38
31.5k
260.5s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyhard
  • Weight4.5
  • Tagstreap, order-statistics, balanced-bst
  • Exit code0
  • Timed outFalse
  • Context tokens31,461
  • LLM calls33
  • Tool calls33
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_edge
passed
AD100-ALG-35
persistent segment tree (versions + k-th)
4/4 drivers
100.0%
100.0%
3
3.00
38.5k
179.5s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaralgorithmic
  • Languagecpp
  • Difficultyexpert
  • Weight3
  • Tagspersistent-segment-tree, functional-data-structure, versions
  • Exit code0
  • Timed outFalse
  • Context tokens38,482
  • LLM calls34
  • Tool calls33
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-DBG-11
API contract: exception + aliasing
15/16
93.8%
40.0%
3
1.20
4908
16.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultymedium
  • Weight3
  • Tagsapi-contract, exception-type, aliasing, defensive-copy
  • Exit code0
  • Timed outFalse
  • Context tokens4,908
  • LLM calls8
  • Tool calls8
  • Compactions0

Failed tests

  • test_set_copy_of_set_and_list
passed
AD100-DBG-12
int overflow in size arithmetic
4/4 drivers
100.0%
100.0%
3.5
3.50
6044
19.0s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagecpp
  • Difficultymedium
  • Weight3.5
  • Tagsinteger-overflow, size-arithmetic, validation
  • Exit code0
  • Timed outFalse
  • Context tokens6,044
  • LLM calls10
  • Tool calls11
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-DBG-13
size_t underflow on singleton/empty
4/4 drivers
100.0%
100.0%
7.5
7.50
5799
31.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagecpp
  • Difficultymedium
  • Weight7.5
  • Tagssize-t, underflow, empty-singleton
  • Exit code0
  • Timed outFalse
  • Context tokens5,799
  • LLM calls10
  • Tool calls10
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-DBG-15
hash-order nondeterminism
12/12
100.0%
100.0%
3
3.00
3356
8.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultymedium
  • Weight3
  • Tagshash-order, determinism, nondeterminism, sorting
  • Exit code0
  • Timed outFalse
  • Context tokens3,356
  • LLM calls7
  • Tool calls7
  • Compactions0
failed
AD100-DBG-17
wrong exception type on error path
2/4 drivers
50.0%
0.0%
4.5
0.00
5825
32.0s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagecpp
  • Difficultymedium
  • Weight4.5
  • Tagsexception-contract, parsing, error-path
  • Exit code0
  • Timed outFalse
  • Context tokens5,825
  • LLM calls6
  • Tool calls7
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_bugs
  • test_regression
passed
AD100-DBG-19
multiple interacting bug classes
19/19
100.0%
100.0%
3
3.00
7008
38.0s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagsmulti-bug, mutable-default, off-by-one, exception-contract, aliasing
  • Exit code0
  • Timed outFalse
  • Context tokens7,008
  • LLM calls8
  • Tool calls8
  • Compactions0
passed
AD100-DBG-20
path traversal + expression injection
50/50
100.0%
100.0%
3
3.00
5597
16.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagssecurity, path-traversal, injection, input-validation
  • Exit code0
  • Timed outFalse
  • Context tokens5,597
  • LLM calls6
  • Tool calls7
  • Compactions0
passed
AD100-DBG-21
unseeded RNG / wall-clock dependence
19/19
100.0%
100.0%
3
3.00
5232
15.1s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagsdeterminism, rng, wall-clock, reproducibility
  • Exit code0
  • Timed outFalse
  • Context tokens5,232
  • LLM calls9
  • Tool calls9
  • Compactions0
passed
AD100-DBG-23
erase-while-iterating + related bugs
4/4 drivers
100.0%
100.0%
3
3.00
8656
33.1s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagecpp
  • Difficultyhard
  • Weight3
  • Tagserase-while-iterating, vector, iterator, off-by-one
  • Exit code0
  • Timed outFalse
  • Context tokens8,656
  • LLM calls15
  • Tool calls16
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-DBG-26
snapshot restore service
20/24
83.3%
35.0%
15.5
5.42
15.7k
53.2s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight15.5
  • Tagssecurity-review, cve-derived, filesystem, symlinks, transactional
  • Exit code0
  • Timed outFalse
  • Context tokens15,650
  • LLM calls20
  • Tool calls25
  • Compactions0

Failed tests

  • test_security_link_target_resolution[False]
  • test_security_link_target_resolution[True]
  • test_security_parent_after_symlink[bridge/../secret]
  • test_security_parent_after_symlink[/r/bridge/../secret]
failed
AD100-DBG-27
verified block ingestion
43/44
97.7%
65.0%
10
6.50
22.7k
83.3s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight10
  • Tagssecurity-review, cve-derived, integrity, streaming, short-reads
  • Exit code0
  • Timed outFalse
  • Context tokens22,706
  • LLM calls17
  • Tool calls22
  • Compactions0

Failed tests

  • test_regression_independent_empty_block
passed
AD100-DBG-28
indexed document reader
26/26
100.0%
100.0%
3
3.00
40.6k
205.5s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight3
  • Tagssecurity-review, cve-derived, parser, progress, random-access
  • Exit code0
  • Timed outFalse
  • Context tokens40,557
  • LLM calls31
  • Tool calls35
  • Compactions0
failed
AD100-DBG-31
stylesheet inspection pipeline
26/33
78.8%
35.0%
22.5
7.87
47.7k
721.5s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight22.5
  • Tagssecurity-review, cve-derived, tokenizer, escaping, parser-differential
  • Exit code0
  • Timed outFalse
  • Context tokens47,692
  • LLM calls30
  • Tool calls36
  • Compactions0

Failed tests

  • test_security_even_backslashes_terminate[2]
  • test_security_even_backslashes_terminate[4]
  • test_security_even_backslashes_terminate[6]
  • test_security_even_backslashes_terminate[8]
  • test_security_hidden_declaration_not_consumed[2]
  • test_security_hidden_declaration_not_consumed[4]
  • test_security_hidden_declaration_not_consumed[6]
passed
AD100-DBG-33
multipart metadata processing
19/19
100.0%
100.0%
13
13.00
26.2k
127.3s
PI_EXIT

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight13
  • Tagssecurity-review, cve-derived, regex, complexity, multipart
  • Exit code0
  • Timed outFalse
  • Context tokens26,207
  • LLM calls38
  • Tool calls41
  • Compactions0
passed
AD100-DBG-34
URL text and form gateway
29/29
100.0%
100.0%
6
6.00
43.9k
197.6s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight6
  • Tagssecurity-review, cve-derived, percent-encoding, utf8, complexity
  • Exit code0
  • Timed outFalse
  • Context tokens43,880
  • LLM calls49
  • Tool calls52
  • Compactions0
failed
AD100-DBG-35
schema identifier registry
18/24
75.0%
0.0%
10.5
0.00
24.4k
99.3s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultyhard
  • Weight10.5
  • Tagssecurity-review, cve-derived, asn1, canonicalization, integer-bounds
  • Exit code0
  • Timed outFalse
  • Context tokens24,396
  • LLM calls25
  • Tool calls29
  • Compactions0

Failed tests

  • test_regression_import_atomic_export_remove
  • test_security_invalid_arcs[0.40]
  • test_security_invalid_arcs[0.42.840.113549.1.1.1]
  • test_security_invalid_arcs[1.40.1]
  • test_security_invalid_arcs[3.2.840]
  • test_security_no_registry_alias_from_invalid_text
passed
AD100-DBG-36
Walk or drive to the car wash
1/1
100.0%
100.0%
4
4.00
2747
8.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultymedium
  • Weight4
  • Tagsreasoning, deliverable, file-io, single-word-answer
  • Exit code0
  • Timed outFalse
  • Context tokens2,747
  • LLM calls4
  • Tool calls3
  • Compactions0
passed
AD100-DBG-37
Which is larger, 9.11 or 9.9?
1/1
100.0%
100.0%
3
3.00
3088
6.9s
PI_EXIT

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillardebugging
  • Languagepython
  • Difficultymedium
  • Weight3
  • Tagsreasoning, numeric-literals, deliverable, file-io
  • Exit code0
  • Timed outFalse
  • Context tokens3,088
  • LLM calls4
  • Tool calls3
  • Compactions0
passed
AD100-OPT-17
quicksort worst-case pivot
2/2 drivers
100.0%
100.0%
3
3.00
6148
34.0s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillaroptimization
  • Languagecpp
  • Difficultyhard
  • Weight3
  • Tagscomplexity, quicksort, pivot, worst-case
  • Exit code0
  • Timed outFalse
  • Context tokens6,148
  • LLM calls7
  • Tool calls6
  • Compactions0

Tests

C++ test drivers (executed stages only): correctness: passed; performance: passed.

failed
AD100-PRJ-01
taskcli: TSV task manager
18/20
90.0%
40.0%
3.5
1.40
11.8k
54.1s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight3.5
  • Tagscli, persistence, exit-codes, json-store
  • Exit code0
  • Timed outFalse
  • Context tokens11,793
  • LLM calls13
  • Tool calls15
  • Compactions0

Failed tests

  • test_add_empty_title
  • test_file_flag_creates_isolated_stores
passed
AD100-PRJ-02
INI config library
3/3 drivers
100.0%
100.0%
3
3.00
7528
29.0s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultymedium
  • Weight3
  • Tagsparsing, ini, api-design, exceptions
  • Exit code0
  • Timed outFalse
  • Context tokens7,528
  • LLM calls8
  • Tool calls7
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-PRJ-08
Markdown→HTML subset
25/26
96.2%
70.0%
22
15.40
23.1k
97.3s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight22
  • Tagsmarkdown, parser, html, escaping
  • Exit code0
  • Timed outFalse
  • Context tokens23,068
  • LLM calls28
  • Tool calls30
  • Compactions0

Failed tests

  • test_unmatched_markers_stay_literal
passed
AD100-PRJ-09
KV store: TTL + LRU + snapshot
23/23
100.0%
100.0%
4.5
4.50
27.3k
128.2s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight4.5
  • Tagskv-store, ttl, lru, persistence
  • Exit code0
  • Timed outFalse
  • Context tokens27,257
  • LLM calls26
  • Tool calls29
  • Compactions0
passed
AD100-PRJ-10
cron next-fire calculator
21/21
100.0%
100.0%
3.5
3.50
17.2k
76.1s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight3.5
  • Tagscron, schedules, calendar, parsing
  • Exit code0
  • Timed outFalse
  • Context tokens17,195
  • LLM calls17
  • Tool calls20
  • Compactions0
passed
AD100-PRJ-11
access-log analyzer (stats + filters)
16/16
100.0%
100.0%
3.5
3.50
34.1k
164.4s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultymedium
  • Weight3.5
  • Tagslogs, parsing, aggregation, cli
  • Exit code0
  • Timed outFalse
  • Context tokens34,108
  • LLM calls42
  • Tool calls44
  • Compactions0
passed
AD100-PRJ-12
HTTP/1.1 message parser
3/3 drivers
100.0%
100.0%
5
5.00
21.1k
106.2s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultymedium
  • Weight5
  • Tagshttp, parser, chunked, protocol
  • Exit code0
  • Timed outFalse
  • Context tokens21,068
  • LLM calls17
  • Tool calls18
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-PRJ-13
mustache-lite template engine
3/3 drivers
100.0%
100.0%
6.5
6.50
40.1k
197.4s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultymedium
  • Weight6.5
  • Tagstemplates, mustache, html-escaping, recursion
  • Exit code0
  • Timed outFalse
  • Context tokens40,063
  • LLM calls35
  • Tool calls34
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-PRJ-14
mini scripting language interpreter
19/21
90.5%
65.0%
10.5
6.83
119.3k
482.1s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight10.5
  • Tagsinterpreter, lexer, parser, tree-walker, cli
  • Exit code0
  • Timed outFalse
  • Context tokens119,293
  • LLM calls122
  • Tool calls122
  • Compactions1

Failed tests

  • test_functions_and_recursion
  • test_list_mutation
failed
AD100-PRJ-15
mini pytest (discovery, fixtures, report)
10/18
55.6%
30.0%
4.5
1.35
16.6k
76.1s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight4.5
  • Tagstest-runner, discovery, fixtures, reporting
  • Exit code0
  • Timed outFalse
  • Context tokens16,601
  • LLM calls21
  • Tool calls23
  • Compactions0

Failed tests

  • test_fixture_raises_is_error
  • test_unknown_fixture_is_error
  • test_fixture_cycle_is_error
  • test_fixture_assertion_is_error_not_fail
  • test_mixed_outcomes_report
  • test_import_failure_reported_and_others_still_run
  • test_fixture_error_does_not_stop_other_tests
  • test_two_files_counts_aggregate
passed
AD100-PRJ-16
Game of Life engine (seeded, census)
11/11
100.0%
100.0%
3.5
3.50
10.7k
52.0s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight3.5
  • Tagsgame-of-life, simulation, prng, cycle-detection
  • Exit code0
  • Timed outFalse
  • Context tokens10,682
  • LLM calls9
  • Tool calls12
  • Compactions0
failed
AD100-PRJ-17
LZ77+RLE codec with checksum
2/4 drivers
50.0%
55.0%
4.5
2.48
29.8k
124.2s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight4.5
  • Tagscompression, lz77, rle, checksum, codec
  • Exit code0
  • Timed outFalse
  • Context tokens29,781
  • LLM calls13
  • Tool calls14
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_errors
  • test_format
passed
AD100-PRJ-18
discrete-event simulator (deterministic)
4/4 drivers
100.0%
100.0%
3.5
3.50
27.8k
99.2s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight3.5
  • Tagssimulation, event-queue, deterministic-ordering
  • Exit code0
  • Timed outFalse
  • Context tokens27,759
  • LLM calls32
  • Tool calls33
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-PRJ-19
C++ mini test framework
4/4 drivers
100.0%
100.0%
3.5
3.50
25.3k
119.2s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight3.5
  • Tagstest-framework, macros, registry, fixtures
  • Exit code0
  • Timed outFalse
  • Context tokens25,259
  • LLM calls34
  • Tool calls36
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-PRJ-20
SQL subset engine (DDL/DML/SELECT/JOIN)
2/4 drivers
50.0%
50.0%
15.5
7.75
301.0k
1135.6s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight15.5
  • Tagssql, parser, join, query-engine
  • Exit code0
  • Timed outFalse
  • Context tokens300,972
  • LLM calls184
  • Tool calls185
  • Compactions3

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_join
  • test_select
failed
AD100-PRJ-21
Indexed archive utility
3/8 drivers
37.5%
0.0%
30
0.00
226.7k
1038.8s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight30
  • Tagsmini-project, idea-1, zip, indexed-access, posix-metadata
  • Exit code0
  • Timed outFalse
  • Context tokens226,724
  • LLM calls87
  • Tool calls88
  • Compactions2

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core_metadata
  • test_errors
  • test_errors_structure
  • test_resources
  • test_resources_indexed
failed
AD100-PRJ-22
Silence-aware MP3 splitter
16/18
88.9%
20.0%
11.5
2.30
56.4k
251.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight11.5
  • Tagsmini-project, idea-2
  • Exit code0
  • Timed outFalse
  • Context tokens56,400
  • LLM calls43
  • Tool calls44
  • Compactions0

Failed tests

  • test_core_plan_min_track_merges_and_leading_trailing_silence
  • test_errors_plan_argument_validation
failed
AD100-PRJ-23
FAT32/VFAT filesystem recovery
5/24
20.8%
20.0%
30
6.00
326.0k
1202.1s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight30
  • Tagsmini-project, idea-3, fat32, vfat, reverse-engineering
  • Exit code0
  • Timed outFalse
  • Context tokens326,015
  • LLM calls51
  • Tool calls51
  • Compactions3

Failed tests

  • test_core_independent_trees[41]
  • test_core_independent_trees[1337]
  • test_core_independent_trees[2027]
  • test_core_unicode_short_escape_and_full_lfn_parts
  • test_core_deep_directory_tree
  • test_core_reserved_high_bits_and_inactive_fat
  • test_core_deleted_entries_volume_label_and_empty_directory
  • test_errors_geometry[boot]
  • test_errors_geometry[fat16]
  • test_errors_geometry[small]
  • test_errors_geometry[fat-capacity]
  • test_errors_geometry[root]
  • test_errors_geometry[active]
  • test_errors_geometry[fsinfo]
  • test_errors_chain_markers_and_file_size
  • test_errors_cycles_and_cross_links
  • test_errors_lfn_records
  • test_errors_namespace_and_depth_limits
  • test_errors_mirror_disagreement_and_invalid_alias
failed
AD100-PRJ-24
Image similarity and grouping
16/17
94.1%
80.0%
5
4.00
18.7k
89.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight5
  • Tagsmini-project, idea-4
  • Exit code0
  • Timed outFalse
  • Context tokens18,713
  • LLM calls24
  • Tool calls24
  • Compactions0

Failed tests

  • test_errors_group_validation
failed
AD100-PRJ-25
Binary delta generator and applier
0/3 drivers
0.0%
0.0%
6.5
0.00
38.1k
164.8s
PI_EXIT

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight6.5
  • Tagsmini-project, idea-5
  • Exit code0
  • Timed outFalse
  • Context tokens38,091
  • LLM calls3
  • Tool calls5
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_errors
  • test_resources
failed
AD100-PRJ-26
Incremental build tool
38/40
95.0%
80.0%
10
8.00
21.6k
93.7s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight10
  • Tagsmini-project, idea-6
  • Exit code0
  • Timed outFalse
  • Context tokens21,629
  • LLM calls18
  • Tool calls19
  • Compactions0

Failed tests

  • test_errors_digest_requires_bytes
  • test_errors_files_missing_path
failed
AD100-PRJ-27
ELF executable inspector
43/79
54.4%
20.0%
21
4.20
302.2k
1200.1s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight21
  • Tagsmini-project, idea-7, elf64, binary-recovery, stdlib
  • Exit code0
  • Timed outFalse
  • Context tokens302,164
  • LLM calls110
  • Tool calls109
  • Compactions3

Failed tests

  • test_core_reports[rel-relocations]
  • test_core_reports[buffers-sections]
  • test_core_reports[buffers-symbols]
  • test_core_reports[buffers-relocations]
  • test_core_reports[buffers-segments]
  • test_core_absent_names[sections]
  • test_core_no_tables
  • test_core_review_valid_inputs[sections-null-program]
  • test_core_review_valid_inputs[sections-empty-symbol-names]
  • test_core_review_valid_inputs[sections-symbol-free-relocations]
  • test_core_review_valid_inputs[symbols-empty-symbol-names]
  • test_errors_type_header_bounds[sections]
  • test_errors_type_header_bounds[symbols]
  • test_errors_type_header_bounds[relocations]
  • test_errors_type_header_bounds[segments]
  • test_errors_sections[name-range]
  • test_errors_sections[name-end]
  • test_errors_sections[name-start]
  • test_errors_symbols[stride]
  • test_errors_symbols[remainder]
  • test_errors_symbols[info]
  • test_errors_symbols[string-end]
  • test_errors_symbols[string-start]
  • test_errors_relocations[remainder]
  • test_errors_relocations[link-range]
  • test_errors_relocations[link-type]
  • test_errors_relocations[target]
  • test_errors_relocations[symbol-range]
  • test_errors_relocations[linked-stride]
  • test_errors_relocations[linked-string]
  • test_errors_segments
  • test_errors_review_boundaries[null-as-load]
  • test_errors_review_boundaries[null-as-note]
  • test_errors_review_boundaries[no-table-nonzero-symbol]
  • test_errors_review_boundaries[no-table-bad-link]
  • test_errors_review_boundaries[no-table-wrong-type]
passed
AD100-PRJ-28
Dependency-aware package resolver
29/29
100.0%
100.0%
9
9.00
166.7k
1200.1s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight9
  • Tagsmini-project, idea-8
  • Exit code0
  • Timed outFalse
  • Context tokens166,673
  • LLM calls86
  • Tool calls88
  • Compactions1
passed
AD100-PRJ-29
RAW Bayer development pipeline
3/3 drivers
100.0%
100.0%
7
7.00
53.2k
1202.1s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight7
  • Tagsmini-project, idea-9
  • Exit code0
  • Timed outFalse
  • Context tokens53,246
  • LLM calls35
  • Tool calls37
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

passed
AD100-PRJ-30
Image registration (translation)
3/3 drivers
100.0%
100.0%
3.5
3.50
13.6k
63.6s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight3.5
  • Tagsmini-project, idea-10
  • Exit code0
  • Timed outFalse
  • Context tokens13,607
  • LLM calls10
  • Tool calls12
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

failed
AD100-PRJ-31
Score language to WAV synthesizer
8/12
66.7%
20.0%
28
5.60
201.9k
326.1s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight28
  • Tagsmini-project, idea-11
  • Exit code0
  • Timed outFalse
  • Context tokens201,878
  • LLM calls65
  • Tool calls65
  • Compactions2

Failed tests

  • test_core_reference_match
  • test_core_voice_continuation
  • test_resources_long_score
  • test_resources_many_voices
failed
AD100-PRJ-32
Fixed-timestep 2D physics sandbox
10/12
83.3%
20.0%
9.5
1.90
13.9k
65.7s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight9.5
  • Tagsmini-project, idea-12
  • Exit code0
  • Timed outFalse
  • Context tokens13,923
  • LLM calls18
  • Tool calls17
  • Compactions0

Failed tests

  • test_core_bounds_reflection
  • test_resources_many_bodies
failed
AD100-PRJ-33
Columnar data compressor
0/3 drivers
0.0%
0.0%
30
0.00
40.3k
164.8s
PI_EXIT

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight30
  • Tagsmini-project, idea-13
  • Exit code0
  • Timed outFalse
  • Context tokens40,310
  • LLM calls3
  • Tool calls5
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_errors
  • test_resources
passed
AD100-PRJ-34
DTMF decoder
13/13
100.0%
100.0%
18.5
18.50
306.9k
874.7s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight18.5
  • Tagsmini-project, idea-14
  • Exit code0
  • Timed outFalse
  • Context tokens306,915
  • LLM calls132
  • Tool calls131
  • Compactions3
failed
AD100-PRJ-35
Mobile-robot path planner
11/12
91.7%
80.0%
9.5
7.60
8941
32.7s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight9.5
  • Tagsmini-project, idea-15
  • Exit code0
  • Timed outFalse
  • Context tokens8,941
  • LLM calls15
  • Tool calls15
  • Compactions0

Failed tests

  • test_errors_start_goal
failed
AD100-PRJ-36
Two-link robot-arm controller
12/14
85.7%
80.0%
23
18.40
13.6k
52.7s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight23
  • Tagsmini-project, idea-16
  • Exit code0
  • Timed outFalse
  • Context tokens13,596
  • LLM calls11
  • Tool calls11
  • Compactions0

Failed tests

  • test_errors_configs
  • test_errors_obstacles
failed
AD100-PRJ-37
Fiducial-marker detector
2/3 drivers
66.7%
80.0%
12.5
10.00
122.9k
449.2s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight12.5
  • Tagsmini-project, idea-17
  • Exit code0
  • Timed outFalse
  • Context tokens122,941
  • LLM calls88
  • Tool calls90
  • Compactions1

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_errors
failed
AD100-PRJ-38
Multi-object tracker
9/11
81.8%
20.0%
15.5
3.10
30.4k
128.8s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight15.5
  • Tagsmini-project, idea-18
  • Exit code0
  • Timed outFalse
  • Context tokens30,442
  • LLM calls20
  • Tool calls20
  • Compactions0

Failed tests

  • test_core_crossing_identity_swap
  • test_errors_frames
failed
AD100-PRJ-39
Parametric audio equalizer
0/3 drivers
0.0%
0.0%
28
0.00
61.8k
296.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyhard
  • Weight28
  • Tagsmini-project, idea-19
  • Exit code0
  • Timed outFalse
  • Context tokens61,781
  • LLM calls50
  • Tool calls51
  • Compactions0

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_errors
  • test_resources
failed
AD100-PRJ-40
Barcode scanner (EAN-13)
—
—
0.0%
24
0.00
138.2k
1202.1s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight24
  • Tagsmini-project, idea-20
  • Exit code0
  • Timed outFalse
  • Context tokens138,195
  • LLM calls43
  • Tool calls45
  • Compactions1

Tests

C++ test drivers: results unavailable or incomplete.

failed
AD100-PRJ-41
JSONL chat-log to Markdown converter
27/32
84.4%
20.0%
30
6.00
164.6k
530.2s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight30
  • Tagsmini-project, idea-21
  • Exit code0
  • Timed outFalse
  • Context tokens164,604
  • LLM calls76
  • Tool calls78
  • Compactions1

Failed tests

  • test_core_unterminated_fence_runs_to_end
  • test_core_tool_result_and_empty_text
  • test_errors_unknown_type
  • test_errors_empty_role
  • test_errors_tool_call_fields
failed
AD100-PRJ-42
RFC 3986 URL utility
114/129
88.4%
0.0%
30
0.00
303.6k
1053.9s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight30
  • Tagsmini-project, idea-22, rfc3986, native-oracle
  • Exit code0
  • Timed outFalse
  • Context tokens303,615
  • LLM calls104
  • Tool calls102
  • Compactions3

Failed tests

  • test_core_normalize_literals[WSS://U%73er@%45XAMPLE:00443/a//b/%2E/../c?%2f=%41#%7e-wss://User@example/a//b/c?%2F=A#~]
  • test_core_normalize_literals[http://H%2fX:00081/?#-http://h%2Fx:81/?#]
  • test_core_query_delimiters_and_types
  • test_errors_malformed_url[http://%C3%A9/]
  • test_errors_malformed_url[http://h/\ud800]
  • test_errors_malformed_url[http://h/a\xa0b]
  • test_errors_api_types_and_escapes[encode-args9-kwargs9]
  • test_errors_api_types_and_escapes[encode-args10-kwargs10]
  • test_errors_api_types_and_escapes[encode-args11-kwargs11]
  • test_errors_api_types_and_escapes[get_query-args17-kwargs17]
  • test_errors_api_types_and_escapes[get_query-args18-kwargs18]
  • test_errors_api_types_and_escapes[set_query-args25-kwargs25]
  • test_errors_api_types_and_escapes[set_query-args26-kwargs26]
  • test_errors_all_input_length_limits
  • test_resources_long_zero_port
failed
AD100-PRJ-43
Nonlinear least-squares solver
1/3 drivers
33.3%
20.0%
7.5
1.50
330.2k
1202.1s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight7.5
  • Tagsmini-project, idea-23
  • Exit code0
  • Timed outFalse
  • Context tokens330,236
  • LLM calls122
  • Tool calls124
  • Compactions3

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_resources
passed
AD100-PRJ-44
IBAN and credit-card validator
9/9
100.0%
100.0%
6
6.00
21.0k
95.7s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyhard
  • Weight6
  • Tagsmini-project, idea-24
  • Exit code0
  • Timed outFalse
  • Context tokens20,983
  • LLM calls17
  • Tool calls18
  • Compactions0
failed
AD100-PRJ-45
Arbitrary-precision integer arithmetic
1/3 drivers
33.3%
20.0%
14.5
2.90
141.8k
1202.0s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight14.5
  • Tagsmini-project, idea-25
  • Exit code0
  • Timed outFalse
  • Context tokens141,799
  • LLM calls66
  • Tool calls69
  • Compactions1

Tests

C++ test drivers (one per hidden .cpp file).

Failed tests

  • test_core
  • test_resources
passed
AD100-PRJ-47
Recover a hidden phrase from an executable
6/6
100.0%
100.0%
5.5
5.50
33.8k
101.7s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyexpert
  • Weight5.5
  • Tagsmini-project, idea-27
  • Exit code0
  • Timed outFalse
  • Context tokens33,848
  • LLM calls30
  • Tool calls29
  • Compactions0
failed
AD100-PRJ-48
Black-box image transformation utility clone
—
—
0.0%
30
0.00
302.3k
1202.0s
DEADLINE

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagecpp
  • Difficultyexpert
  • Weight30
  • Tagsmini-project, idea-28
  • Exit code0
  • Timed outFalse
  • Context tokens302,263
  • LLM calls176
  • Tool calls176
  • Compactions3

Tests

C++ test drivers: results unavailable or incomplete.

failed
AD100-PRJ-49
Closed-loop differential-drive line follower
18/21
85.7%
40.0%
13.5
5.40
157.0k
728.4s
SUBMITTED

Challenge

  • Observed modelsbartowski/Ornith-1.5-35B-A3B-GGUF:Q4_K_M
  • Pillarproject
  • Languagepython
  • Difficultyexpert
  • Weight13.5
  • Tagsmini-project, idea-29
  • Exit code0
  • Timed outFalse
  • Context tokens157,013
  • LLM calls91
  • Tool calls92
  • Compactions1

Failed tests

  • test_core_hidden_track_completion_and_recovery[6]
  • test_core_hidden_track_completion_and_recovery[7]
  • test_core_hidden_track_completion_and_recovery[9]