Qwen3.8 Flash Next DeepSWE benchmark results, task by task

All 113 DeepSWE 1.1 tasks for Qwen3.8 Flash Next on one DGX Spark, next to DeepSeek V4 Flash: pass/fail, tests passed, agent steps, time and context use per task.

Per-task results behind Best LLM for a single DGX Spark: Qwen3.8 Flash Next DeepSWE benchmark results. Qwen3.8 Flash Next (NVFP4, vLLM, 262K context, four tasks at once) solved 62 of 113 (54.9%); DeepSeek V4 Flash (EXL3 3-bpw, 384K context, one at a time) solved 51 of 113 (45.1%) on the same tasks. A task counts as solved only when every target test passes and no existing test breaks. The DeepSeek run is written up in Running DeepSeek V4 Flash across all of DeepSWE on one DGX Spark.

By language

Language	Tasks	Qwen3.8 Flash Next	DeepSeek V4 Flash
typescript	35	13	13
go	34	23	18
python	34	21	17
rust	5	1	3
javascript	5	4	0

Every task

Tests are fail-to-pass (target) tests passed. Context is the peak prompt as a share of the 262,144-token window.

Task	Repo	Lang	Qwen	Qwen tests	Steps	Min	Context	DeepSeek	DeepSeek tests	Note
abs-module-cache-flags	abs-lang/abs	go	✗	18/20	123	80	62%	✓	20/20
abs-stepped-slices	abs-lang/abs	go	✓	6/6	71	48	36%	✓	6/6
actionlint-action-pinning-lint	rhysd/actionlint	go	✓	55/55	137	72	73%	✗	54/55
adaptix-name-mapping-aliases	reagento/adaptix	python	✓	44/44	137	91	86%	✓	44/44
aiomonitor-task-snapshots-diff	aio-libs/aiomonitor	python	✓	53/53	95	73	58%	✗	52/53
anko-default-function-arguments	mattn/anko	go	✓	2/2	86	92	62%	✓	2/2
anko-typed-variable-bindings	mattn/anko	go	✓	9/9	82	75	68%	✓	9/9
arcane-drift-detection-baselines	getarcaneapp/arcane	go	✓	82/82	145	92	68%	✓	82/82
arktype-json-schema-refs-dependencies	arktypeio/arktype	typescript	✗	23/25	137	107	81%	✗	23/25	broke 1 existing test
awilix-async-container-initialization	jeffijoe/awilix	typescript	✗	23/24	83	62	66%	✗	23/24
bandit-incremental-cache-control	PyCQA/bandit	python	✓	88/88	121	87	73%	✗	87/88
bandit-interprocedural-taint-checks	PyCQA/bandit	python	✓	66/66	148	101	79%	✓	66/66
bandit-structured-nosec-directives	PyCQA/bandit	python	✗	69/69	77	91	64%	✓	69/69	broke 1 existing test
boa-hierarchical-evaluation-cancellation	boa-dev/boa	rust	✗	0/17	162	88	78%	✓	17/17
cattrs-partial-structuring-recovery	python-attrs/cattrs	python	✓	69/69	127	78	64%	✗	67/69
clack-async-autocomplete-options	bombshell-dev/clack	typescript	✓	82/82	78	64	46%	✗	74/82
claude-code-by-agents-recursive-delegation	baryhuang/claude-code-by-agents	typescript	✓	7/7	67	59	55%	✗	2/7
cliffy-config-file-parsing	c4spar/cliffy	typescript	✓	37/37	105	52	66%	✗	36/37
csstree-shorthand-expansion-compression	csstree/csstree	javascript	✗	73/79	80	94	70%	✗	74/79
dasel-html-document-format	TomWright/dasel	go	✓	146/146	96	87	61%	✗	144/146
dateutil-rfc5545-timezone-interop	dateutil/dateutil	python	✓	67/67	110	104	89%	✗	65/67
drizzle-orm-window-function-builders	drizzle-team/drizzle-orm	typescript	✗	128/130	131	75	66%	✗	115/130
dynamodb-toolbox-conditional-attribute-requirements	dynamodb-toolbox/dynamodb-toolbox	typescript	✗	0/31	172	100	94%	✓	31/31	ran out of context
dynamodb-toolbox-lazy-recursive-schemas	dynamodb-toolbox/dynamodb-toolbox	typescript	✗	32/37	161	92	94%	✓	37/37	ran out of context
effect-sse-httpapi-streaming	Effect-TS/effect	typescript	✗	0/47	192	108	94%	✗	43/47	ran out of context
eicrud-keyset-pagination-cursor	eicrud/eicrud	typescript	✗	10/14	146	83	74%	✓	14/14	broke 4 existing tests
etree-xml-diff-patch	beevik/etree	go	✗	51/52	93	129	71%	✓	52/52
expr-try-catch-errors	expr-lang/expr	go	✓	79/79	179	117	94%	✗	77/79	ran out of context
fastapi-deprecation-response-headers	fastapi/fastapi	python	✗	134/137	95	59	52%	✗	136/137
fastapi-implicit-head-options	fastapi/fastapi	python	✗	38/43	168	116	85%	✓	43/43
fd-deterministic-multi-key-sorting	sharkdp/fd	rust	✓	43/43	146	84	77%	✓	43/43
geo-shapeindex-serialization	golang/geo	go	✓	24/24	147	117	88%	✗	14/24
go-critic-doc-link-checker	go-critic/go-critic	go	✗	2/3	171	108	67%	✗	2/3	broke 1 existing test
go-genai-streamed-function-args	googleapis/go-genai	go	✓	6/6	90	85	63%	✓	6/6
go-git-worktree-merge-conflicts	go-git/go-git	go	✓	17/17	149	191	83%	✓	17/17
goreleaser-retry-publish-auditing	goreleaser/goreleaser	go	✓	29/29	174	155	68%	✓	29/29
gql-incremental-graphql-delivery	graphql-python/gql	python	✗	17/17	131	110	70%	✗	14/17	broke 1 existing test
happy-dom-abort-pending-body-reads	capricorn86/happy-dom	typescript	✗	0/14	161	151	93%	✓	14/14	ran out of context
happy-dom-deterministic-intersectionobserver	capricorn86/happy-dom	typescript	✗	13/14	165	159	75%	✗	13/14
helm-array-merge-strategies	helm/helm	go	✓	47/47	160	102	78%	✓	47/47
helm-unified-manifest-stream	helm/helm	go	✓	5/5	167	108	81%	✓	5/5
httpx-deterministic-cookie-store	encode/httpx	typescript	✓	115/115	70	63	47%	✗	113/115
httpx-multipart-response-parsing	encode/httpx	python	✗	121/122	83	57	48%	✓	122/122
httpx-streaming-json-iteration	encode/httpx	python	✓	108/108	83	54	50%	✓	108/108
igel-persist-feature-schema	nidhaloff/igel	python	✗	6/24	94	75	57%	✗	6/24
ink-grid-box-layout	vadimdemedes/ink	typescript	✗	23/25	149	122	85%	✗	20/25
ipython-session-bundle-replay	ipython/ipython	python	✓	17/17	140	93	67%	✗	4/17
katex-multicolumn-array-spans	KaTeX/KaTeX	javascript	✓	94/94	111	97	74%	✗	92/94
kcp-go-multiplexed-kcp-streams	xtaci/kcp-go	go	✗	28/30	108	114	55%	✓	30/30
kea-atomic-signal-selectors	keajs/kea	typescript	✗	11/12	144	171	82%	✗	11/12
kgateway-consistent-hash-policy	kgateway-dev/kgateway	go	✓	2/2	168	92	69%	✓	2/2
kombu-single-active-consumer-priority	celery/kombu	python	✓	85/85	114	74	68%	✗	84/85
kombu-virtual-queue-dead-lettering	celery/kombu	python	✗	74/76	128	98	80%	✗	66/76
koota-composite-trait-aspects	pmndrs/koota	typescript	✗	0/51	139	91	93%	✗	49/51	ran out of context
koota-deferred-mutation-buffer	pmndrs/koota	typescript	✗	0/71	115	130	94%	✗	70/71	ran out of context
koota-entity-snapshot-rollback	pmndrs/koota	python	✓	84/84	93	77	71%	✓	84/84
koota-pair-relation-tracking	pmndrs/koota	typescript	✗	0/38	100	98	93%	✓	38/38	ran out of context
koota-query-predicates	pmndrs/koota	typescript	✗	0/43	140	105	93%	✗	39/43	ran out of context
kysely-window-grouping-helpers	kysely-org/kysely	typescript	✓	254/254	146	113	89%	✗	0/254
langchain-request-coalescing	langchain-ai/langchain	python	✓	50/50	155	178	90%	✗	44/50
mashumaro-flattened-dataclass-fields	Fatal1ty/mashumaro	python	✓	66/66	125	72	74%	✗	63/66
meriyah-explicit-resource-declarations	meriyah/meriyah	typescript	✗	46/49	175	89	84%	✓	49/49
mnamer-daemon-watch-lifecycle	jkwill87/mnamer	python	✓	51/51	79	129	48%	✗	34/51
mobly-grouped-test-barriers	google/mobly	python	✓	79/79	85	112	55%	✓	79/79
narwhals-rolling-window-suite	narwhals-dev/narwhals	python	✗	0/103	153	118	93%	✓	103/103	ran out of context
numba-stencil-boundary-modes	numba/numba	python	✓	29/29	166	115	85%	✓	29/29
obsidian-linter-auto-table-of-contents	platers/obsidian-linter	typescript	✗	0/41	79	61	58%	✗	33/41
obsidian-linter-link-format-conversion	platers/obsidian-linter	typescript	✗	56/60	82	72	66%	✗	59/60
obsidian-linter-scoped-ignore-markers	platers/obsidian-linter	typescript	✗	30/33	103	102	83%	✓	33/33
ofetch-per-origin-circuit-breaker	unjs/ofetch	typescript	✓	47/47	82	78	73%	✓	47/47
onedump-dump-encryption-pipeline	liweiyi88/onedump	go	✓	82/82	85	73	44%	✗	15/82
opa-rego-rule-profiling	open-policy-agent/opa	go	✗	24/25	131	86	62%	✓	25/25
opa-template-string-reconstruction	open-policy-agent/opa	go	✗	0/5	190	127	94%	✗	2/5	ran out of context
optique-conditional-option-dependencies	dahlia/optique	typescript	✓	36/36	164	93	80%	✓	36/36
oxvg-structural-selector-preservation	noahbald/oxvg	rust	✗	0/6	148	95	93%	✓	6/6	ran out of context
participle-grammar-conflict-analysis	alecthomas/participle	go	✓	91/91	108	85	65%	✗	89/91
pebble-durability-wait-apis	cockroachdb/pebble	go	✓	59/59	143	100	71%	✗	58/59
pest-character-class-coalescing	pest-parser/pest	rust	✗	100/104	169	105	82%	✗	100/104	broke 1 existing test
prometheus-transactional-reload-status	prometheus/prometheus	typescript	✗	10/15	157	95	78%	✗	15/15	broke 10 existing tests
prometheus-typed-label-sorting	prometheus/prometheus	go	✗	0/17	109	79	59%	✗	16/17
psd-tools-blend-range-api	psd-tools/psd-tools	python	✓	45/45	108	65	63%	✓	45/45
pwntools-tube-multiplexing	Gallopsled/pwntools	python	✓	73/73	130	136	73%	✓	73/73
python-statemachine-state-data-scoping	fgmacedo/python-statemachine	python	✗	0/72	177	94	93%	✗	68/72	ran out of context
query-persist-restored-query-state	TanStack/query	typescript	✓	8/8	168	97	83%	✗	8/8
quill-shared-toolbar-focus	slab/quill	typescript	✓	13/13	131	93	88%	✗	11/13
returns-validated-error-accumulation	dry-python/returns	python	✓	159/159	99	51	61%	✓	159/159
scc-bounded-memory-spilling	boyter/scc	go	✓	31/31	159	104	79%	✗	28/31
scriggo-method-declarations	open2b/scriggo	go	✓	48/48	128	107	94%	✓	48/48	ran out of context
skrub-duration-encoding	skrub-data/skrub	python	✓	130/130	140	84	76%	✓	130/130
sql-formatter-bigquery-pipe-formatting	sql-formatter-org/sql-formatter	typescript	✓	26/26	94	63	56%	✓	26/26
sqlfmt-create-table-ddl-formatting	tconbeer/sqlfmt	python	✗	0/32	106	131	94%	✗	28/32	ran out of context
sqlite-utils-safe-import-checkpoints	simonw/sqlite-utils	python	✗	58/60	156	101	91%	✓	60/60
superjson-error-stack-serialization	flightcontrolhq/superjson	typescript	✓	80/80	55	69	45%	✗	73/80
task-task-graph-export	go-task/task	go	✓	20/20	170	95	72%	✓	20/20
tengo-callable-instance-isolation	d5/tengo	go	✓	23/23	126	104	79%	✗	21/23
tengo-destructuring-bindings	d5/tengo	go	✗	0/91	130	92	93%	✗	86/91	ran out of context
termenv-preserve-ansi-resets	muesli/termenv	go	✗	34/35	74	81	55%	✗	28/35
testem-bail-on-test-failure	testem/testem	javascript	✓	90/90	113	80	79%	✗	55/90
testem-per-launcher-reports	testem/testem	javascript	✓	65/65	95	55	50%	✗	64/65
textual-kitty-key-phases	Textualize/textual	python	✗	21/23	137	115	81%	✗	12/23
textual-richlog-follow-state	Textualize/textual	python	✓	20/20	180	116	89%	✗	14/20
tomlkit-toml-table-converters	python-poetry/tomlkit	python	✗	0/60	155	141	94%	✓	60/60	ran out of context
true-myth-iterable-collection-combinators	true-myth/true-myth	typescript	✗	94/96	127	101	82%	✓	96/96
ts-pattern-match-each	gvergnaud/ts-pattern	typescript	✓	85/85	60	47	43%	✓	85/85
updo-policy-alerting	Owloops/updo	go	✗	15/17	99	79	64%	✓	17/17
valibot-recursive-schema-composition	open-circle/valibot	typescript	✗	0/10	108	121	93%	✗	2/10	ran out of context
vitest-duration-sharding	vitest-dev/vitest	typescript	✓	56/56	194	93	86%	✓	56/56
vulture-persistent-analysis-cache	jendrikseipp/vulture	python	✓	24/24	85	87	54%	✓	24/24
wasmi-trap-coredumps	wasmi-labs/wasmi	rust	✗	0/22	142	95	93%	✗	0/22	ran out of context
wazero-multi-module-snapshots	wazero/wazero	go	✓	78/78	101	97	63%	✓	78/78
yaegi-go-embed-directives	traefik/yaegi	go	✓	38/38	205	106	94%	✗	0/38	ran out of context
yjs-map-conflict-detection	yjs/yjs	javascript	✓	9/9	110	70	71%	✗	8/9
ytt-jsonpath-query-api	carvel-dev/ytt	go	✗	12/103	100	66	61%	✗	102/103

Each task was run once at temperature 1.0 with the stock mini-swe-agent prompt and reasoning effort xhigh; the DeepSeek run used a custom prompt at max reasoning. One Qwen task (gql-incremental-graphql-delivery) was re-run after an infrastructure error deleted its Docker image before the agent started.