pith:XC46HSFB
Dooly: Configuration-Agnostic, Redundancy-Aware Profiling for LLM Inference Simulation
Dooly reuses profiled LLM operation latencies across model configurations by tracing input-dimension origins in a single inference pass.
arxiv:2605.07985 v2 · 2026-05-08 · cs.DC · cs.AI
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{XC46HSFBDQEO3FT2RVX65HMIWN}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
Across two GPU platforms, three attention backends, and diverse model architectures, Dooly achieves simulation accuracy within 5% MAPE for TTFT and 8% for TPOT while reducing profiling GPU-hours by 56.4% across 12 models compared to the existing profiling approach.
That labeling input dimensions by origin via taint propagation during one inference pass is sufficient to identify all reusable operations across arbitrary model configurations, and that the resulting latency database plus regression models generalize without hidden dependencies or post-hoc tuning.
Dooly reduces LLM inference profiling costs by 56.4% via configuration-agnostic taint-based labeling and selective database reuse, delivering simulation accuracy within 5% MAPE for TTFT and 8% for TPOT across 12 models.
Receipt and verification
| First computed | 2026-05-22T01:04:05.469584Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
b8b9e3c8a11c08ed967a8d6fee9d88b3720dc03a369c9f993c71a982301ed297
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/XC46HSFBDQEO3FT2RVX65HMIWN \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: b8b9e3c8a11c08ed967a8d6fee9d88b3720dc03a369c9f993c71a982301ed297
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "834ef73fc769407acf33c8e36ffc97a63b6e35819da18dbebc1f198915b12784",
"cross_cats_sorted": [
"cs.AI"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.DC",
"submitted_at": "2026-05-08T16:44:47Z",
"title_canon_sha256": "d776310694207b5c955b74fc08e4fdfe53a7d02b736402c7ec58d1ee6ba53c83"
},
"schema_version": "1.0",
"source": {
"id": "2605.07985",
"kind": "arxiv",
"version": 2
}
}