Pith. sign in

Paper Citation Record · LEDGER

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation

As of 19 August 2026, this Paper Citation Record lists 50 of 50 outbound references and 1 inbound Pith citation observation for arXiv:2505.19529.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.19529 v2

Coverage vector

measured 50 of 50 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T14:17:13.982716Z

measured 51 of 51 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-19T20:22:55.750693Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

50 of 50 outbound references displayed

  • verified exact1
  • verified fuzzy18
  • unresolved31
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation ba269e43-3d07-482d-9e57-8d183c7e61d0 · outbound

This paper cites Paligemma: Towards compact vision encoders for multi- modal models.Transactions on Image Processing,.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Paligemma: Towards compact vision encoders for multi- modal models.Transactions on Image Processing,

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:17.827205Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:11.400821Z digest=sha256:fd579d96aaa8a32f481c3d122924c9bf9af26a12eca83612e05eb64bdb2134d0

Observation e57543c6-54ef-47d4-a4bd-08ba2221afcd · outbound

This paper cites In- ternvl2: Scalable multi-modal models with reduced vision encoder complexity.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation In- ternvl2: Scalable multi-modal models with reduced vision encoder complexity

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:17.607727Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:11.455294Z digest=sha256:7bdc4ddc2c15422d8c59fb6380bc73f4f7f8dd35009edea254fd5d2419ea35e8

Observation 525d393f-0f0e-47c6-b7b5-8a59b7d7bd7a · outbound

This paper cites FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.462045Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.462045Z digest=sha256:5c7c1e9b14a526f62f650545f44224cb1b9451af43e9e837a9b28f8e731dd17d

Observation 32760e6c-4e9b-4439-b832-db51f67a6641 · outbound

This paper cites Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.511088Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.511088Z digest=sha256:e6ed8138548024ad128ef6c7ca9736eda71f0bc879b789d396789182482b01fd

Observation 9e20b6e3-3618-43d1-9032-172cf5660d5e · outbound

This paper cites RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.537923Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.537923Z digest=sha256:f22baeb590ba2c4742739a45da205e17a65d5ba70d4da582a8c05ced8b0d8b16

Observation 4d57117a-8ee2-4611-88a2-76b622201287 · outbound

This paper cites Hallusionbench: an advanced diagnostic suite for entangled language hallu- cination and visual illusion in large vision-language models.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Hallusionbench: an advanced diagnostic suite for entangled language hallu- cination and visual illusion in large vision-language models

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:17.071197Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:11.622080Z digest=sha256:d9e38642b6145424a93e8062f14899421d937b790dc1eeb352bcdac5c4bb4751

Observation fea74fcc-4562-4db2-aa15-11db796590ed · outbound

This paper cites Learning both weights and connections for efficient neural networks.Advances in Neural Infor- mation Processing Systems (NeurIPS), pages 1135–1143,.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Learning both weights and connections for efficient neural networks.Advances in Neural Infor- mation Processing Systems (NeurIPS), pages 1135–1143,

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:16.844833Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:11.624558Z digest=sha256:02f3e2f0956934b29e2479dce7d265f9f7eaa60e9725336171f4b230825f9e22

Observation ff6090e1-6391-4622-93ba-414497b53be0 · outbound

This paper cites an unresolved cited work.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:17:16.646144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:11.682390Z digest=sha256:ed73d06837cb9d0e9ab9bcb2ec2234b844347fb90f65a8442c19ed9b0e0da651

Observation f8778558-a2fb-4087-b379-4913e0515162 · outbound

This paper cites Hooper and T.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Hooper and T

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:16.517334Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:11.691663Z digest=sha256:27713d5acccf1f149a521e379347c3cb138ac8888229ddc6329c0b2f9c1e902b

Observation 1d13cc24-f49a-4213-8240-4295edffd042 · outbound

This paper cites The price of prompting: Profiling energy use in large language models inference.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation The price of prompting: Profiling energy use in large language models inference

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.707616Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.707616Z digest=sha256:d8377b273675d1e7f0cef130d0ed9f874b19b83fe8a2948a5e45e2ec153ddde2

Observation bc43c28a-25c9-4381-8c83-bf0b92b7143b · outbound

This paper cites Distributionally Robust Receive Combining.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Distributionally Robust Receive Combining

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.711326Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.711326Z digest=sha256:0bb3bb70a7fea760a8b21728d365f3abaedaafe5f0778f285a81e7dc1228c8a5

Observation b72f986e-e1fa-4137-948d-6f3944b454e4 · outbound

This paper cites TinyBERT: Distilling BERT for Natural Language Understanding.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation TinyBERT: Distilling BERT for Natural Language Understanding

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.727608Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.727608Z digest=sha256:65d0e2df9dc4e5e53e5f5ff763ce84c0d9babb87734f12f68f8d779a4b277f49

Observation 08c83d54-410e-45a5-b4c7-e695f2d79c0d · outbound

This paper cites Adam: A Method for Stochastic Optimization.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Adam: A Method for Stochastic Optimization

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.863978Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.863978Z digest=sha256:e836d789139a9275b756a128c5e97685435b59170f5879b8a9cc2a508d0de3a7

Observation 27f3e6c1-68fc-4035-9afd-f44d73be0d70 · outbound

This paper cites Idefics2: Efficient multi-modal fusion with lightweight visual encoders.Transactions on Pattern Anal- ysis and Machine Intelligence,.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Idefics2: Efficient multi-modal fusion with lightweight visual encoders.Transactions on Pattern Anal- ysis and Machine Intelligence,

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:16.234259Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:12.055737Z digest=sha256:bbcb9c78a7fdfaf3cf144c3ae684e768840d58df61e0c7a344d042ca6a841eb4

Observation 3067529d-1b04-41d2-93d5-bf95167f3788 · outbound

This paper cites The Power of Scale for Parameter-Efficient Prompt Tuning.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation The Power of Scale for Parameter-Efficient Prompt Tuning

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:12.163973Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:12.163973Z digest=sha256:70ae3c5a767bfb43932720fb32f2f7e7f90bab5a0170f093b1fa2dead3ab7634

Observation 981ae193-7e67-442a-9c3b-1bf192d17e9e · outbound

This paper cites LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:12.320067Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:12.320067Z digest=sha256:f3193987899ca96d8f2ebb4396529764f78dcc55a3426df221f0f589f1be160e

Observation f737957a-7371-4b8e-aa36-43a5b9c3ab8f · outbound

This paper cites LLM-PBE: Assessing Data Privacy in Large Language Models.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation LLM-PBE: Assessing Data Privacy in Large Language Models

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:12.334623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:12.334623Z digest=sha256:984ffa1d2a7ea7234d295e9ff5a8b8c7d5708ee01a7cfd41f4d7c6ea8b17757e

Observation 0a63797f-8042-4a1f-9fa6-f06e84a5dd47 · outbound

This paper cites Sophia: A memory-efficient optimizer for large-scale model training.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Sophia: A memory-efficient optimizer for large-scale model training

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:15.892780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:12.352967Z digest=sha256:6bd8a95c1a8c31f4e19fcd36e79b8d1ec85f5e7c776fc3f131a88ac5c6ce6197

Observation c58d0578-9101-470e-9eef-932886b97af9 · outbound

This paper cites Prompt Injection attack against LLM-integrated Applications.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Prompt Injection attack against LLM-integrated Applications

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:12.481222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:12.481222Z digest=sha256:1928d62f1e228e641cbaa51df9483931b64a3fb52bfa1ae8aaecf0a41c7b4970

Observation eb9bae79-ec57-4a33-8ce0-de74faecff51 · outbound

This paper cites Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Models.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Models

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:12.496846Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:12.496846Z digest=sha256:3d34e3db1564852149310d3ae6552c09d12b6e02fae17a3ca22b9727255f23e0

Observation 1d4ac386-14aa-4d58-aa36-a2e399a61ba2 · outbound

This paper cites Decoupled Weight Decay Regularization.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Decoupled Weight Decay Regularization

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:12.591921Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:12.591921Z digest=sha256:a6ad505dec3180af2ee35bf660107ff1c2078f31407e7ce4d9769c8e62d5664b

Observation 9d9c8a15-0f85-4924-8d95-e20f4bf3def6 · outbound

This paper cites Mono-internvl: Mlp-based architectures for efficient multi-modal fusion.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Mono-internvl: Mlp-based architectures for efficient multi-modal fusion

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:15.694658Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:12.651520Z digest=sha256:c653ddb35af6fe851fc458ffddb32934f0099817eaf0077b86dbb6441721d390

Observation 1aafba37-afd3-47b5-9cbb-b195ed8b7c2c · outbound

This paper cites Mixed pre- cision training.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Mixed pre- cision training

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:15.483641Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:12.683775Z digest=sha256:2fa0b4f78571ee3993f4a74fd26c48bcdab4a81bb8ddcc8fb0932898045c39bc

Observation 26686d04-756c-47ad-92a1-c9c358329c4a · outbound

This paper cites Characterizing power management opportunities for llms in the cloud.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Characterizing power management opportunities for llms in the cloud

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:15.242828Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:12.854614Z digest=sha256:3c506ceab7510550bdf3dc72ab4e3dcf4c9360617f2b0f4323ec960608d1abaa

Observation 7a85df90-f420-45fa-bcbc-c293d55f41b0 · outbound

This paper cites RWKV: Reinventing RNNs for the Transformer Era.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation RWKV: Reinventing RNNs for the Transformer Era

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:12.868317Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:12.868317Z digest=sha256:956aa3f5c5cdf7efe4f7dc20763e8c384224080875616d9752a89eb72aa24177

Observation f7bc1586-190f-42cd-8d59-7db0f3401569 · outbound

This paper cites Language models are unsupervised multitask learners.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Language models are unsupervised multitask learners

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:15.051946Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:12.929444Z digest=sha256:6890431aa68605a4bb5c68dcc3559b6432ae5ddd8376ca43efb4dbe426b34d3c

Observation 9c80f438-bf06-4bac-9da0-17b54e578f5c · outbound

This paper cites Scaling Language Models: Methods, Analysis & Insights from Training Gopher.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Scaling Language Models: Methods, Analysis & Insights from Training Gopher

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:13.000942Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:13.000942Z digest=sha256:8c0f4dee0071d6bf8ae6f58191187b89bfdf1813f993b8e59cd4aa5cbf3aec6d

Observation 8c0302bc-9844-495f-9d82-d0cd79918f66 · outbound

This paper cites A primer in bertology: What we know about how bert works.Transactions of the Association for Com- putational Linguistics, 8:842–866,.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation A primer in bertology: What we know about how bert works.Transactions of the Association for Com- putational Linguistics, 8:842–866,

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:14.957140Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:13.036025Z digest=sha256:bf99bbb626ce0df41b9b41b62d4fdce7e62fae2c0359857f18ff0eb4617afa69

Observation 6bc4f6ac-cdfd-4a87-9005-923b38063684 · outbound

This paper cites DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:13.080609Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:13.080609Z digest=sha256:69c91a1404c59f4b195c30ff68dcf884b33b81be90865e7ccd9c934d10db5dba

Observation 22d5c83e-5765-4de7-84be-7ec87f3ab893 · outbound

This paper cites Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:13.163081Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:13.163081Z digest=sha256:ece02702e42b1211bc021886a1c893ec64cf2353c9dbfa0aacc8a7e9339d3b9e

Observation ff0c436f-f0f8-4b17-8539-95eacae40950 · outbound

This paper cites Dy- namollm: Designing llm inference clusters for performance and energy efficiency.arXiv preprint arXiv:2408.00741,.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Dy- namollm: Designing llm inference clusters for performance and energy efficiency.arXiv preprint arXiv:2408.00741,

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:13.228754Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:13.228754Z digest=sha256:3a6ced4eb44578b50d1981a5f4527edcce62b5400f539a944565fff149cba0de

Observation d664f92c-b996-4566-82f9-81bf444e72d0 · outbound

This paper cites Mobilebert: A compact task-agnostic BERT for resource-limited devices.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Mobilebert: A compact task-agnostic BERT for resource-limited devices

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:14.858591Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:13.316281Z digest=sha256:5c62683699de99c2ad8cbb01a3083d88654b07e81b257bac1401fd82dca3be3a

Observation 13675588-4f3d-41a6-9065-15e4421d2be0 · outbound

This paper cites A Simple and Effective Pruning Approach for Large Language Models.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation A Simple and Effective Pruning Approach for Large Language Models

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:13.388307Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:13.388307Z digest=sha256:7a7cc4153d18d5bfa2926ff78964c1b2c5c712a3560837a59cd391d0e12d363f

Observation 7e41aa38-ff46-4ba9-8ab9-2384f277e640 · outbound

This paper cites Baby Llama: knowledge distillation from an ensemble of teachers trained on a small dataset with no performance penalty.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Baby Llama: knowledge distillation from an ensemble of teachers trained on a small dataset with no performance penalty

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:13.520349Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:13.520349Z digest=sha256:3af47d4798c2eac3e92cbad2cea342ddcc6288640914235a0f3d73cc85384518

Observation d2d3d269-a9a6-4263-9a70-464058ce7405 · outbound

This paper cites Smoothquant: Accurate and efficient post-training quantization for large language models.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Smoothquant: Accurate and efficient post-training quantization for large language models

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:14.717813Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:13.587314Z digest=sha256:965f77baf5e61b4fd6fc2f37bccd48a2f669bd35508f8d4d47dd72ca4810c52a

Observation d9f20b2c-fff4-424d-9f38-361bf038c52f · outbound

This paper cites WizardLM: Empowering large pre-trained language models to follow complex instructions.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation WizardLM: Empowering large pre-trained language models to follow complex instructions

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:13.649125Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:13.649125Z digest=sha256:c7ee8dc41ed6290807aa575143ff38c3addd05dba7e013475ecd00167553c167

Observation 68daf60d-6e6b-400a-8df4-ab97fea72bc8 · outbound

This paper cites Privacy-Preserving Instructions for Aligning Large Language Models.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Privacy-Preserving Instructions for Aligning Large Language Models

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:13.709783Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:13.709783Z digest=sha256:5b067947e5afaa070dd96a7ae2f697d3b4600b6502203738c04121d16948488c

Observation 6295d597-242a-4e73-80ea-d1236c263649 · outbound

This paper cites LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:13.776915Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:13.776915Z digest=sha256:2052b0f783f7833dad023766da218b84c5c5904a03a5aa13e4f3a1bd0c4fb57a

Observation ebdda103-2ce5-433d-b1b2-a713d540c036 · outbound

This paper cites TinyLlama: An Open-Source Small Language Model.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation TinyLlama: An Open-Source Small Language Model

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:13.851848Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:13.851848Z digest=sha256:2026134ef13a45000de7f36c371cb798e35b1d02b9e7e0c554488ac51ee4a531

Observation bd81e855-636f-4768-bbaf-40464cf7f24e · outbound

This paper cites PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:13.922316Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:13.922316Z digest=sha256:0f83818cd52fca00c18a1471ce571ca102c342ff2a5c96b8331c59cfaa31c98e

Observation 3149eb77-4ecc-456d-83e6-c3e6e4ed1d8d · outbound

This paper cites FANNO: Augmenting High-Quality Instruction Data with Open-Sourced LLMs Only.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation FANNO: Augmenting High-Quality Instruction Data with Open-Sourced LLMs Only

Reference 51

Resolution
verified exact
local_arxiv, observed 2026-08-07T14:17:14.112359Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:13.982716Z digest=sha256:2018379a3e15f44d1115800f9a7b4a5087c0a6d165e9be10eff5fe1827d5f9d4

Observation 451a2cec-ba0e-445a-b54e-ee7e56ad6f1e · outbound

This paper cites Reformer: The Efficient Transformer.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Reformer: The Efficient Transformer

Reference 2014

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.954986Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.954986Z digest=sha256:3603a720e8aeb9b0fd4db6e49c00ee047f3040b04018c3f2b7b1449c2186e80c

Observation 18420bcd-1426-47cd-8f14-8638b35a56f6 · outbound

This paper cites Understanding the Effect of Noise in LLM Training Data with Algorithmic Chains of Thought.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Understanding the Effect of Noise in LLM Training Data with Algorithmic Chains of Thought

Reference 2015

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.627462Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.627462Z digest=sha256:b272c37e202f20d4c2718d9280ca6dded857e88b2763f15731be373e3d187345

Observation 412d6c06-8663-4262-a70b-d2b1a3d26820 · outbound

This paper cites BBQ: A Hand-Built Bias Benchmark for Question Answering.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation BBQ: A Hand-Built Bias Benchmark for Question Answering

Reference 2018

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:12.731119Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:12.731119Z digest=sha256:72c29d099258c4b7bca215f73b37247b815b8647cc15f0495708db12a37def0f

Observation f13f7814-9cee-49a6-a712-46a252697270 · outbound

This paper cites Transformers are rnns: Fast autoregressive transformers with linear attention.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Transformers are rnns: Fast autoregressive transformers with linear attention

Reference 2019

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:16.387650Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:11.784482Z digest=sha256:a05613fdd217ecc5c97cf8a7ef62a48f43a4404f54040dd3883491a830e571fd

Observation e5707c30-1294-496b-81ba-f9e3009b34fe · outbound

This paper cites Minillm: Knowledge distillation of large language models.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Minillm: Knowledge distillation of large language models

Reference 2020

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:17.297578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:11.572309Z digest=sha256:51e36d9d6ebd1ac7368c2d0f5a0dc4a6fb8c1814093401daf1a0dc23068ff1c9

Observation cc1cdb19-6f44-4ba1-8459-a4663bce7e02 · outbound

This paper cites Mini-gemini: Efficient multi-modal models with lightweight vision en- coders.Proceedings of the International Conference on Machine Learning,.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Mini-gemini: Efficient multi-modal models with lightweight vision en- coders.Proceedings of the International Conference on Machine Learning,

Reference 2021

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:16.031243Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:12.255383Z digest=sha256:aa762a6d920a245df82a9b20849958e0394e2e9f2d78439d8a8e9b59179d6375

Observation 1b73d8c0-525e-4910-83c4-2e637df2c6c0 · outbound

This paper cites GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers

Reference 2022

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.481150Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.481150Z digest=sha256:e6e1d905886be93624f59308b99714e1bdad54e7a2c8e114f160f923416d5c98

Observation 409ed7a8-8a80-494a-bfd3-2994e99998b5 · outbound

This paper cites Transformers are ssms: Generalized models and efficient algorithms through structured state space duality.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Transformers are ssms: Generalized models and efficient algorithms through structured state space duality

Reference 2023

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:17:17.457918Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T14:17:11.458535Z digest=sha256:8480462b3f56b0718daba5a88d7c84ffd620f20d15d63584b0be6ba14520e711

Observation c0ab66cc-894b-4d69-b9e9-54185a6c8210 · outbound

This paper cites Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs.

Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-07T14:17:11.452316Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:17:11.452316Z digest=sha256:28d9316b50e20fd8f5214b6ebcab353be3acd31b1974d73992be8c92dbd9e42f

Pith citing papers

Observation badbdbc5-1620-4e3c-a4d0-e4d8509464f9 · inbound

Response-free item difficulty modelling for multiple-choice items with fine-tuned transformers: Component-wise representation and multi-task learning cites this paper.

Response-free item difficulty modelling for multiple-choice items with fine-tuned transformers: Component-wise representation and multi-task learning Small Language Models: Architectures, Techniques, Evaluation, Problems and Future Adaptation

Reference 155

Resolution
verified exact
arxiv_id, observed 2026-05-19T20:23:12.763744Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=arxiv_source observed=2026-05-19T20:22:55.750693Z digest=sha256:c184e3724bee17ca0a1866865c43f193d96401235f64f6e14bf81514e2709ef2