Pith. sign in

Paper Citation Record · LEDGER

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

As of 12 August 2026, this Paper Citation Record lists 51 of 51 outbound references and 5 inbound Pith citation observations for arXiv:2502.00281.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.00281 v2

Coverage vector

measured 51 of 51 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-09T19:40:10.117050Z

measured 56 of 56 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T20:49:18.282782Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-03T09:57:56.071813Z

Reference resolution

51 of 51 outbound references displayed

  • verified exact1
  • verified fuzzy19
  • unresolved31
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e8120a2f-1ed4-4b27-a28e-bd9d932542bb · outbound

This paper cites Quadratic Gating Mixture of Experts: Statistical Insights into Self-Attention.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Quadratic Gating Mixture of Experts: Statistical Insights into Self-Attention

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.900330Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.900330Z digest=sha256:22924fa69b076684302025e21ebbdfd6ef4207f2672bf4faeca0ed7cc6f3853f

Observation c8d8891a-f976-44ad-8f0d-71c3911bb9f6 · outbound

This paper cites Brown, B.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Brown, B

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.203351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.905517Z digest=sha256:162dfb5de87fc3158103c3e53c1c15f639ef86f372c1ca055e6e148339f5847d

Observation ab4d4468-b600-4c27-98a4-acc42eef12ad · outbound

This paper cites Carion, F.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Carion, F

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.190297Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.910208Z digest=sha256:7ba31261c8d1d58f2f31a226a40888a87135d22a7442347da1f05c23698a4384

Observation 10bba22e-00dd-44fc-8f03-aeabe3451f3d · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.177037Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.914886Z digest=sha256:fd0520e3501a44be365663d91b74fbe0073335bc69219a2b589fd32c171e6cfc

Observation f0ffd833-082e-4733-997e-b698dcc0f59b · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.163315Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.919331Z digest=sha256:a0e2d243fa02826d60c5102d91365781ec62896c1a83c1409cc686e7f7c54369

Observation ae242085-d1c6-42e9-a732-924c497e3b57 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.150009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.923873Z digest=sha256:25a771e56a419c5456c36b31779ca78f623e13b91a8e47a8d41d996249047029

Observation 54a17dd1-0fea-454a-b6e9-5fe9fb1fe11a · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.136890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.928662Z digest=sha256:f60b67794e7256f0f000fb414fd73a8645881e06e6a4bd1459baa6481ce58417

Observation cf36eb1e-0b80-44d1-88ad-859c22423932 · outbound

This paper cites Csordás, K.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Csordás, K

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.123287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.932953Z digest=sha256:5ee41f2f69ce008b52d97a8049d4d91d5af92dfb3d45d53144105c92bbd91dc1

Observation e45bede9-6c9d-4f26-ad44-2b34d4e07e10 · outbound

This paper cites SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.937100Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.937100Z digest=sha256:f063f5a576ceebc58889783b256c9a4fe057f238f75ab36b71eb58cc44205291

Observation 43abca66-ad71-4c7e-97b7-77b8e897c22c · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.109063Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.941678Z digest=sha256:a632042ef4de4b1404444a09dbd8b2e1332cbbcf9cb75b40f448e0576703bc84

Observation d1b3f20a-c2fd-435f-ba94-91f6aefc0470 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.094932Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.945761Z digest=sha256:fb685cd32d89287cc5a6b3547fbc5e186b75f74f7bd92128882377eb4d11d92a

Observation fa7dafaf-4d6b-46be-baf8-2b81dce23543 · outbound

This paper cites DeepSeek-V3 Technical Report.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective DeepSeek-V3 Technical Report

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.950221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.950221Z digest=sha256:5d11cdd5eb74684469aaa14d5a0de560e3cb6e3b23d285fbbde2879abb8f52ad

Observation 253386c7-9ee4-41f6-bb58-3b149a922e74 · outbound

This paper cites Devlin, M.-W.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Devlin, M.-W

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.080979Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.954822Z digest=sha256:0cc85f3503c6e1e3084a4f23b253932a5c12a9106ce736416419f2e4e7105e3a

Observation d087c60a-ee86-406f-a0b7-7b7b0a1725e2 · outbound

This paper cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.958925Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.958925Z digest=sha256:178a920818d8b1870e68d6aebf3429d5582ce6f8256204883d924f68481e78b3

Observation 676de2a8-a1a3-4c58-a6d7-c0899e021e64 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.067577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.963234Z digest=sha256:901f078924ab20dcdc7afd6c8c50a62d8c754746e416dd610d391ed8fa1570ef

Observation 599fd6a8-175d-4b02-8c68-7a0bdd711742 · outbound

This paper cites Faria and G.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Faria and G

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.054095Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.967335Z digest=sha256:24f5eab88b3c713322f0618ed3dd05daa03324dc59bdd1862ee6944ebfa020aa

Observation 6e5711a7-2217-4e2b-a1a0-c18ff6caa360 · outbound

This paper cites Fedus, B.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Fedus, B

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.040919Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.971313Z digest=sha256:56616cd28840d6ab611f8efdc3dbe32a74d0b7fe17915f7cf462197b733e1f41

Observation db5d1512-5d0d-431c-94ef-e6f6823b6a38 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.027620Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.975323Z digest=sha256:6d7f9b810352b7e5156195951866dd507ca74616aaa4d371e3eeee46f0359897

Observation 94040920-2a3c-4ba5-8fdc-c71943b91d03 · outbound

This paper cites When Attention Sink Emerges in Language Models: An Empirical View.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective When Attention Sink Emerges in Language Models: An Empirical View

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.979304Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.979304Z digest=sha256:8d4e42f225103ef03d031d75bb50177412ed5f0ebe8349dfbff9e02083794810

Observation 5f986ff3-09af-4868-9ebb-81821c2c1630 · outbound

This paper cites Hazimeh, Z.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Hazimeh, Z

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.014277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.984123Z digest=sha256:b988a136d1ab2c7b862ef583b01d435b010012dad5442c43c2f7ba114f0fd7de

Observation bd3c8fad-4ea1-4be6-a400-ced16f5f9f9d · outbound

This paper cites Ho, C.-Y.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Ho, C.-Y

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.001140Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.988056Z digest=sha256:faad1377c96783c7bf211e0f9539ca61936ecb52a9fb53cfb039a938be57248d

Observation 6161a011-10e8-4898-a37e-5bc640160320 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.992027Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.992027Z digest=sha256:b7c1118ea7703ba717f3441ef9971da7d20678f5075a5332bb0d49758d3e34ee

Observation 538213f1-c24a-4f17-bbc8-671ad2be8eef · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.987525Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:09.996131Z digest=sha256:88436272291b5cd76893693b43fb8e96379db5166736622a0bd8a2971ec30a4e

Observation 74f79a52-ec75-4a5c-826f-5f4a8271b756 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.974348Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.000145Z digest=sha256:4afc98a851e22f1a7d834d4c57991bddeee4cbb1338a81d3dc68a97742e60b47

Observation 98d8873a-e043-433d-85a5-673f82117a78 · outbound

This paper cites Mixtral of Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Mixtral of Experts

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.004105Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.004105Z digest=sha256:c69481d1f276c675706686427b8776b276c1379a8128dbbb83e24644a79b6469

Observation bc98eb83-21b7-4899-8753-b55aa7e3fe1c · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.008682Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.008682Z digest=sha256:c0953eec8e330a7ec4a724fda0cd13c2c96bc5ec41bba73faad25b33f0168795

Observation 968242c1-feda-412c-b867-0bc959ae2c0b · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.961009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.012895Z digest=sha256:a922ebf4ec1fa5b3a5472537e2397df91880e9e606207f187766f377804f3957

Observation 2809a598-64be-4929-b590-d4fc542cf60b · outbound

This paper cites Preference Transformer: Modeling Human Preferences using Transformers for RL.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Preference Transformer: Modeling Human Preferences using Transformers for RL

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.017433Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.017433Z digest=sha256:3396b1a824e4128f5708dae57f4c54397a3f5fc7a50d7d785ad1ce6e1fc224fc

Observation 26154118-9089-4458-97a9-ec9b9e392146 · outbound

This paper cites Kwon and S.-W.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Kwon and S.-W

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.947431Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.022054Z digest=sha256:07d95e170d2c713ebd5ed228a89c637d1f15787cb89609ede9e924609881b42e

Observation 8c1220ec-2af6-4db9-af5f-a9a9b87b42bc · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.934201Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.026196Z digest=sha256:1a758021795ebbcb600515e5ec2b348d6e35c0ea12fe21e472b4ccc299182f9f

Observation b6ab5a69-e223-4325-bc4d-737676593977 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.920938Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.030423Z digest=sha256:c2d67d382377a73512c30996ef62a4f7d0ff4ac6ede773a4493ecafe2e890a27

Observation eaad19f3-c0ac-42c3-9944-674c11baa8d1 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.907333Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.034812Z digest=sha256:1d73f4da9368b9853003bafdca03911bee65be9a6202dd7e39bf697a7540a55f

Observation 80e2ac64-eebf-441c-8ea6-aa3007049d4c · outbound

This paper cites Manole and N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Manole and N

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.893918Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.039164Z digest=sha256:25f9c364162d6f1327a9b4c302f1d63ad2eb9db6ddc7f5571b370400aaa59eb6

Observation 6a9355de-8d42-45e6-938a-9fc09e2c4049 · outbound

This paper cites Convergence Rates for Mixture-of-Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Convergence Rates for Mixture-of-Experts

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.043497Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.043497Z digest=sha256:a814f9d7495a1d9fba45f1fcc267c3dd4b39c6f3e5f3ff5a87c42ba3058f720e

Observation 71feb4ba-a7e5-46a1-9945-9ceb7a7c5eab · outbound

This paper cites OLMoE: Open Mixture-of-Experts Language Models.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective OLMoE: Open Mixture-of-Experts Language Models

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.047855Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.047855Z digest=sha256:eb24640b73cbe1f33c421c4de256f568e5864fd3b4b67c8fdc86e89b974d3b56

Observation ab56543d-cac9-4b9e-be45-9a0e599f7307 · outbound

This paper cites Nguyen, P.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Nguyen, P

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.879965Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.052583Z digest=sha256:6bafd3c059d684602e11b5052b7e76b59ba2b7fbaca9616d5fc03dd723d8cba2

Observation baf56675-9f9b-45f7-8540-65b729d3bb66 · outbound

This paper cites On Expert Estimation in Hierarchical Mixture of Experts: Beyond Softmax Gating Functions.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective On Expert Estimation in Hierarchical Mixture of Experts: Beyond Softmax Gating Functions

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.056730Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.056730Z digest=sha256:7367c2d60362364a4bce867e247708e0e0fdcccf4fa9fbe067977ce272e2f59a

Observation 6178e07b-b68c-43de-8d2f-3c8027c7b27f · outbound

This paper cites Nguyen, N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Nguyen, N

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.865963Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.061063Z digest=sha256:46685cb8646293129b0643eb1b12d4977faa30a887a8c5ab779b5d0d8a327bd9

Observation e3a0f99e-2ecb-428b-9498-90a9b789db58 · outbound

This paper cites Nguyen, T.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Nguyen, T

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.851697Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.065429Z digest=sha256:80276771d7e92c414576508fed2222b624e68890cd6a74a698426b97c9013489

Observation 30a20f9a-c936-4ee9-a8e3-552c09ce2cfa · outbound

This paper cites Puigcerver, C.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Puigcerver, C

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.837621Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.069969Z digest=sha256:6cd3a8e4cd358455b6911852d5ca29acf12572ff4c18354974215e8b1d13ccd4

Observation c65e66c5-abe5-4307-b1ff-9a324a67e769 · outbound

This paper cites Radford, J.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Radford, J

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.823953Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.074169Z digest=sha256:3026ded8e8a3651d6303dce644ca4909d8ff62fda575a1fb04082f8b8d9f3083

Observation 07cf5d11-6c29-4bff-b1d7-cee2ebcd2739 · outbound

This paper cites Raffel, N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Raffel, N

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.809871Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.078721Z digest=sha256:f097a29a52d5ca26f75f07f345297bc7583865ddaefb4bb338a2058b4712c700

Observation 83fe0c0b-b786-43e1-a462-f18671deb5dd · outbound

This paper cites Theory, Analysis, and Best Practices for Sigmoid Self-Attention.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.082924Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.082924Z digest=sha256:46e79b6cccc612fd30cd65a934ca1822c748c7348538ce6aafe3ab9e2d0c86dd

Observation 415866f7-466c-4977-a643-b7911dea9cdb · outbound

This paper cites Shazeer, A.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Shazeer, A

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.793983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.087570Z digest=sha256:e401fc47da0612ffe4471d521cbe04856e0567249084cc4aa7c294910c870964

Observation 45f5aca0-f4ac-43fe-8be7-60ea9fe12926 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective LLaMA: Open and Efficient Foundation Language Models

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.091745Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.091745Z digest=sha256:4900e05abfd9c066105099cdb1007458a9d090165952df13f289106635e28f36

Observation 361ce6d9-8ada-43f5-a50d-41c25448b45a · outbound

This paper cites van de Geer.Empirical Processes in M-estimation.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective van de Geer.Empirical Processes in M-estimation

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.780108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.095973Z digest=sha256:6ceb29b75cc1329be3eac9182f2b5640bd3443b87268d0d2d9ceeacd91781169

Observation 5a7d2c5b-9169-40d2-a67b-7d18cfeb4396 · outbound

This paper cites Vaswani, N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Vaswani, N

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.765132Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.100075Z digest=sha256:f8d614a5147e3c0be6aa8e8630a192d99f1a42a6bf0f0c107f5715ad3250fcab

Observation 1c69072e-898a-4f23-bf1b-49ea75647eba · outbound

This paper cites Multi-Head Mixture-of-Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Multi-Head Mixture-of-Experts

Reference 48

Resolution
verified exact
local_arxiv, observed 2026-08-09T19:40:10.171584Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.104099Z digest=sha256:6e5ddce506f537581336f1eda653b326aaa5b5d730c028b9a95fd48c49868bd3

Observation 39cfab8e-90a2-4419-8c76-e23f39afd472 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.751070Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.108506Z digest=sha256:0f6e1f21ec8ca76a3934b1b2da588ee1b113df9fe1c5be7855c7d08e1f3bb006

Observation fc2b7f1a-0b9a-425a-a8a9-b788e2943258 · outbound

This paper cites SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.112733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.112733Z digest=sha256:8fd246f7493e17e21111baf2b9af99771055d0bb0215e924b2e01ddd49adc883

Observation 39ae668c-00e4-4f95-b16e-470717cc645f · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.736837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-09T19:40:10.117050Z digest=sha256:227e0521bda1baf7fc746aaf483fd4247dd61cd0030b8f1eafc8f2e7087341a1

Pith citing papers

Observation 74902ead-3577-4d01-9a87-7f7862c4d1c6 · inbound

SAGE: Shape-Adapting Gated Experts for Adaptive Histopathology Image Segmentation cites this paper.

SAGE: Shape-Adapting Gated Experts for Adaptive Histopathology Image Segmentation Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-03T20:49:18.282782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T20:49:18.282782Z digest=sha256:652a7ec0c16e5907eeaa5f9ea5e925141ac807ad195f1782fee55788b254aefa

Observation 62cb4b34-ec64-48a5-a379-5011aaab5a53 · inbound

Integrated electro-optic attention nonlinearities for transformers cites this paper.

Integrated electro-optic attention nonlinearities for transformers Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 12

Resolution
verified exact
arxiv_id, observed 2026-05-11T06:20:58.535002Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-10T17:40:50.396800Z digest=sha256:d325e3fe6936a85e788ae20d3192627da4ce8f5dfdb7dc6cffbd5457d199f47e

Observation f2b15b6b-1169-4598-853c-f53962355732 · inbound

Convergence Rates for Latent Mixing Measures in Infinite Homoscedastic Location-Scale Mixture Models cites this paper.

Convergence Rates for Latent Mixing Measures in Infinite Homoscedastic Location-Scale Mixture Models Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 97

Resolution
metadata mismatch
arxiv_id, observed 2026-05-11T04:50:55.274953Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=arxiv_source observed=2026-05-11T01:03:12.737706Z digest=sha256:f079c3c90c123bd3c48c297b30c0d540d7e742439656831e478a2fc24e4d0ad2

Observation a1ff76b9-ee72-4d8c-8925-53542b2ad83e · inbound

Efficient Implementation of an Adaptive Transformer Accelerator for Massive MIMO Outdoor Localization cites this paper.

Efficient Implementation of an Adaptive Transformer Accelerator for Massive MIMO Outdoor Localization Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 20

Resolution
verified exact
arxiv_id, observed 2026-05-14T18:27:35.241620Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-14T18:27:21.248464Z digest=sha256:2e2a60c2245b6b18e47b205f52fc9a940543991daf8447f8cd385fa1c2262df2

Observation 1b5517cb-1af4-4347-9199-1a246cf347ee · inbound

Boltzmann Attention: Learnable Ising Couplings for Cooperative Attention cites this paper.

Boltzmann Attention: Learnable Ising Couplings for Cooperative Attention Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 16

Resolution
verified exact
arxiv_id, observed 2026-07-03T09:57:56.073408Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-06-27T10:18:40.938618Z digest=sha256:637aa95d053a9735a51066905d5eb5d3fa8470de628b0af0ef6fd67fecb18948