Pith. sign in

Paper Citation Record · LEDGER

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models

As of 14 August 2026, this Paper Citation Record lists 52 of 52 outbound references and 0 inbound Pith citation observations for arXiv:2501.10714.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2501.10714 v1

Coverage vector

measured 52 of 52 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-10T19:05:55.300522Z

measured 52 of 52 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-13T06:32:02.005865+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

52 of 52 outbound references displayed

  • verified exact0
  • verified fuzzy34
  • unresolved18
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 6eca6e43-5a8a-4632-be01-fc69e718477d · outbound

This paper cites https://developer.nvidia.com/blog/doubling-all2all- performance-with-nvidia-collective-communication-library-2-12/.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models https://developer.nvidia.com/blog/doubling-all2all- performance-with-nvidia-collective-communication-library-2-12/

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.906955Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.113340Z digest=sha256:5be740683b77a72b18d2c3ed8cd0e80499160d6b80180e700922d137fcd79b43

Observation 7ae7939d-1a8c-450f-ae8a-9912a56d556d · outbound

This paper cites Deepspeed-inference: enabling efficient infer- ence of transformer models at unprecedented scale.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Deepspeed-inference: enabling efficient infer- ence of transformer models at unprecedented scale

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.895967Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.117819Z digest=sha256:1518abbd6c5b0a4593517a676c454ca7734acc9a2105dca85cc5cbcb1303b489

Observation a8bf19b0-5037-4016-a15e-e11f7b484f37 · outbound

This paper cites Language models are few-shot learners.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Language models are few-shot learners

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.121971Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.121971Z digest=sha256:56e1c07c6f84c6599253180b13ccea00171b208f3469caafb9e17fc380e278cd

Observation 0dfe1503-fe16-4ecd-9e8c-9c6b07ef8dd9 · outbound

This paper cites FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.126143Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.126143Z digest=sha256:79c6a2b28176dbb958f7fc95900424ce593c6fbe46c957cec2a221f4d2a3a11f

Observation 07bbda01-9b0a-45de-a31f-80cd7be94982 · outbound

This paper cites Centauri: Enabling efficient sched- uling for communication-computation overlap in large model train- ing via communication partitioning.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Centauri: Enabling efficient sched- uling for communication-computation overlap in large model train- ing via communication partitioning

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.877549Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.130548Z digest=sha256:d6a5fee5a6cc8ab0bd45e0174b25c9082af4441074543a8c7a0d3dfb98e16dd1

Observation 2c3471e6-22bb-4817-a501-5d26b5371634 · outbound

This paper cites On the representation collapse of sparse mixture of experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models On the representation collapse of sparse mixture of experts

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.866473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.134272Z digest=sha256:ba1d9e24ae2e37881a9d3461e935a6ce40a2c3e798e3f3472f8daadad74e15e3

Observation 91b8be49-ef8e-47b9-87da-b812022e2b72 · outbound

This paper cites Palm: Scaling language modeling with pathways.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Palm: Scaling language modeling with pathways

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.138161Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.138161Z digest=sha256:f688397fecb4cd1be4f0f8eb4eddc26172c1431b3176c9bbc6de228dd92d04c6

Observation 96093689-98ff-4c7c-82c8-acc315e8ae4f · outbound

This paper cites Stablemoe: Stable routing strategy for mixture of experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Stablemoe: Stable routing strategy for mixture of experts

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.849207Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.141579Z digest=sha256:04d1f56960965fe6263577f9f339ae0973a32cfa30ddb927548f03dfd936e4e9

Observation a9ed7357-2285-4a41-83fc-f6ff33610287 · outbound

This paper cites Large scale distributed deep networks.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Large scale distributed deep networks

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.145012Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.145012Z digest=sha256:48b0f338e74f2e1b1b32750fff77d10d991259f606c4cdffea288756f2c43ffa

Observation 27b22620-c9b6-4b58-bc38-3cf0ad4ac1fd · outbound

This paper cites Deepseek-v2: A strong, economical, and efficient mixture-of-experts language model, 2024.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Deepseek-v2: A strong, economical, and efficient mixture-of-experts language model, 2024

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.148417Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.148417Z digest=sha256:fb68e5550554eac3ee8fa687b4f95c72ef7b2f0f8b120e890f907a3f65e6b085

Observation b705c846-265e-4b57-8a8f-d58dbca2b99f · outbound

This paper cites PaLM-E: An Embodied Multimodal Language Model.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models PaLM-E: An Embodied Multimodal Language Model

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.151848Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.151848Z digest=sha256:0563778a3083d811c05874c5919ddc5c3e56ffe09ca835b3cb75557820e87f4b

Observation f150b62a-8c17-4517-afe3-92c62b7d4306 · outbound

This paper cites Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.155744Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.155744Z digest=sha256:b7cb432ed6efb2f25922d4ad258af71560d616ffd1ec5f782ec544b662e1bcc1

Observation e984d50e-df31-4780-aa12-a2adcb3a7427 · outbound

This paper cites FastMoE: A Fast Mixture-of-Expert Training System.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models FastMoE: A Fast Mixture-of-Expert Training System

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.159063Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.159063Z digest=sha256:0697cc773ec462ed36e1188f2ab5a6561d875b9936305131f98c8bfd00da25e9

Observation 3f4daa76-9012-4571-9e41-e1ff91bc8ae1 · outbound

This paper cites FasterMoE: modeling and optimizing training of large-scale dynamic pre-trained models.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models FasterMoE: modeling and optimizing training of large-scale dynamic pre-trained models

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.815293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.163115Z digest=sha256:befde24dbd46d53430c5647de197cb2ae77aa634a315f1572e4c0482237967bc

Observation 18eda69a-b686-4d42-ba83-a3c27739cd61 · outbound

This paper cites Gpipe: Efficient training of giant neural networks using pipeline parallelism.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Gpipe: Efficient training of giant neural networks using pipeline parallelism

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.166393Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.166393Z digest=sha256:d817df038ade7617d5e144279985fb5e47a62256efc0c6871dbd0607d76d2902

Observation 78f4a3b7-a753-4059-98a5-2809dbed33f5 · outbound

This paper cites Experts Weights Averaging: A New General Training Scheme for Vision Transformers.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Experts Weights Averaging: A New General Training Scheme for Vision Transformers

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.169824Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.169824Z digest=sha256:d64cd9078c175a5b9302a2f71a7ecc09afdcfb99ad96889b24c0396ac7b512e8

Observation 634bc3ae-50d3-473e-a721-10f5ad0a058d · outbound

This paper cites Tutel: Adaptive mixture-of-experts at scale.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Tutel: Adaptive mixture-of-experts at scale

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.797394Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.173791Z digest=sha256:b9295edebec7b6bac48057027e34d307cc95b298adce95df743533b862f16e31

Observation 83246816-fbbf-4c31-8cf4-f1b71791528f · outbound

This paper cites Breaking the computation and communication abstraction barrier in distributed machine learning workloads.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Breaking the computation and communication abstraction barrier in distributed machine learning workloads

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.786294Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.177255Z digest=sha256:190d25eaefa602ddcd495f996a6aefb6fb2ba876870e6ab6401420eb28d9f549

Observation 7088d145-0197-4f83-ab97-0eee12afdced · outbound

This paper cites Highly scalable deep learning training system with mixed-precision: Training ImageNet in four minutes.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Highly scalable deep learning training system with mixed-precision: Training ImageNet in four minutes

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.775383Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.180968Z digest=sha256:10c55e2b9077d501e2986ff21493a287f86baa9ba71379269c7c03b61b220656

Observation e201b5e5-da61-4f10-9622-d1c5cf2c216a · outbound

This paper cites Mixtral of Experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Mixtral of Experts

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.184623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.184623Z digest=sha256:b8409f86e106688e366a926c2c69198cfd1d9470012abdb4d052d6259ef085d1

Observation fd46062d-05f2-4e73-b91b-3ebd3e54bb9d · outbound

This paper cites Lancet: Accelerating mixture-of-experts training by over- lapping weight gradient computation and all-to-all communication.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Lancet: Accelerating mixture-of-experts training by over- lapping weight gradient computation and all-to-all communication

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.763414Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.188654Z digest=sha256:c89f86fdcf062b5eb72ea94aedf7ef1cafe5a3a3a747f569891d6b44db44da43

Observation 339ab4a9-001b-4c33-a978-aa7fe1876c84 · outbound

This paper cites Gshard: Scaling giant models with conditional compu- tation and automatic sharding.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Gshard: Scaling giant models with conditional compu- tation and automatic sharding

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.752070Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.192429Z digest=sha256:a424053b96a1b0691335ce25b465628ade6a914c5e1cabf761653eaa577b03d5

Observation b95e5bc8-9bad-4eae-b600-eddb1a94b54b · outbound

This paper cites BASE layers: Simplifying training of large, sparse models.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models BASE layers: Simplifying training of large, sparse models

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.741240Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.196205Z digest=sha256:d16e523606c1b2910efd47637869d73516db30f3bb8fbbf85f2532fda2a385b9

Observation 8fb7b99b-61d0-48b7-882b-b28145780031 · outbound

This paper cites Acceler- ating distributed{MoE} training and inference with lina.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Acceler- ating distributed{MoE} training and inference with lina

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.730249Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.199901Z digest=sha256:73ec1a87ffd182ed731845c7723e24426580a76da1ebb559837b80bd7fb6a362

Observation 71b22f36-7a78-4d02-b6df-3910757c8aae · outbound

This paper cites Janus: A unified dis- tributed training framework for sparse mixture-of-experts models.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Janus: A unified dis- tributed training framework for sparse mixture-of-experts models

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.717844Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.203250Z digest=sha256:7f8071d018f1fdf9fa6234bb90294b24af986496137041f42f838b7e6cfd8d53

Observation 36092380-1151-4b27-8fc5-ccf28957205b · outbound

This paper cites Gating dropout: Communication-efficient regularization for sparsely activated transformers.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Gating dropout: Communication-efficient regularization for sparsely activated transformers

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.704357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.206956Z digest=sha256:5fa059b6a064ea37093f898a5b857d0cac8680996228c988c4ea7fad9a6ec310

Observation a3148a43-8b3e-42db-a45f-4a910214841e · outbound

This paper cites Modeling task relationships in multi-task learning with multi- gate mixture-of-experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Modeling task relationships in multi-task learning with multi- gate mixture-of-experts

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.691636Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.210485Z digest=sha256:ef048d7d9547ddf845cb06bbc23ff4ee02731df33c9a2371a60e36a4ef16b7a6

Observation ee9cd83a-4fed-4246-ad23-f565fc339481 · outbound

This paper cites Bagualu: targeting brain scale pretrained models with over 37 million cores.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Bagualu: targeting brain scale pretrained models with over 37 million cores

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.678285Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.214438Z digest=sha256:d4a7ec7b6c8e0e47a51a34edc63d0072800bf7136249de4246bea2b8ef2f11fd

Observation f4051df7-4d54-4b72-a120-664d48e2a369 · outbound

This paper cites Efficient large- scale language model training on GPU clusters using Megatron-LM.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Efficient large- scale language model training on GPU clusters using Megatron-LM

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.664058Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.218354Z digest=sha256:334366c0c277a8a6b3488c01e5cd19e43dddffd1b42c46b989291e835c5eddce

Observation df6aacf6-b731-4fa8-a8e7-6483b5eca643 · outbound

This paper cites Flexmoe: Scaling large-scale sparse pre-trained model training via dynamic device placement.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Flexmoe: Scaling large-scale sparse pre-trained model training via dynamic device placement

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.645363Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.222298Z digest=sha256:f01bf1676c038211d62876ed9f6f32807041f53952be531ac7ca366724771ddf

Observation 7a7c8003-d358-44a5-8c97-ee152cf73e38 · outbound

This paper cites HetuMoE: An Efficient Trillion-scale Mixture-of-Expert Distributed Training System.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models HetuMoE: An Efficient Trillion-scale Mixture-of-Expert Distributed Training System

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.225891Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.225891Z digest=sha256:63831c23ea0d8bfc9472d07cf55735f8800861bc8c48d4cd47d4e1777ee7a8d6

Observation 5e0c7257-5456-482f-b6bc-294482416b5e · outbound

This paper cites Springer, 1999.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Springer, 1999

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.229870Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.229870Z digest=sha256:cc766c2e3c881614a43e7df9d75042cbe44a622c447dbf4070aa17a3227d057b

Observation 1b9e643d-5a85-4770-8283-463e0c0ee288 · outbound

This paper cites Parm: Efficient training of large sparsely-activated models with dedicated schedules.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Parm: Efficient training of large sparsely-activated models with dedicated schedules

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.623764Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.233478Z digest=sha256:f04ec46f9e215745540292818d7f8b939fae3f27ce8d894d7919551912fb5901

Observation 637c6623-802f-4d7d-94e8-908e7294bf6b · outbound

This paper cites Sinclair.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Sinclair

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.610245Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.236995Z digest=sha256:30b51a5e8f63f42e9fcab755b84e65848947f978ed8f48ffffe5e1d1f1692f25

Observation dcf067a7-1b92-4851-b2f1-48df2593038a · outbound

This paper cites Differential evolution.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Differential evolution

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.597154Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.240768Z digest=sha256:b78ae93cad8d07cd515208d3142df199d44b896b7de63cb9e1d5e2b803d014fe

Observation 97fbd66a-aa5f-4700-a6e9-6a3ee8637a87 · outbound

This paper cites From Sparse to Soft Mixtures of Experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models From Sparse to Soft Mixtures of Experts

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.244443Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.244443Z digest=sha256:8959e775b9917220e810136c6ee9d5437dc8e0bcb92a1573ddfbea6c590c442c

Observation 9527e6fe-90cd-4b97-be65-8a0bddcc8609 · outbound

This paper cites Beckmann.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Beckmann

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.583586Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.248468Z digest=sha256:a9e575caa1395f809edf26f487b7964a4259dd72fbe208af48497f67ecbb38f2

Observation 63a85fec-f237-48cf-a2aa-62c79a08a610 · outbound

This paper cites Language models are unsupervised multitask learners.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Language models are unsupervised multitask learners

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.252114Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.252114Z digest=sha256:3f5712035706b013fe27a98a2ddbcf9b240c6a2506f553f01e059c19b02201dd

Observation 936a2d2d-802f-491f-bae0-7c05ef6573c6 · outbound

This paper cites Deepspeed-moe: Advancing mixture-of-experts inference and training to power next-generation ai scale.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Deepspeed-moe: Advancing mixture-of-experts inference and training to power next-generation ai scale

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.560292Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.255661Z digest=sha256:7e241ae75d21b8fc050c88e1f67734a359081698b8a22673fd38970915a0ec6e

Observation bb688046-91ee-43d3-96bf-356c9dabf994 · outbound

This paper cites Outrageously large neural networks: The sparsely-gated mixture-of-experts layer.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Outrageously large neural networks: The sparsely-gated mixture-of-experts layer

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.546293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.259055Z digest=sha256:854c18b8c4b0f760776d70c38fe7b69da382d8f9e5ff9aac0a1e03eeb442f5e8

Observation 8829b396-86f2-4407-b2a7-edefdf954dd6 · outbound

This paper cites Exploiting simultaneous communications to accelerate data parallel distributed deep learning.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Exploiting simultaneous communications to accelerate data parallel distributed deep learning

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.533093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.263102Z digest=sha256:b8fe91df4a101502d844176406a0cc3ce94e8cb0d2f59831b19af8c38ad8f02b

Observation 6cb210e4-3597-4aea-b8ef-2c3ed4f88006 · outbound

This paper cites PipeMoE: Ac- celerating mixture-of-experts through adaptive pipelining.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models PipeMoE: Ac- celerating mixture-of-experts through adaptive pipelining

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.518217Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.266430Z digest=sha256:e9d6a0b9072df1e1343f6104371b0f879426fb5f66ab54ab9bcd9cbfd82096b3

Observation 5ade87aa-a439-476f-97d5-c54b1ed5f19d · outbound

This paper cites Schemoe: An ex- tensible mixture-of-experts distributed training system with tasks scheduling.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Schemoe: An ex- tensible mixture-of-experts distributed training system with tasks scheduling

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.504495Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.269557Z digest=sha256:b9c984f7d76e3e3ab49e6606620bb8383e286ba10495a0b7ced17d3f4087e0f7

Observation 3fa568d8-b289-4def-bee2-4f77473dc4e9 · outbound

This paper cites A hybrid tensor-expert- data parallelism approach to optimize mixture-of-experts training.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models A hybrid tensor-expert- data parallelism approach to optimize mixture-of-experts training

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.485399Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.273159Z digest=sha256:ddaad1ebf97b5707e4a11da0c79d0ff68936b9b6ee3cf03e392354f1dfb6f404

Observation e9e45f2c-f3cd-4126-b2c9-30360a6bdf08 · outbound

This paper cites Attention is all you need.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Attention is all you need

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.276366Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.276366Z digest=sha256:f458af4e51f62ef69a6d8dcccdfa264340968ac137ccb2105835ad1cb2f7226e

Observation 2b2112e4-8c85-4dc1-85ab-63011375483b · outbound

This paper cites Overlap communication with dependent compu- tation via decomposition in large deep learning models.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Overlap communication with dependent compu- tation via decomposition in large deep learning models

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.468097Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.279486Z digest=sha256:21e2d23b7fe7cb3f01632ca82a30e9231a0cbe750eae76008911cb7a2b3d4d9d

Observation d8952115-49a6-4eb3-8d5f-a75eb3d24060 · outbound

This paper cites Large batch optimization for deep learning: Training BERT in 76 minutes.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Large batch optimization for deep learning: Training BERT in 76 minutes

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.457249Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.282689Z digest=sha256:e7c6e871d5133e8c42d38bf46d37f3fcfaa55574cf8e02fc647345642bb545fa

Observation 3c0f0013-3795-4faa-acdd-7e56b87e99e7 · outbound

This paper cites SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.285944Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.285944Z digest=sha256:a2b3b90f6663b7758957895322d8458d548bebd51f9f8afcf6af18a248afc6a4

Observation 9c5b9b8b-b453-497a-906e-b1a03ab170a3 · outbound

This paper cites SmartMoE: Efficiently training Sparsely-Activated mod- els through combining offline and online parallelization.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models SmartMoE: Efficiently training Sparsely-Activated mod- els through combining offline and online parallelization

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.446707Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.289368Z digest=sha256:e85255a008011ebb975753eb5f23aa46bf733e121cc0bb85f9a594077d2479c8

Observation d9c12ac6-24df-4160-81c0-2d54e0dd9b73 · outbound

This paper cites Pit: Optimization of dynamic sparse deep learning models via permutation invariant transformation.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Pit: Optimization of dynamic sparse deep learning models via permutation invariant transformation

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.435346Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.292629Z digest=sha256:af247dd3474208329eb1942aa1d852bd2089fd0c0398f5c0b701eb6b8197b750

Observation 487fa7b9-974a-45bc-9f95-830f85be3280 · outbound

This paper cites Mixture-of-Experts with Expert Choice Routing.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Mixture-of-Experts with Expert Choice Routing

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.296446Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.296446Z digest=sha256:86584f93784a83e1744cb99b8d410bb8eaafa20931e61a421ad295fbcba222e7

Observation f4b27ede-16fc-4098-bbbe-a828271fcf63 · outbound

This paper cites Taming sparsely activated transformer with stochastic experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Taming sparsely activated transformer with stochastic experts

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.423266Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-10T19:05:55.300522Z digest=sha256:af680715449431e4f011d948c9cafc618cd9708d21ad72017d0263f4c148c67d

Pith citing papers

No inbound Pith citation observations are available.