{"record_type":"pith_number_record","schema_url":"https://pith.science/schemas/pith-number/v1.json","pith_number":"pith:2024:Z7KICLUGMM224P6R2PSTRZFPXP","short_pith_number":"pith:Z7KICLUG","schema_version":"1.0","canonical_sha256":"cfd4812e866335ae3fd1d3e538e4afbbd56d503f9ea5945609eca5cb0c3d5bf1","source":{"kind":"arxiv","id":"2406.11704","version":2},"attestation_state":"computed","paper":{"title":"Nemotron-4 340B Technical Report","license":"http://creativecommons.org/licenses/by/4.0/","headline":"","cross_cats":["cs.AI","cs.LG"],"primary_cat":"cs.CL","authors_text":"Aastha Jhunjhunwala, Aleksander Ficek, Ameya Sunil Mahabaleshwarkar, Annika Brundyn, Ashwath Aithal, Ayush Dattagupta, Boris Ginsburg, Bryan Catanzaro, Chen Zhu, Christopher Parisien, Daniel Egert, Dan Su, Dave Sizer, Deepak Narayanan, Denys Fridman, Dong H. Anh, Eileen Long, Ellie Evans, Felipe Soares, Gerald Shen, Guruprasad Nutheti, Hao Wang, Hui Li, Igor Gitman, Ivan Moshkov, James Maki, Jane Polak Scowcroft, Jared Casper, Jason Sewall, Jesus Navarro, Jiaqi Zeng, Jiaxuan You, Jimmy Zhang, Jing Zhang, Jining Huang, Jiwei Liu, John Kamalu, Jonathan Cohen, Joseph Jennings, Jupinder Parmar, Krzysztof Pawelec, Leon Derczynski, Maer Rodrigues de Melo, Makesh Narsimhan Sreedhar, Miguel Martinez, Misha Smelyanskiy, Mohammad Shoeybi, Mostofa Patwary, Niket Agarwal, Nvidia: Bo Adler, Oleksii Kuchaiev, Olivier Delalleau, Osvald Nitski, Pallab Bhattacharya, Patrick LeGresley, Pavel Shamis, Phong Nguyen, Rajarshi Roy, Robert Hero, Sadaf Khan, Sandeep Subramanian, Sanjeev Satheesh, Sean Narenthiran, Shaona Ghosh, Sharon Clay, Shengyang Sun, Shrimai Prabhumoye, Shubham Toshniwal, Sirshak Das, Somshubra Majumdar, Tomasz Grzegorzek, Trisha Saar, Vahid Noroozi, Vasanth Rao Naik Sabavat, Vibhu Jawa, Vivienne Zhang, Wei Ping, Yian Zhang, Yi Dong, Zhilin Wang, Zihan Liu","submitted_at":"2024-06-17T16:25:04Z","abstract_excerpt":"We release the Nemotron-4 340B model family, including Nemotron-4-340B-Base, Nemotron-4-340B-Instruct, and Nemotron-4-340B-Reward. Our models are open access under the NVIDIA Open Model License Agreement, a permissive model license that allows distribution, modification, and use of the models and its outputs. These models perform competitively to open access models on a wide range of evaluation benchmarks, and were sized to fit on a single DGX H100 with 8 GPUs when deployed in FP8 precision. We believe that the community can benefit from these models in various research studies and commercial "},"verification_status":{"content_addressed":true,"pith_receipt":true,"author_attested":false,"weak_author_claims":0,"strong_author_claims":0,"externally_anchored":false,"storage_verified":false,"citation_signatures":0,"replication_records":0,"graph_snapshot":true,"references_resolved":false,"formal_links_present":false},"canonical_record":{"source":{"id":"2406.11704","kind":"arxiv","version":2},"metadata":{"license":"http://creativecommons.org/licenses/by/4.0/","primary_cat":"cs.CL","submitted_at":"2024-06-17T16:25:04Z","cross_cats_sorted":["cs.AI","cs.LG"],"title_canon_sha256":"c845e4ca60a14c016a848a6d8dce8e4a33185415aec849498f56ea40c02d4a1c","abstract_canon_sha256":"2d0be157e63ee8ee53bfd4f155150ec1b7a9225ac06ee464a809ec999abf5d84"},"schema_version":"1.0"},"receipt":{"kind":"pith_receipt","key_id":"pith-v1-2026-05","algorithm":"ed25519","signed_at":"2026-07-05T08:52:55.062034Z","signature_b64":"vS8PKnEnhwp3yyl4H2PjREM/GFn5VQ02O8WoheTrq+KuhuoOieZCe3T8gGleo5EdmhN5uCVcYio3U0agyq6XDA==","signed_message":"canonical_sha256_bytes","builder_version":"pith-number-builder-2026-05-17-v1","receipt_version":"0.3","canonical_sha256":"cfd4812e866335ae3fd1d3e538e4afbbd56d503f9ea5945609eca5cb0c3d5bf1","last_reissued_at":"2026-07-05T08:52:55.061569Z","signature_status":"signed_v1","first_computed_at":"2026-07-05T08:52:55.061569Z","public_key_fingerprint":"8d4b5ee74e4693bcd1df2446408b0d54"},"graph_snapshot":{"paper":{"title":"Nemotron-4 340B Technical Report","license":"http://creativecommons.org/licenses/by/4.0/","headline":"","cross_cats":["cs.AI","cs.LG"],"primary_cat":"cs.CL","authors_text":"Aastha Jhunjhunwala, Aleksander Ficek, Ameya Sunil Mahabaleshwarkar, Annika Brundyn, Ashwath Aithal, Ayush Dattagupta, Boris Ginsburg, Bryan Catanzaro, Chen Zhu, Christopher Parisien, Daniel Egert, Dan Su, Dave Sizer, Deepak Narayanan, Denys Fridman, Dong H. Anh, Eileen Long, Ellie Evans, Felipe Soares, Gerald Shen, Guruprasad Nutheti, Hao Wang, Hui Li, Igor Gitman, Ivan Moshkov, James Maki, Jane Polak Scowcroft, Jared Casper, Jason Sewall, Jesus Navarro, Jiaqi Zeng, Jiaxuan You, Jimmy Zhang, Jing Zhang, Jining Huang, Jiwei Liu, John Kamalu, Jonathan Cohen, Joseph Jennings, Jupinder Parmar, Krzysztof Pawelec, Leon Derczynski, Maer Rodrigues de Melo, Makesh Narsimhan Sreedhar, Miguel Martinez, Misha Smelyanskiy, Mohammad Shoeybi, Mostofa Patwary, Niket Agarwal, Nvidia: Bo Adler, Oleksii Kuchaiev, Olivier Delalleau, Osvald Nitski, Pallab Bhattacharya, Patrick LeGresley, Pavel Shamis, Phong Nguyen, Rajarshi Roy, Robert Hero, Sadaf Khan, Sandeep Subramanian, Sanjeev Satheesh, Sean Narenthiran, Shaona Ghosh, Sharon Clay, Shengyang Sun, Shrimai Prabhumoye, Shubham Toshniwal, Sirshak Das, Somshubra Majumdar, Tomasz Grzegorzek, Trisha Saar, Vahid Noroozi, Vasanth Rao Naik Sabavat, Vibhu Jawa, Vivienne Zhang, Wei Ping, Yian Zhang, Yi Dong, Zhilin Wang, Zihan Liu","submitted_at":"2024-06-17T16:25:04Z","abstract_excerpt":"We release the Nemotron-4 340B model family, including Nemotron-4-340B-Base, Nemotron-4-340B-Instruct, and Nemotron-4-340B-Reward. Our models are open access under the NVIDIA Open Model License Agreement, a permissive model license that allows distribution, modification, and use of the models and its outputs. These models perform competitively to open access models on a wide range of evaluation benchmarks, and were sized to fit on a single DGX H100 with 8 GPUs when deployed in FP8 precision. We believe that the community can benefit from these models in various research studies and commercial "},"claims":{"count":0,"items":[],"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"source":{"id":"2406.11704","kind":"arxiv","version":2},"verdict":{"id":null,"model_set":{},"created_at":null,"strongest_claim":"","one_line_summary":"","pipeline_version":null,"weakest_assumption":"","pith_extraction_headline":""},"integrity":{"clean":true,"summary":{"advisory":0,"critical":0,"by_detector":{},"informational":0},"endpoint":"/pith/2406.11704/integrity.json","findings":[],"available":true,"detectors_run":[],"snapshot_sha256":"c28c3603d3b5d939e8dc4c7e95fa8dfce3d595e45f758748cecf8e644a296938"},"references":{"count":0,"sample":[],"resolved_work":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57","internal_anchors":0},"formal_canon":{"evidence_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"author_claims":{"count":0,"strong_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"builder_version":"pith-number-builder-2026-05-17-v1"},"aliases":[{"alias_kind":"arxiv","alias_value":"2406.11704","created_at":"2026-07-05T08:52:55.061626+00:00"},{"alias_kind":"arxiv_version","alias_value":"2406.11704v2","created_at":"2026-07-05T08:52:55.061626+00:00"},{"alias_kind":"doi","alias_value":"10.48550/arxiv.2406.11704","created_at":"2026-07-05T08:52:55.061626+00:00"},{"alias_kind":"pith_short_12","alias_value":"Z7KICLUGMM22","created_at":"2026-07-05T08:52:55.061626+00:00"},{"alias_kind":"pith_short_16","alias_value":"Z7KICLUGMM224P6R","created_at":"2026-07-05T08:52:55.061626+00:00"},{"alias_kind":"pith_short_8","alias_value":"Z7KICLUG","created_at":"2026-07-05T08:52:55.061626+00:00"}],"events":[],"event_summary":{},"paper_claims":[],"inbound_citations":{"count":24,"internal_anchor_count":0,"sample":[{"citing_arxiv_id":"2606.24747","citing_title":"Scaling Laws for Task-Specific LLM Distillation","ref_index":1,"is_internal_anchor":false},{"citing_arxiv_id":"2606.17687","citing_title":"SuCo: Sufficiency-guided Continuous Adaptive Reasoning","ref_index":50,"is_internal_anchor":false},{"citing_arxiv_id":"2606.09711","citing_title":"Proxy Reward Internalization and Mechanistic Exploitation: A Learned Precursor to Reward Hacking and Its Generalization","ref_index":84,"is_internal_anchor":false},{"citing_arxiv_id":"2605.27996","citing_title":"Reward Bias Substitution: Single-Axis Bias Mitigations Redirect Optimization Pressure","ref_index":60,"is_internal_anchor":false},{"citing_arxiv_id":"2606.00359","citing_title":"Next-Billion AI Index: The compass for AI utility and adoption in the global majority","ref_index":78,"is_internal_anchor":false},{"citing_arxiv_id":"2605.23315","citing_title":"Convergence Without Understanding: When Language Models Agree on Representations but Disagree on Reasoning","ref_index":2,"is_internal_anchor":false},{"citing_arxiv_id":"2408.15339","citing_title":"UNA: A Unified Supervised Framework for Efficient LLM Alignment Across Feedback Types","ref_index":11,"is_internal_anchor":false},{"citing_arxiv_id":"2412.15115","citing_title":"Qwen2.5 Technical Report","ref_index":2,"is_internal_anchor":false},{"citing_arxiv_id":"2504.12501","citing_title":"Reinforcement Learning from Human Feedback","ref_index":30,"is_internal_anchor":false},{"citing_arxiv_id":"2605.20740","citing_title":"Distribution-Aware Reward: Reinforcement Learning over Predictive Distributions for LLM Regression","ref_index":13,"is_internal_anchor":false},{"citing_arxiv_id":"2307.06435","citing_title":"A Comprehensive Overview of Large Language Models","ref_index":137,"is_internal_anchor":false},{"citing_arxiv_id":"2506.01937","citing_title":"RewardBench 2: Advancing Reward Model Evaluation","ref_index":59,"is_internal_anchor":false},{"citing_arxiv_id":"2507.02833","citing_title":"Generalizing Verifiable Instruction Following","ref_index":1,"is_internal_anchor":false},{"citing_arxiv_id":"2512.20856","citing_title":"NVIDIA Nemotron 3: Efficient and Open Intelligence","ref_index":33,"is_internal_anchor":false},{"citing_arxiv_id":"2410.18451","citing_title":"Skywork-Reward: Bag of Tricks for Reward Modeling in LLMs","ref_index":2,"is_internal_anchor":false},{"citing_arxiv_id":"2503.15558","citing_title":"Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning","ref_index":40,"is_internal_anchor":false},{"citing_arxiv_id":"2406.19314","citing_title":"LiveBench: A Challenging, Contamination-Limited LLM Benchmark","ref_index":2,"is_internal_anchor":false},{"citing_arxiv_id":"2604.19765","citing_title":"Do Hallucination Neurons Generalize? Evidence from Cross-Domain Transfer in LLMs","ref_index":33,"is_internal_anchor":false},{"citing_arxiv_id":"2503.09567","citing_title":"Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models","ref_index":4,"is_internal_anchor":false},{"citing_arxiv_id":"2605.08378","citing_title":"Reinforcement Learning for Scalable and Trustworthy Intelligent Systems","ref_index":104,"is_internal_anchor":false},{"citing_arxiv_id":"2605.06216","citing_title":"TIDE: Every Layer Knows the Token Beneath the Context","ref_index":76,"is_internal_anchor":false},{"citing_arxiv_id":"2604.23051","citing_title":"Evaluating Temporal Consistency in Multi-Turn Language Models","ref_index":28,"is_internal_anchor":false},{"citing_arxiv_id":"2604.10627","citing_title":"Computational Lesions in Multilingual Language Models Separate Shared and Language-specific Brain Alignment","ref_index":26,"is_internal_anchor":false},{"citing_arxiv_id":"2501.03575","citing_title":"Cosmos World Foundation Model Platform for Physical AI","ref_index":2,"is_internal_anchor":false}]},"formal_canon":{"evidence_count":0,"sample":[],"anchors":[]},"links":{"html":"https://pith.science/pith/Z7KICLUGMM224P6R2PSTRZFPXP","json":"https://pith.science/pith/Z7KICLUGMM224P6R2PSTRZFPXP.json","graph_json":"https://pith.science/api/pith-number/Z7KICLUGMM224P6R2PSTRZFPXP/graph.json","events_json":"https://pith.science/api/pith-number/Z7KICLUGMM224P6R2PSTRZFPXP/events.json","paper":"https://pith.science/paper/Z7KICLUG"},"agent_actions":{"view_html":"https://pith.science/pith/Z7KICLUGMM224P6R2PSTRZFPXP","download_json":"https://pith.science/pith/Z7KICLUGMM224P6R2PSTRZFPXP.json","view_paper":"https://pith.science/paper/Z7KICLUG","resolve_alias":"https://pith.science/api/pith-number/resolve?arxiv=2406.11704&json=true","fetch_graph":"https://pith.science/api/pith-number/Z7KICLUGMM224P6R2PSTRZFPXP/graph.json","fetch_events":"https://pith.science/api/pith-number/Z7KICLUGMM224P6R2PSTRZFPXP/events.json","actions":{"anchor_timestamp":"https://pith.science/pith/Z7KICLUGMM224P6R2PSTRZFPXP/action/timestamp_anchor","attest_storage":"https://pith.science/pith/Z7KICLUGMM224P6R2PSTRZFPXP/action/storage_attestation","attest_author":"https://pith.science/pith/Z7KICLUGMM224P6R2PSTRZFPXP/action/author_attestation","sign_citation":"https://pith.science/pith/Z7KICLUGMM224P6R2PSTRZFPXP/action/citation_signature","submit_replication":"https://pith.science/pith/Z7KICLUGMM224P6R2PSTRZFPXP/action/replication_record"}},"created_at":"2026-07-05T08:52:55.061626+00:00","updated_at":"2026-07-05T08:52:55.061626+00:00"}