REVIEW 8 cited by
A Survey on Large Language Models with some Insights on their Capabilities and Limitations
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The rapid advancement of artificial intelligence, particularly with the development of Large Language Models (LLMs) built on the transformer architecture, has redefined the capabilities of natural language processing. These models now exhibit remarkable performance across various language-related tasks, such as text generation, question answering, translation, and summarization, often rivaling human-like comprehension. More intriguingly, LLMs have demonstrated emergent abilities extending beyond their core functions, showing proficiency in tasks like commonsense reasoning, code generation, and arithmetic. This survey paper explores the foundational components, scaling mechanisms, and architectural strategies that drive these capabilities. Emphasizing models like GPT and LLaMA, we analyze the impact of exponential data and computational growth on LLM performance, while also addressing the trade-offs associated with scaling. We also examine LLM applications across sectors, such as healthcare, finance, education, and law, highlighting their adaptability and potential to solve domain-specific challenges. Central to this work are the questions of how LLMs generalize across diverse tasks, exhibit planning, and reasoning abilities, and whether these emergent abilities can be systematically elicited or enhanced. In particular, we provide some insights into the CoT (Chain of Thought) and PoT (Plan of Thought) abilities within LLMs, focusing on how pre-training data influences their emergence. Additionally, we investigate LLM-modulo frameworks that integrate external systems, allowing LLMs to handle complex, dynamic tasks. By analyzing these factors, this paper aims to foster the ongoing discussion on the capabilities and limits of LLMs, promoting their responsible development and application in novel and increasingly complex environments.
Forward citations
Cited by 8 Pith papers
-
Generalizable and Computational Efficient Channel Extrapolation for 6G: A Configurable AI-Driven Framework Built from a Modular Perspective
A three-stage modular AI framework, pretrain, cluster experts, and learn routing, improves channel extrapolation accuracy and cuts FLOPs in simulated 6G scenarios.
-
EVADE-Bench: Multimodal Benchmark for Evaluating and Enhancing Evasive Content Detection
A new benchmark of 2,833 evasive text samples and 13,961 images shows current LLMs and VLMs frequently miss veiled policy violations in Chinese e-commerce ads.
-
Large Language Models for Next-Generation Wireless Network Management: A Survey and Tutorial
A survey and tutorial that organizes LLM-enabled wireless network optimization into formulation, solution, and verification stages, with case studies drawn from the authors' own prior papers.
-
InsightBuild: LLM-Powered Causal Reasoning in Smart Building Systems
InsightBuild uses Granger causality and structural pruning to rank sensor causes, then a fine-tuned LLaMA 2 model turns the ranked causes into text explanations that outperform baseline systems on annotated building e...
-
Survey of GenAI for Automotive Software Development: From Requirements to Executable Code
A review of roughly 60 papers and 9 industry respondents finds GPT-family models dominate automotive code generation while requirements handling lags due to confidentiality constraints.
-
RACE-Align: Retrieval-Augmented and Chain-of-Thought Enhanced Preference Alignment for Large Language Models
RACE-Align generates preference pairs from RAG-grounded chain-of-thought answers and applies DPO to align a 1.7B model, showing improved reasoning scores in TCM QA but lacking statistical support.
-
From Transformers to Large Language Models: A systematic review of AI applications in the energy sector towards Agentic Digital Twins
A systematic review of 99 papers on transformers and LLMs in energy, ending with a proposal for LLM-powered Agentic Digital Twins for smart grids.
-
A Survey of the State-of-the-Art in Conversational Question Answering Systems
A review that categorizes ConvQA components, techniques, models, and datasets, with no new experimental result.
Discussion (0). Continue with ORCID to comment.