REVIEW 13 cited by
PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Finance
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Although large language models (LLMs) has shown great performance on natural language processing (NLP) in the financial domain, there are no publicly available financial tailtored LLMs, instruction tuning datasets, and evaluation benchmarks, which is critical for continually pushing forward the open-source development of financial artificial intelligence (AI). This paper introduces PIXIU, a comprehensive framework including the first financial LLM based on fine-tuning LLaMA with instruction data, the first instruction data with 136K data samples to support the fine-tuning, and an evaluation benchmark with 5 tasks and 9 datasets. We first construct the large-scale multi-task instruction data considering a variety of financial tasks, financial document types, and financial data modalities. We then propose a financial LLM called FinMA by fine-tuning LLaMA with the constructed dataset to be able to follow instructions for various financial tasks. To support the evaluation of financial LLMs, we propose a standardized benchmark that covers a set of critical financial tasks, including five financial NLP tasks and one financial prediction task. With this benchmark, we conduct a detailed analysis of FinMA and several existing LLMs, uncovering their strengths and weaknesses in handling critical financial tasks. The model, datasets, benchmark, and experimental results are open-sourced to facilitate future research in financial AI.
Forward citations
Cited by 13 Pith papers
-
A Three-Phase Foundation Model for Tax-Aware Personalized Portfolio Management
A ticker-identity-free Chronos-augmented encoder plus MoE PPO policy and 76-parameter LoRA personalization claims +2.93% 14-day alpha vs equal-weight while serving six investment objectives.
-
FlexServe: A Fast and Secure LLM Serving System for Mobile Devices with Flexible Resource Isolation
Page-granular Flex-Mem and switchable Flex-NPU cut TrustZone LLM TTFT by ~10× vs a CMA strawman and ~2.4× vs a pipelined secure-NPU strawman on RK3588.
-
Can Large Language Models Execute Parent Orders?
PACE, a planner–executor LLM framework, beats TWAP, Almgren–Chriss, and ML execution baselines by up to ~0.65 bps on Shenzhen parent orders without task-specific training.
-
Accept or Deny? Evaluating LLM Fairness and Performance in Loan Approval across Table-to-Text Serialization Approaches
Serialization format and in-context examples change both accuracy and gender fairness of LLM loan approvals, with finance-tuned models often showing larger disparities.
-
Language-Routed RAG and Direct Option Scoring for Multilingual Financial QA: DS@GT at FinMMEval
For multilingual financial exam questions, no single model or reasoning strategy wins across languages: Qwen3-14B regresses 22.9 points on English, Llama-3.1-8B wins Greek, and chain-of-thought collapses Greek accurac...
-
FRED: Financial Retrieval-Enhanced Detection and Editing of Hallucinations in Language Models
Fine-tuning small language models on synthetic financial errors yields high detection and editing scores, but the evaluation is limited to synthetic data from the same pipeline.
-
Agentar-Fin-R1: Enhancing Financial Intelligence through Domain Expertise, Training Efficiency, and Advanced Reasoning
Agentar-Fin-R1, an 8B and 32B financial LLM family, reports top scores on FinEval, FinanceIQ, and a new Finova benchmark while keeping general reasoning near its Qwen3 base.
-
FinTeam: A Multi-Agent Collaborative Intelligence System for Comprehensive Financial Scenarios
A four-agent LLM pipeline trained with role-specific data improves human preference on comprehensive Chinese financial analysis tasks.
-
Enterprise Large Language Model Evaluation Benchmark
A 14-task enterprise LLM benchmark built mostly from GPT-4o-generated labels and scored by GPT-4o-as-judge shows open-source models closing the reasoning gap, but the dataset is not public and the evaluation is partly...
-
PulseReddit: A Novel Reddit Dataset for Benchmarking MAS in High-Frequency Cryptocurrency Trading
MAS traders using Reddit sentiment from PulseReddit beat traditional baselines in the reported bull-market backtests, but the gains are small, most runs lose money, and the evaluation has critical flaws.
-
Interpretable LLMs for Credit Risk: A Systematic Review and Taxonomy
A systematic review and taxonomy that organizes LLM-based credit risk research by model architecture, data modality, explainability mechanism, and application domain.
-
Assessing the Capabilities and Limitations of FinGPT Model in Financial NLP Applications
FinGPT matches GPT-4 on financial sentiment and headline classification, lags on QA and NER, and shows a bullish bias in stock movement prediction.
-
Domain Specific Benchmarks for Evaluating Multimodal Large Language Models
A review paper that organizes domain-specific MLLM benchmarks into an eight-discipline taxonomy, with summary tables and performance highlights.
Discussion (0). Sign in to comment.