REVIEW 4 major objections 5 minor 4 cited by
Generating Personalized Recipes from Historical User Preferences
T0 review · 4 major / 5 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read Conditioning recipe generation on a user's past reviews produces recipes judged more plausible and more personal than generation without user history.
desk verdict A useful new-task paper with a reusable dataset, but the personalization claim is softer than the abstract suggests: the UMA metric is a likelihood-ranking proxy, and the human evaluation shows plausibility, not personalized fit. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is the attention fusion layer, which at each decoding step concatenates the ingredient context, the prior-recipe or prior-technique context, the decoder hidden state, and the previous token embedding, then applies a ReLU projection and softmax to produce the next-token distribution. Prior-recipe attention averages over the user's k=20 most recent reviewed recipes, represented either by recipe id or by the mean of the recipe name's token embeddings, while prior-technique attention adds a user-technique co-occurrence prior to the attention score. This is what injects user history into the generation process and what distinguishes the three personalized variants: Prior Recipe, Prior Name, and Prior Tech.
What would settle it
Run a blind comparison in which the same dish is generated once from the user's true review history and once from the history of ten other users with similar culinary tastes, then ask the user which recipe better fits their preference; if the true-history recipe is not chosen significantly above chance, the apparent personalization is mostly genre or cuisine matching.
Extended reading notes
Core claim
The paper's central discovery is that conditioning recipe generation on a user's historical recipe interactions improves the plausibility, diversity, and personalization of the generated instructions relative to a non-personalized encoder-decoder. A user is represented by the set of recipes they have reviewed, by the names of those recipes, or by the cooking techniques occurring in them; at each decoding step the model attends over the user's k most recent reviewed recipes and fuses that context with ingredient attention and decoder state. In user-matching tests, the variant attending over prior recipe names ranks the correct user first in about half the cases and best in mean reciprocal rank, and human evaluators preferred the personalized outputs to the non-personalized baseline in 63% of pairwise comparisons.
Load-bearing premise
The load-bearing assumption is that what a person reviewed in the past reliably predicts what they want in a new dish, even when their review history contains as few as four items.
Editorial extensions
If this is right
- Users with as little as four prior reviews can receive a plausible recipe from a dish name and a few ingredients; the model works even though half of the users have six or fewer reviews.
- The most effective personalization signal is the names of previously reviewed recipes, not the recipes' ids or their cooking techniques.
- Personalized generation increases recipe diversity and explicit ingredient mentions without sacrificing coherence, as measured by step-order scoring and step entailment.
- The dataset and evaluation protocol, including sequential leave-one-out splits, user-matching accuracy, and coherence scorers, can serve as a benchmark for incomplete-specification recipe generation.
- Human preference for personalized recipes, 63% over baseline, indicates that user history can steer instructional text generation beyond simple template filling.
Reading between the lines
- If review history is a reliable taste signal, the same attention-fusion idea should transfer to other content-to-text settings where the "user" is defined by feedback, such as shopping lists, workout plans, or medication instructions.
- The user-matching experiment could be sharpened by testing users whose histories overlap in cuisine: if a model conditioned on a different but cuisine-similar user scores almost as well, the personalization is largely genre matching rather than per-person taste.
- A simple ablation anyone can run is to pass the k recent recipes in shuffled or reversed order; if performance holds, the model is using the set of prior recipes rather than their temporal drift, which would simplify the memory mechanism.
- The coherence metrics introduced here, step-order scoring and step entailment, could be applied to other instructional prose, since they do not depend on recipe-specific knowledge.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces the task of personalized recipe generation: given a recipe name, a few ingredients, a calorie level, and a user's historical recipe interactions, the model generates full recipe instructions tailored to that user. The proposed architecture encodes the recipe name and ingredients with BiGRUs, applies ingredient attention during decoding, and incorporates user information either by attending over the k most recent prior recipes, prior recipe names, or a technique-preference vector; an attention fusion layer combines these contexts before the final output softmax. The authors release a Food.com dataset of 180K recipes and 700K interactions and evaluate against a nearest-neighbor baseline and an encoder-decoder baseline, reporting perplexity, BLEU/ROUGE, distinctness, user matching accuracy (UMA), mean reciprocal rank (MRR), automatic coherence and entailment scores, and pairwise human preference. They report that personalized models beat the baselines on perplexity, diversity, UMA/MRR, coherence, and a 63% human pairwise preference rate.
Significance. If the claims hold, this is a useful new task connecting natural language generation and recommender systems, with a novel dataset and a clean decomposition of user modeling into recipe-level, name-level, and technique-level signals. The public release of code and data is a strength, as are the automatic coherence metrics and the UMA/MRR personalization probes. However, the paper's central claim has two parts, plausibility and personalization, and the evidence for the second half is indirect: the human judges were not the target users, and UMA measures likelihood ranking under different conditioning profiles rather than actual user preference. The absence of error bars and significance tests further weakens the quantitative comparisons. With additional validation, the task and model would be a solid contribution.
major comments (4)
- [Section 5, Personalization] The UMA/MRR result demonstrates that the model's output distribution changes with the conditioning user profile, but it does not establish that the generated recipe is more appropriate for the target user than for another user. The pairwise human evaluation uses anonymous judges who see only the recipe name and ingredients, not the target user's history, so it tests plausibility, not personalized fit. Add a target-user study (for example, each user chooses between the personalized and baseline recipe for their own held-out review) or validate UMA against a behavioral signal such as the user's subsequent review or rating of the generated recipe.
- [Section 5, Tables 2 and 4] All quantitative results are reported as point estimates without error bars, confidence intervals, or significance tests, and several margins are small (for example, BPE PPL 9.516 vs. 9.551 for Prior Name vs. Enc-Dec, and coherence 1.82 vs. 1.77). Report multiple random seeds or bootstrapped intervals and paired significance tests, or explicitly state that the differences are not statistically tested. This is essential for the comparative claims made throughout the paper.
- [Section 4, Dataset and task framing] The paper treats users' Food.com reviews as evidence of recipes they 'consumed,' but a review is not necessarily a record of cooking or liking a recipe. The personalization signal and the UMA evaluation both depend on this assumption, and the paper provides no analysis of review text or ratings to validate it. Please justify or soften this assumption and discuss how review behavior might differ from consumption behavior.
- [Section 5, Personalization] The description of the nine 'randomly generated user profiles' used in UMA evaluation is underspecified. If these profiles are drawn from a different activity distribution (for example, shorter or less typical histories), the gold user could rank highest for reasons unrelated to personalization. Describe the sampling procedure and, ideally, include a control condition with random histories matched on length and recipe popularity.
minor comments (5)
- [Section 5, Baselines] The Neural Checklist model is mentioned as adapted and then dropped because Enc-Dec has 'comparable performance,' but no Neural Checklist numbers are shown; either report them in Table 2 or move them to the appendix for transparency.
- [Section 4, Techniques] The manually constructed list of 58 techniques and the string-match detection method are described with no precision about matching rules or false positives; a sentence on how inflected forms and multiword expressions are handled would help.
- [Section 5] Calorie-level conditioning is part of the model but is never ablated or analyzed; a small experiment or a statement on its effect would clarify whether it contributes to the reported gains.
- [Table 2] The NN row reports a dash for BPE PPL with no explanation; please add a note on why that value is omitted.
- [Section 5, Recipe Level Coherence] The recipe-level coherence metric is said to have a maximum score of 2, but the reported scores (1.77-1.82) are all close to each other and to the maximum; consider reporting the distribution or the score of gold recipes as a reference point.
Circularity Check
No circularity: the personalized-generation claim is supported by held-out likelihood, external coherence metrics, and human evaluation rather than by a fitted constant or self-citation chain.
full rationale
The paper contains no derivation step that reduces to its own inputs by construction. The model is trained to maximize the log-likelihood of the gold recipe text conditioned on a user's prior reviews, and the UMA/MRR personalization metric then asks whether the same model assigns the highest likelihood to the gold user among ten profiles. This is a self-consistency check of whether user conditioning affects the output distribution, not a tautology: random-user likelihoods are not forced to be lower, and the gold recipe itself is held out from the user history by sequential leave-one-out. The coherence and entailment evaluations use externally pretrained scorers (Bosselut et al. 2018a; BERT), and the human pairwise evaluation is an external judge-based benchmark, albeit one that tests general plausibility more than per-user fit. Self-citations (Ni and McAuley 2018; Kang and McAuley 2018) are methodological or related-work references and are not load-bearing to the central claim. Any concerns about whether UMA or anonymous judges adequately capture true personalization are validity questions, not circularity.
Assumptions & free parameters
free parameters (4)
- k (prior recipe attention window) =
20
- top-k sampling k =
3
- Hidden size dh =
256
- Embedding dimensions (V/I/R/X/C) =
300/10/50/50/5
assumptions (4)
- standard math GRU, BiGRU, and attention mechanisms provide differentiable learning signal for the encoder-decoder.
- domain assumption Each review implies the user consumed and preferred the recipe.
- domain assumption The first 3-5 ingredients in a recipe are a sufficient partial input to generate the full instructions.
- ad hoc to paper The manually constructed list of 58 techniques, with string-match detection, adequately represents cooking techniques.
Cite this review
Pith. "Pith review of Generating Personalized Recipes from Historical User Preferences." pith.science (2026). https://pith.science/paper/NQ5WJQWH
@misc{pith2026190900105,
author = {Pith},
title = {Pith review of: Generating Personalized Recipes from Historical User Preferences},
year = {2026},
howpublished = {\url{https://pith.science/paper/NQ5WJQWH}},
note = {Machine review of arXiv:1909.00105}
}
read the original abstract
Existing approaches to recipe generation are unable to create recipes for users with culinary preferences but incomplete knowledge of ingredients in specific dishes. We propose a new task of personalized recipe generation to help these users: expanding a name and incomplete ingredient details into complete natural-text instructions aligned with the user's historical preferences. We attend on technique- and recipe-level representations of a user's previously consumed recipes, fusing these 'user-aware' representations in an attention fusion layer to control recipe text generation. Experiments on a new dataset of 180K recipes and 700K interactions show our model's ability to generate plausible and personalized recipes compared to non-personalized baselines.
Figures
Forward citations
Cited by 4 Pith papers
-
Symmetric Behavior Regularized Policy Optimization
Symmetric behavior regularization for offline RL becomes tractable by expanding any f-divergence into a truncated Pearson-Vajda series, yielding a closed-form policy and bounded approximation error.
-
MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents
MemBench introduces a multi-scenario, multi-level memory benchmark for LLM agents, evaluating factual and reflective memory across participation and observation settings.
-
Fine-tuning Language Models for Recipe Generation: A Comparative Analysis and Benchmark Study
Fine-tuning small language models for recipe generation produces mixed results: Phi-2 degrades on the authors' custom quality scores while SmolLM-360M and 1.7B perform similarly.
-
Retrieval Augmented Recipe Generation
A retrieval-augmented LMM with stochastic retrieval sampling and self-consistency voting improves recipe generation from food images on Recipe1M.
Reference graph
Works this paper leans on
-
[1]
URL: " 'urlintro :=
ENTRY address author booktitle chapter edition editor howpublished institution journal key month note number organization pages publisher school series title type volume year eprint doi pubmed url lastchecked label extra.label sort.label short.list INTEGERS output.state before.all mid.sentence after.sentence after.block STRINGS urlintro eprinturl eprintpr...
-
[2]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION word.in bbl.in capitalize " " * FUNCT...
-
[3]
Lawrence Zitnick, Devi Parikh, and Dhruv Batra
Aishwarya Agrawal, Jiasen Lu, Stanislaw Antol, Margaret Mitchell, C. Lawrence Zitnick, Devi Parikh, and Dhruv Batra. 2017. https://doi.org/10.1007/s11263-016-0966-6 VQA: visual question answering . IJCV, 123(1):4--31
-
[4]
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. http://arxiv.org/abs/1409.0473 Neural machine translation by jointly learning to align and translate . In ICLR
arXiv 2015
-
[5]
Ashutosh Baheti, Alan Ritter, Jiwei Li, and Bill Dolan. 2018. https://aclanthology.info/papers/D18-1431/d18-1431 Generating more interesting responses in neural conversation models with distributional constraints . In EMNLP
work page 2018
-
[6]
Antoine Bosselut, Asli C elikyilmaz, Xiaodong He, Jianfeng Gao, Po - Sen Huang, and Yejin Choi. 2018 a . https://aclanthology.info/papers/N18-1016/n18-1016 Discourse-aware neural rewards for coherent text generation . In NAACL-HLT
work page 2018
-
[7]
Antoine Bosselut, Omer Levy, Ari Holtzman, Corin Ennis, Dieter Fox, and Yejin Choi. 2018 b . https://openreview.net/forum?id=rJYFzMZC- Simulating action dynamics with neural process networks . In ICLR
work page 2018
-
[8]
Kyunghyun Cho, Bart van Merrienboer, C aglar G \" u l c ehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. http://aclweb.org/anthology/D/D14/D14-1179.pdf Learning phrase representations using RNN encoder-decoder for statistical machine translation . In EMNLP
work page 2014
Show all 37 references
-
[9]
Jacob Devlin, Ming - Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. https://aclweb.org/anthology/papers/N/N19/N19-1423/ BERT: pre-training of deep bidirectional transformers for language understanding . In NAACL-HLT 2019
2019
-
[10]
Angela Fan, Mike Lewis, and Yann Dauphin. 2018. https://aclanthology.info/papers/P18-1082/p18-1082 Hierarchical neural story generation . In ACL
2018
-
[11]
Albert Gatt and Emiel Krahmer. 2018. https://doi.org/10.1613/jair.5477 Survey of the state of the art in natural language generation: Core tasks, applications and evaluation . J. Artif. Intell. Res., 61:65--170
2018 doi
-
[12]
Jiatao Gu, Zhengdong Lu, Hang Li, and Victor O. K. Li. 2016. http://aclweb.org/anthology/P/P16/P16-1154.pdf Incorporating copying mechanism in sequence-to-sequence learning . In ACL
2016
-
[13]
Jeremy Howard and Sebastian Ruder. 2018. https://doi.org/10.18653/v1/P18-1031 Universal language model fine-tuning for text classification . In ACL
2018 doi
-
[14]
Wang - Cheng Kang and Julian McAuley. 2018. https://doi.org/10.1109/ICDM.2018.00035 Self-attentive sequential recommendation . In ICDM
2018
-
[15]
Chlo \' e Kiddon, Ganesa Thandavam Ponnuraj, Luke Zettlemoyer, and Yejin Choi. 2015. http://aclweb.org/anthology/D/D15/D15-1114.pdf Mise en place: Unsupervised interpretation of instructional recipes . In EMNLP
2015
-
[16]
Chlo \' e Kiddon, Luke Zettlemoyer, and Yejin Choi. 2016. http://aclweb.org/anthology/D/D16/D16-1032.pdf Globally coherent text generation with neural checklist models . In EMNLP
2016
-
[17]
Kingma and Jimmy Ba
Diederik P. Kingma and Jimmy Ba. 2015. http://arxiv.org/abs/1412.6980 Adam: A method for stochastic optimization . In ICLR
2015 arXiv
-
[18]
Leo Lepp \" a nen, Myriam Munezero, Mark Granroth - Wilding, and Hannu Toivonen. 2017. https://aclanthology.info/papers/W17-3528/w17-3528 Data-driven news generation for automated journalism . In INLG
2017
-
[19]
Moore, Shuo Chen, Douglas Turnbull, and Thorsten Joachims
Joshua L. Moore, Shuo Chen, Douglas Turnbull, and Thorsten Joachims. 2013. http://www.ppgia.pucpr.br/ismir2013/wp-content/uploads/2013/09/220\_Paper.pdf Taste over time: The temporal dynamics of user preferences . In ISMIR
2013
-
[20]
Lipton, Sharad Vikram, and Julian McAuley
Jianmo Ni, Zachary C. Lipton, Sharad Vikram, and Julian McAuley. 2017. https://aclanthology.info/papers/I17-1079/i17-1079 Estimating reactions and recommending products with generative models of reviews . In IJCNLP
2017
-
[21]
Jianmo Ni and Julian McAuley. 2018. https://aclanthology.info/papers/P18-2112/p18-2112 Personalized review generation by expanding phrases and attending on aspect-aware representations . In ACL
2018
-
[22]
Romain Paulus, Caiming Xiong, and Richard Socher. 2018. https://openreview.net/forum?id=HkAClQgA- A deep reinforced model for abstractive summarization . In ICLR
2018
-
[23]
Massimo Quadrana, Paolo Cremonesi, and Dietmar Jannach. 2018. https://doi.org/10.1145/3209219.3209270 Sequence-aware recommender systems . In UMAP
2018
-
[24]
Radev, Hong Qi, Harris Wu, and Weiguo Fan
Dragomir R. Radev, Hong Qi, Harris Wu, and Weiguo Fan. 2002. http://www.lrec-conf.org/proceedings/lrec2002/pdf/301.pdf Evaluating web-based question answering systems . In LREC
2002
-
[25]
Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018. https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf Improving language understanding by generative pre-training
2018
-
[26]
Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. https://openai.com/blog/better-language-models/ Language models are unsupervised multitask learners
2019
-
[27]
Lam, Sean M
Al Mamunur Rashid, Istvan Albert, Dan Cosley, Shyong K. Lam, Sean M. McNee, Joseph A. Konstan, and John Riedl. 2002. https://doi.org/10.1145/502716.502737 Getting to know you: learning new user preferences in recommender systems . In IUI
2002
-
[28]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt - Thieme. 2009. https://dslpitt.org/uai/displayArticleDetails.jsp?mmnu=1&smnu=2&article\_id=1630&proceeding\_id=25 BPR: bayesian personalized ranking from implicit feedback . In UAI
2009
-
[29]
Liu, and Christopher D
Abigail See, Peter J. Liu, and Christopher D. Manning. 2017. https://doi.org/10.18653/v1/P17-1099 Get to the point: Summarization with pointer-generator networks . In ACL
2017 doi
-
[30]
Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016. http://aclweb.org/anthology/P/P16/P16-1162.pdf Neural machine translation of rare words with subword units . In ACL
2016
-
[31]
Mayumi Ueda, Mari Takahata, and Shinsuke Nakajima. 2011. http://dl.acm.org/citation.cfm?id=2887675.2887686 User's food preference extraction for personalized cooking recipe recommendation . In SPIM
2011
-
[32]
Gomez, Lukasz Kaiser, and Illia Polosukhin
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. http://papers.nips.cc/paper/7181-attention-is-all-you-need Attention is all you need . In NIPS
2017
-
[33]
Williams and David Zipser
Ronald J. Williams and David Zipser. 1989. https://doi.org/10.1162/neco.1989.1.2.270 A learning algorithm for continually running fully recurrent neural networks . Neural Computation, 1(2):270--280
1989 doi
-
[34]
Jingjing Xu, Xuancheng Ren, Yi Zhang, Qi Zeng, Xiaoyan Cai, and Xu Sun. 2018. https://aclanthology.info/papers/D18-1462/d18-1462 A skeleton-based model for promoting coherence among sentences in narrative story generation . In EMNLP
2018
-
[35]
Zichao Yang, Phil Blunsom, Chris Dyer, and Wang Ling. 2017. https://aclanthology.info/papers/D17-1197/d17-1197 Reference-aware language models . In EMNLP
2017
-
[36]
Weischedel, Kevin Knight, Dongyan Zhao, and Rui Yan
Lili Yao, Nanyun Peng, Ralph M. Weischedel, Kevin Knight, Dongyan Zhao, and Rui Yan. 2018. http://arxiv.org/abs/1811.05701 Plan-and-write: Towards better automatic storytelling . CoRR, abs/1811.05701
2018 arXiv
-
[37]
Saizheng Zhang, Emily Dinan, Jack Urbanek, Arthur Szlam, Douwe Kiela, and Jason Weston. 2018. https://aclanthology.info/papers/P18-1205/p18-1205 Personalizing dialogue agents: I have a dog, do you have pets too? In ACL
2018
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.