REVIEW 3 major objections 5 minor 44 references
Into the Unknown: Applying Inductive Spatial-Semantic Location Embeddings for Predicting Individuals' Mobility Beyond Visited Places
T0 review · 3 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read The paper claims that CaLLiPer, a multimodal location embedding learned by aligning coordinates with point-of-interest text through contrastive learning, improves next-location prediction, and that its main advantage appears when the…
desk verdict A useful application study whose inductive claim is not yet established: the held-out POIs are likely not held out from CaLLiPer's pretraining, and baselines are left without a mechanism to embed unseen locations. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is CaLLiPer, a multimodal representation-learning framework that aligns a coordinate-based location encoder with a text encoder over point-of-interest descriptions. The location encoder maps geographic coordinates through a multi-scale Grid positional encoding and a fully connected network; the text encoder is a Sentence Transformer; and the two modalities are pulled together by a bidirectional InfoNCE contrastive objective. Because the encoder maps any coordinate rather than only locations in a fixed vocabulary, it is inductive: an embedding exists for any unseen location. The downstream mechanism is MHSA, a multi-head self-attention Transformer that ingests these frozen embeddings and outputs a softmax over candidate next locations; the paper uses its performance as the measurement of embedding quality.
What would settle it
Re-run the FSQ-NYC inductive experiment after deleting from CaLLiPer's pre-training corpus every POI whose coordinates overlap the held-out set L_new, while keeping the downstream training identical. If the Acc@1 advantage over the best baseline (reportedly 16.07 versus 15.25) disappears, the claimed generalisation to unseen places fails the 'unseen' test.
Extended reading notes
Core claim
The central discovery is that location embeddings built from general spatial and semantic data, rather than from individual mobility traces, can serve as drop-in substitutes for conventional lookup-table embeddings in next-location prediction. The paper applies CaLLiPer, pre-trained by contrasting coordinates with accompanying point-of-interest text, to four public mobility datasets in both a conventional setting and an inductive setting where ten percent of locations are absent from the training and validation sequences. The results show CaLLiPer attains the best scores on all metrics in both settings for FSQ-NYC and Gowalla-LD; on FSQ-TKY it becomes best on most metrics in the inductive setting; and on Geolife it is best on three of five metrics in both settings. From these numbers the paper concludes that the inductive, spatially explicit, semantically enriched nature of CaLLiPer embeddings makes them particularly suited to scenarios where new locations emerge.
Load-bearing premise
The inductive comparison is only fair if every method gets the same kind of information about unseen locations; the paper leaves open whether baselines receive only random or zero vectors for held-out locations while CaLLiPer still benefits from their coordinates and POI semantics.
Editorial extensions
If this is right
- Predictive systems can serve new locations without retraining the embedding layer, because the location encoder produces vectors for any coordinate at inference time.
- Embedding pre-training no longer depends on mobility traces, so it can exploit publicly available POI data even when detailed movement data are privacy-restricted.
- On two datasets the inductive gains are larger than the conventional gains, and on a third the method moves from behind in the conventional setting to leading most metrics in the inductive setting, indicating the spatial-semantic encoder carries much of the generalisation load.
- The same frozen embeddings feed the same downstream predictor across datasets and settings, so the representation can act as reusable infrastructure rather than a task-specific lookup table.
Reading between the lines
- A stronger inductive test would also withhold the held-out locations' POI descriptions from CaLLiPer's pre-training corpus; the paper does not report whether such overlap exists, so part of the 'unseen' advantage could come from the semantic channel rather than from spatial continuity alone.
- Comparing CaLLiPer against a coordinate-only location encoder (without POI text) would separate the contribution of spatial continuity from semantic enrichment, an ablation the paper does not run.
- The same embeddings could be tested for cold-start mobility prediction, where a new user's first check-in is to an unseen location; if the inductive mechanism works, the predictor should degrade far less for users with few observations than lookup-table baselines.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes using CaLLiPer, a contrastive location encoder pre-trained on POI coordinates and textual descriptions, as an inductive location embedding for individual next-location prediction. On four public mobility datasets, it compares CaLLiPer with six baselines under conventional and inductive train/validation/test splits, using MHSA as a common downstream predictor, and reports Acc@1/5/10, MRR, and nDCG@10 in Table 2, together with UMAP visualisations. The abstract claims consistent superiority, with a particular advantage in inductive scenarios involving previously unseen locations, and the authors release code and data for reproducibility.
Significance. If the central claim were established, this would be a useful contribution: it would be the first application of a multimodal, spatially explicit and semantically informed location encoder to individual mobility prediction, and it would offer a practical way to handle emerging locations without retraining lookup-table embeddings. The manuscript is transparent about releasing code and data, and the evaluation uses public datasets with a common downstream model. However, the inductive protocol is currently underspecified in a way that directly affects the validity of the main claim, and the abstract overstates the results reported in Table 2. The significance is therefore conditional on a corrected, equal-information inductive evaluation.
major comments (3)
- [4.3 (with 4.1 and A.1)] The inductive setting does not enforce an equal-information condition. Section 4.3 removes mobility sequences containing L_new from the train/validation sets and states that locations in L_new are 'not seen during neither the pre-training phase nor the downstream model training phase.' However, CaLLiPer's pre-training is not on mobility sequences but on POI coordinates and textual descriptions (Sections 3.3.1 and A.1). For FSQ-NYC and FSQ-TKY the locations are the dataset's own POIs, and Section 4.1 states that no additional POI sourcing is needed because these datasets already include POI information; for Gowalla-LD and Geolife, external Foursquare POI data covering London and Beijing are used for CaLLiPer pre-training. The paper never states that the POIs corresponding to L_new are removed from CaLLiPer's contrastive pre-training set. If they are not removed, CaLLiPer has already seen the coordinates and textual descriptions of the supposedly unseen test locations, and the inductive comparison measures data leakage rather than generalisation.
- [4.3 (with Eqs. 4-5)] The paper does not explain how the non-inductive baselines obtain embeddings for locations in L_new. Vanilla-E2E, Skip-gram, POI2Vec, Geo-Teaser, TALE, and CTLE all rely on a fixed vocabulary learned from the training sequences; after the inductive filtering, no sequence containing an L_new location remains, so these methods have no embedding for those locations. The downstream model's output layer, defined in Eq. (4) and trained with Eq. (5), has one logit per location, and the paper does not specify whether L_new are in the output space for the baselines, whether their embeddings are randomly initialised, or whether the final layer is truncated. Without this information, the inductive columns of Table 2 are difficult to interpret as a comparison of generalisation ability.
- [Abstract and Section 5.1 / Table 2] The abstract's claim that CaLLiPer 'consistently outperforms strong baselines' and 'particularly excelling in inductive scenarios' is not supported by Table 2. On FSQ-TKY conventional, the relative differences are negative for all five metrics (Acc@1 -8.31%, Acc@5 -1.09%, Acc@10 -0.30%, MRR -3.52%, nDCG@10 -2.47%); on Geolife, Acc@5 and Acc@10 are negative in both conventional and inductive settings. The more careful wording in Section 5.1, which says CaLLiPer has the best result in the majority of cases and performs well on a subset of metrics in the remaining datasets, is accurate, but it should replace the abstract's overclaim.
minor comments (5)
- [4.3] The sentence 'not seen during neither the pre-training phase nor the downstream model training phase' should read 'not seen during either the pre-training phase or the downstream model training phase.'
- [Figures 4 and 5] Both figure captions contain the typo 'conventinoal setting,' which should be corrected to 'conventional setting.'
- [4.1] The dataset enumeration lists only FSQ-NYC, Gowalla-LD, and Geolife, but Table 1 and the rest of the paper also use FSQ-TKY; the fourth dataset should be named explicitly in the text.
- [5.1] The phrase 'significantly outperforms' is used without reporting significance tests; several key comparisons show overlapping standard deviations, for example FSQ-NYC inductive Acc@1 with CaLLiPer 16.07 ± 0.69 versus Vanilla-E2E 15.25 ± 1.04, so either significance testing or explicit wording that the differences are not tested would be appropriate.
- [A.1] Appendix A.1 reports dataset-specific hyperparameters for CaLLiPer, but the accompanying text should be cross-checked for FSQ-TKY, which is omitted from the dataset list in Section 4.1.
Circularity Check
No circular derivation: downstream accuracy is an independent external benchmark; self-citation to CaLLiPer is context, not the load-bearing argument.
full rationale
The paper's central claim is that CaLLiPer embeddings, pre-trained by contrastive alignment of coordinates and POI text, improve next-location prediction when plugged into a downstream MHSA model. The target metrics (Acc@k, MRR, nDCG@10) are computed on held-out mobility sequences and are not used to fit any CaLLiPer parameter: Section 3.3 defines the pretraining objective as InfoNCE over POI pairs, Section 4 lists the downstream model and metrics, and the embeddings are frozen during downstream training. No equation in the paper reduces the prediction output to the pretraining objective by construction. The only self-citation is reference [34] for the CaLLiPer architecture and its prior urban-characterisation result; that citation is not the evidence for the empirical comparison here, which stands on Table 2 against external baselines. The inductive-setting concern in Section 4.3 — that L_new sequences are removed from mobility training/validation but CaLLiPer's POI pretraining set is not explicitly filtered — is a potential data-leakage/fairness problem affecting the validity of the inductive comparison, not a circular definition or a fitted input renamed as a prediction. Under the defined circularity patterns, no specific reduction can be exhibited, so the appropriate finding is no significant circularity.
Assumptions & free parameters
free parameters (2)
- CaLLiPer Grid scale radii r_min and r_max =
0.01 and 10 for FSQ-NYC, FSQ-TKY, and Geolife; 1 and 1000 for Gowalla-LD
- Inductive sample fraction =
10%
assumptions (3)
- domain assumption POI textual descriptions capture the semantic function of a location relevant to mobility behavior
- ad hoc to paper The inductive split makes test locations unseen for all embedding methods
- domain assumption MHSA is a representative and fair downstream predictor
Cite this review
Pith. "Pith review of Into the Unknown: Applying Inductive Spatial-Semantic Location Embeddings for Predicting Individuals' Mobility Beyond Visited Places." pith.science (2026). https://pith.science/paper/ZEZ37FVL
@misc{pith2026250614070,
author = {Pith},
title = {Pith review of: Into the Unknown: Applying Inductive Spatial-Semantic Location Embeddings for Predicting Individuals' Mobility Beyond Visited Places},
year = {2026},
howpublished = {\url{https://pith.science/paper/ZEZ37FVL}},
note = {Machine review of arXiv:2506.14070}
}
read the original abstract
Predicting individuals' next locations is a core task in human mobility modelling, with wide-ranging implications for urban planning, transportation, public policy and personalised mobility services. Traditional approaches largely depend on location embeddings learned from historical mobility patterns, limiting their ability to encode explicit spatial information, integrate rich urban semantic context, and accommodate previously unseen locations. To address these challenges, we explore the application of CaLLiPer -- a multimodal representation learning framework that fuses spatial coordinates and semantic features of points of interest through contrastive learning -- for location embedding in individual mobility prediction. CaLLiPer's embeddings are spatially explicit, semantically enriched, and inductive by design, enabling robust prediction performance even in scenarios involving emerging locations. Through extensive experiments on four public mobility datasets under both conventional and inductive settings, we demonstrate that CaLLiPer consistently outperforms strong baselines, particularly excelling in inductive scenarios. Our findings highlight the potential of multimodal, inductive location embeddings to advance the capabilities of human mobility prediction systems. We also release the code and data (https://github.com/xlwang233/Into-the-Unknown) to foster reproducibility and future research.
Figures
Reference graph
Works this paper leans on
-
[1]
Hugo Barbosa, Marc Barthelemy, Gourab Ghoshal, Charlotte R James, Maxime Lenormand, Thomas Louail, Ronaldo Menezes, José J Ramasco, Filippo Simini, and Marcello Tomasini. 2018. Human mobility: Models and applications. Physics Reports 734 (2018), 1–74
2018
-
[2]
Yoshua Bengio, Aaron Courville, and Pascal Vincent. 2013. Representation learning: A review and new perspectives. IEEE transactions on pattern analysis and machine intelligence 35, 8 (2013), 1798–1828
2013
-
[3]
Maike Buchin, Somayeh Dodge, and Bettina Speckmann. 2012. Context-aware similarity of trajectories. In Geographic Information Science: 7th International Conference, GIScience 2012, Columbus, OH, USA, September 18-21, 2012. Proceedings
work page 2012
-
[4]
Eunjoon Cho, Seth A Myers, and Jure Leskovec. 2011. Friendship and mobility: user movement in location-based social networks. In Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining . 1082–1090
2011
-
[5]
Grace Chu, Brian Potetz, Weijun Wang, Andrew Howard, Yang Song, Fernando Brucher, Thomas Leung, and Hartwig Adam. 2019. Geo-aware networks for fine-grained recognition. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops
work page 2019
-
[6]
Jacob Devlin, Chang Ming-Wei, Lee Kenton, and Toutanova Kristina. 2019. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of naacL-HLT, Vol. 1. Minneapolis, Minnesota, 2
work page 2019
-
[7]
Zicheng Fan, Chen-Chieh Feng, and Filip Biljecki. 2025. Coverage and bias of street view imagery in mapping the urban environment. Computers, Environment and Urban Systems 117 (2025), 102253
work page 2025
-
[8]
Shanshan Feng, Gao Cong, Bo An, and Yeow Meng Chee. 2017. Poi2vec: Geo- graphical latent representation for predicting future visitors. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 31
2017
Show all 44 references
-
[9]
Foursquare. 2024. Foursquare Open Source Places: A new foundational dataset for the geospatial community . Retrieved May 31, 2025 from https://location.foursquare.com/resources/blog/products/foursquare-open- source-places-a-new-foundational-dataset-for-the-geospatial-community/
2024
-
[10]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory.Neural computation 9, 8 (1997), 1735–1780
1997
-
[11]
Ye Hong, Yatao Zhang, Konrad Schindler, and Martin Raubal. 2023. Context-aware multi-head self-attentional neural network model for next location prediction. Transportation Research Part C: Emerging Technologies 156 (2023), 104315
2023
-
[12]
Ilya Ilyankou, Andy Newing, and Nick Hood. 2023. Supermarket store locations as a proxy for neighbourhood health, wellbeing, and wealth. Sustainability 15, 15 (2023), 11641
2023
-
[13]
Konstantin Klemmer, Esther Rolf, Caleb Robinson, Lester Mackey, and Marc Rußwurm. 2025. Satclip: Global, general-purpose location embeddings with satellite imagery. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 39. 4347–4355. Conference acronym ’XX, J...
2025
-
[14]
Dejiang Kong and Fei Wu. 2018. HST-LSTM: A hierarchical spatial-temporal long-short term memory network for location prediction.. In Ijcai, Vol. 18. 2341– 2347
2018
-
[15]
Minjin Lee and Petter Holme. 2015. Relating land use and human intra-city mobility. PloS one 10, 10 (2015), e0140152
2015
-
[16]
Yan Lin, Huaiyu Wan, Shengnan Guo, and Youfang Lin. 2021. Pre-training context and time aware location embeddings from spatial-temporal trajectories for user next location prediction. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 4241–4248
2021
-
[17]
Junyuan Liu, Xinglei Wang, and Tao Cheng. 2025. Enriching Location Repre- sentation with Detailed Semantic Information. arXiv preprint arXiv:2506.02744 (2025)
2025 arXiv
-
[18]
Xin Liu, Yong Liu, and Xiaoli Li. 2016. Exploring the context of locations for personalized location recommendations.. In IJCAI. 1188–1194
2016
-
[19]
Massimiliano Luca, Gianni Barlacchi, Bruno Lepri, and Luca Pappalardo. 2021. A survey on deep learning for human mobility. ACM Computing Surveys (CSUR) 55, 1 (2021), 1–44
2021
-
[20]
Oisin Mac Aodha, Elijah Cole, and Pietro Perona. 2019. Presence-only geograph- ical priors for fine-grained image classification. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 9596–9606
2019
-
[21]
Gengchen Mai, Krzysztof Janowicz, Yingjie Hu, Song Gao, Bo Yan, Rui Zhu, Ling Cai, and Ni Lao. 2022. A review of location encoding for GeoAI: methods and applications. International Journal of Geographical Information Science 36 (2022), 639–673. doi:10.1080/13658816.2021.2004602
2022
-
[22]
Gengchen Mai, Krzysztof Janowicz, Bo Yan, Rui Zhu, Ling Cai, and Ni Lao
-
[23]
Gengchen Mai, Yao Xuan, Wenyun Zuo, Yutong He, Jiaming Song, Stefano Er- mon, Krzysztof Janowicz, and Ni Lao. 2023. Sphere2Vec: A general-purpose location representation learning over a spherical surface for large-scale geospa- tial predictions. ISPRS Journal of Photogrammetry...
2023
-
[24]
Henry Martin, Ye Hong, Nina Wiedemann, Dominik Bucher, and Martin Raubal
-
[25]
Leland McInnes, John Healy, and James Melville. 2018. Umap: Uniform man- ifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018)
2018 arXiv
-
[26]
Tomas Mikolov. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)
2013 arXiv
-
[27]
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. Advances in neural information processing systems 26 (2013)
2013
-
[28]
Reimers Nils and Gurevych Iryna. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. InProceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCN...
2019
-
[29]
Luca Pappalardo, Ed Manley, Vedran Sekara, and Laura Alessandretti. 2023. Future directions in human mobility science. Nature computational science 3, 7 (2023), 588–600
2023
-
[30]
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In International conference on machine learni...
2021
-
[31]
Marc Rußwurm, Konstantin Klemmer, Esther Rolf, Robin Zbinden, and Devis Tuia. 2024. Geographic Location Encoding with Spherical Harmonics and Sinu- soidal Representation Networks. In The 12th International Conference on Learning Representations
2024
-
[32]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017)
2017
-
[33]
Huaiyu Wan, Yan Lin, Shengnan Guo, and Youfang Lin. 2021. Pre-training time- aware location embeddings from spatial-temporal trajectories. IEEE Transactions on Knowledge and Data Engineering 34, 11 (2021), 5510–5523
2021
-
[34]
Xinglei Wang, Tao Cheng, Stephen Law, Zichao Zeng, Lu Yin, and Junyuan Liu
-
[35]
Xinglei Wang, Meng Fang, Zichao Zeng, and Tao Cheng. 2023. Where would i go next? large language models as human mobility predictors. arXiv preprint arXiv:2308.15197 (2023)
2023 arXiv
-
[36]
Dingqi Yang, Daqing Zhang, Vincent W Zheng, and Zhiyong Yu. 2014. Modeling user activity preference by leveraging user spatial temporal characteristics in LBSNs. IEEE Transactions on Systems, Man, and Cybernetics: Systems 45, 1 (2014), 129–142
2014
-
[37]
Zijun Yao, Yanjie Fu, Bin Liu, Wangsu Hu, and Hui Xiong. 2018. Representing urban functions through zone embedding with human mobility patterns. In Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI-18)
2018
-
[38]
Pengpeng Zhao, Anjing Luo, Yanchi Liu, Jiajie Xu, Zhixu Li, Fuzhen Zhuang, Victor S Sheng, and Xiaofang Zhou. 2020. Where to go next: A spatio-temporal gated network for next poi recommendation. IEEE Transactions on Knowledge and Data Engineering 34, 5 (2020), 2512–2524
2020
-
[39]
Shenglin Zhao, Tong Zhao, Irwin King, and Michael R Lyu. 2017. Geo-teaser: Geo-temporal sequential embedding rank for point-of-interest recommendation. In Proceedings of the 26th international conference on world wide web companion . 153–162
2017
-
[40]
Yu Zheng, Xing Xie, Wei-Ying Ma, et al. 2010. GeoLife: A collaborative social networking service among user, location and trajectory. IEEE Data Eng. Bull. 33, 2 (2010), 32–39
2010
-
[41]
Yang Zhou and Yan Huang. 2018. Deepmove: Learning place representations through large scale movement data. In 2018 IEEE international conference on big data (big data). IEEE, 2403–2412. A More experimental details To ensure a fair comparison, we set the embedding dimension to ...
2018
-
[2020]
In International Conference on Learning Representations
Multi-Scale Representation Learning for Spatial Feature Distributions using Grid Cells. In International Conference on Learning Representations . https: //openreview.net/forum?id=rJljdh4KDH
-
[2023]
Computers, Environment and Urban Systems 101 (2023), 101938
Trackintel: An open-source Python library for human mobility analysis. Computers, Environment and Urban Systems 101 (2023), 101938
2023
-
[2025]
Computers, Environment and Urban Systems 120 (2025), 102299
Multi-modal contrastive learning of urban space representations from POI data. Computers, Environment and Urban Systems 120 (2025), 102299
2025
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.