Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning | Paper Citation Record

Observation 5cf9ca6b-303e-49b7-860a-b97f038ec39c · outbound

This paper cites Formulation and estimation of dynamic models using panel data.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Formulation and estimation of dynamic models using panel data

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.013868Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 81eab347-b38c-4953-a397-f6fa7bbcb21d · outbound

This paper cites Doubly robust identification for causal panel data models.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Doubly robust identification for causal panel data models

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.019604Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d392ba94-52de-418b-9353-b0106c23bf1f · outbound

This paper cites Design-based analysis in difference-in-differences settings with staggered adoption.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Design-based analysis in difference-in-differences settings with staggered adoption

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.024472Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a13dec1d-9588-44aa-bf28-610180a1d069 · outbound

This paper cites Econometric analysis of panel data, volume 4.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Econometric analysis of panel data, volume 4

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.029217Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 856b2df3-9142-4198-a91c-0af226994e1d · outbound

This paper cites Genetic risk profiles for cancer susceptibility and therapy response.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Genetic risk profiles for cancer susceptibility and therapy response

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.033801Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b4fc580b-0d56-486a-9196-350a637475a3 · outbound

This paper cites Proximal reinforcement learning: Efficient off-policy evaluation in partially observed markov decision processes.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Proximal reinforcement learning: Efficient off-policy evaluation in partially observed markov decision processes

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.038799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2d2851fd-f9da-422f-a698-a9b11f3f2593 · outbound

This paper cites Off-policy Evaluation in Doubly Inhomogeneous Environments.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Off-policy Evaluation in Doubly Inhomogeneous Environments

Reference 7

Resolution: verified exact; local_arxiv, observed 2026-08-11T20:26:50.168208Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation e6aa3b11-ad83-48f3-aa5e-d6c55cdf5ca9 · outbound

This paper cites Time series deconfounder: Estimating treatment effects over time in the presence of hidden confounders.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Time series deconfounder: Estimating treatment effects over time in the presence of hidden confounders

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.048680Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f3703407-ced8-4883-8a64-918f469106e4 · outbound

This paper cites Robust fitted-q-evaluation and iteration under sequentially exogenous unobserved confounders.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Robust fitted-q-evaluation and iteration under sequentially exogenous unobserved confounders

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.052749Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2f731838-1fa3-45b9-bd8d-fc1dcab8f1d9 · outbound

This paper cites Treatment effects in interactive fixed effects models with a small number of time periods.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Treatment effects in interactive fixed effects models with a small number of time periods

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.057216Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 64d47dda-039d-4779-9afd-7c65d9605d74 · outbound

This paper cites Statistical inference.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Statistical inference

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.061405Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 674bde1d-3223-409c-babe-49b6fe6a5f80 · outbound

This paper cites Universal off-policy evaluation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Universal off-policy evaluation

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.065314Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ea0ba1f1-cf76-4fa8-ad75-515556cd94b5 · outbound

This paper cites Testing for the markov property in time series.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Testing for the markov property in time series

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.069222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 61ddd041-b55b-4d1e-932d-44105215db94 · outbound

This paper cites Information-Theoretic Considerations in Batch Reinforcement Learning.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Information-Theoretic Considerations in Batch Reinforcement Learning

Reference 14

Resolution: verified exact; local_arxiv, observed 2026-08-11T20:26:50.069475Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 61dbe7c9-4d78-4c87-b6a3-b8ea0c5428b2 · outbound

This paper cites On well-posedness and minimax optimal rates of nonparametric q-function estimation in off-policy evaluation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning On well-posedness and minimax optimal rates of nonparametric q-function estimation in off-policy evaluation

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.078519Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 79a87a3e-8b07-4c7e-9a83-f545bcf34291 · outbound

This paper cites On instrumental variable regression for deep offline policy evaluation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning On instrumental variable regression for deep offline policy evaluation

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.083127Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cca7315a-4c7e-47dc-9384-2d46fd4f03d5 · outbound

This paper cites Double/debiased machine learning for treatment and structural parameters.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Double/debiased machine learning for treatment and structural parameters

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.087629Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 54065e70-f661-480c-b050-cb993b19469e · outbound

This paper cites A crash course in good and bad controls.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning A crash course in good and bad controls

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.092271Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b3647527-68eb-42b6-ad3c-2c247dc2fb07 · outbound

This paper cites Coindice: Off-policy confidence interval estimation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Coindice: Off-policy confidence interval estimation

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.096926Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ad05cb02-d180-4a4a-9508-f57b7f20b71e · outbound

This paper cites Comment: Reflections on the deconfounder, 2019.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Comment: Reflections on the deconfounder, 2019

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.101485Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 68dde355-1d55-49a3-b452-15c5bef507d5 · outbound

This paper cites Two-way fixed effects estimators with heterogeneous treatment effects.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Two-way fixed effects estimators with heterogeneous treatment effects

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.105859Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9ea2261c-b5ee-4ba1-aa62-e36811700efe · outbound

This paper cites Counterfactual inference in sequential experiments.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Counterfactual inference in sequential experiments

Reference 22

Resolution: verified exact; local_arxiv, observed 2026-08-11T20:26:50.049057Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 722ea65d-52ee-42d8-9ce1-5a3902d93c9f · outbound

This paper cites A theoretical analysis of deep q-learning.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning A theoretical analysis of deep q-learning

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.115428Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6dc54f2f-3ac3-4e0a-ba59-30af9c519f98 · outbound

This paper cites More robust doubly robust off-policy evaluation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning More robust doubly robust off-policy evaluation

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.119846Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1aa730a7-d898-46c9-9e90-bd224f8486c2 · outbound

This paper cites Deep neural networks for estimation and inference.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Deep neural networks for estimation and inference

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.124324Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d241ef39-edf2-4287-b0e8-deb304ea1fc6 · outbound

This paper cites Non-parametric panel data models with interactive fixed effects.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Non-parametric panel data models with interactive fixed effects

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.128856Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4e1aa98c-71ab-44ca-8711-72bbcd9c208f · outbound

This paper cites Offline Reinforcement Learning with Instrumental Variables in Confounded Markov Decision Processes.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Offline Reinforcement Learning with Instrumental Variables in Confounded Markov Decision Processes

Reference 27

Resolution: verified exact; local_arxiv, observed 2026-08-11T20:26:50.028564Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 71f7fafc-e76d-4c41-856e-74588a2a464e · outbound

This paper cites Prediction of treatment response for combined chemo-and radiation therapy for non-small cell lung cancer patients using a bio-mathematical model.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Prediction of treatment response for combined chemo-and radiation therapy for non-small cell lung cancer patients using a bio-mathematical model

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.138132Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation af85bcdc-9ff7-4a0b-bd0c-dc89ad0653d8 · outbound

This paper cites Issues in assessing the contribution of research and development to productivity growth.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Issues in assessing the contribution of research and development to productivity growth

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.142440Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4ca90b1d-0ee0-404d-a32e-8736af8529a9 · outbound

This paper cites Richard Guo, Anton Rask Lundborg, and Qingyuan Zhao.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Richard Guo, Anton Rask Lundborg, and Qingyuan Zhao

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.147024Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 52c89603-207b-4f0a-b66d-ed48e4f6765f · outbound

This paper cites Dream to Control: Learning Behaviors by Latent Imagination.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Dream to Control: Learning Behaviors by Latent Imagination

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.151455Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3bfd73e2-7b4c-4d1b-a9ba-66f424d966f0 · outbound

This paper cites Learning latent dynamics for planning from pixels.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Learning latent dynamics for planning from pixels

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.156301Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fa09841b-afa9-4af0-8f09-c107a472fb7d · outbound

This paper cites Bootstrapping fitted q-evaluation for off-policy inference.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Bootstrapping fitted q-evaluation for off-policy inference

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.160798Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 52f1e374-03d7-4990-9a8d-02939d46e023 · outbound

This paper cites Sequential Deconfounding for Causal Inference with Unobserved Confounders.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Sequential Deconfounding for Causal Inference with Unobserved Confounders

Reference 34

Resolution: verified exact; local_arxiv, observed 2026-08-11T20:26:49.994127Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 7fe94afa-707d-4d74-8f53-c5f8b8746612 · outbound

This paper cites Neural collaborative filtering.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Neural collaborative filtering

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.170520Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1b616d7c-1356-4f6b-8bf4-a49d8e0f5007 · outbound

This paper cites A Policy Gradient Method for Confounded POMDPs.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning A Policy Gradient Method for Confounded POMDPs

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.174755Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e4cadad5-e646-4614-a495-325ffc3a13c8 · outbound

This paper cites Collaborative filtering for implicit feedback datasets.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Collaborative filtering for implicit feedback datasets

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.178967Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f18883af-ed44-4dd2-9508-340088c4bad5 · outbound

This paper cites On the use of two-way fixed effects regression models for causal inference with panel data.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning On the use of two-way fixed effects regression models for causal inference with panel data

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.182754Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 32386744-8488-4fe7-9487-63338c368b07 · outbound

This paper cites Off-policy evaluation via off-policy classification.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Off-policy evaluation via off-policy classification

Reference 39

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.799584Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation a127d31e-b7f1-4795-8641-129d4520de1b · outbound

This paper cites When to trust your model: Model-based policy optimization.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning When to trust your model: Model-based policy optimization

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.190846Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 71aaaba8-9046-4a8e-94b2-8f8cf63173aa · outbound

This paper cites A survey on knowledge graphs: Representation, acquisition, and applications.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning A survey on knowledge graphs: Representation, acquisition, and applications

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.194737Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0b532d18-1e37-4f82-a1f3-29eeea0c962c · outbound

This paper cites A Note on Loss Functions and Error Compounding in Model-based Reinforcement Learning.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning A Note on Loss Functions and Error Compounding in Model-based Reinforcement Learning

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.199064Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a49847dc-e071-44ab-8e47-3da895f4dd04 · outbound

This paper cites Doubly robust off-policy value evaluation for reinforcement learning.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Doubly robust off-policy value evaluation for reinforcement learning

Reference 43

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.766712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation af55c0cd-0b26-43a5-a67a-2265db6863e3 · outbound

This paper cites Mimic-iii, a freely accessible critical care database.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Mimic-iii, a freely accessible critical care database

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.208020Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 64ee11ac-76dd-476a-87f0-6ae58685e7f9 · outbound

This paper cites Efficiently breaking the curse of horizon in off-policy evaluation with double reinforcement learning.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Efficiently breaking the curse of horizon in off-policy evaluation with double reinforcement learning

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.212413Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0e964bf1-c5cb-41ef-a054-15e682554714 · outbound

This paper cites Confounding-robust policy evaluation in infinite-horizon reinforcement learning.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Confounding-robust policy evaluation in infinite-horizon reinforcement learning

Reference 46

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.734020Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 94a0e4f1-6eb6-483d-a136-302449c5190e · outbound

This paper cites Offline Policy Evaluation and Optimization under Confounding.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Offline Policy Evaluation and Optimization under Confounding

Reference 47

Resolution: verified exact; local_arxiv, observed 2026-08-11T20:26:49.943952Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 3b6da3e7-58ef-4f93-be19-d93779cdf21d · outbound

This paper cites Learning mixtures of markov chains and mdps.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Learning mixtures of markov chains and mdps

Reference 48

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.719425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 0e270572-5815-4174-bd97-59858a67f107 · outbound

This paper cites Asymptotic Theory for IV-Based Reinforcement Learning with Potential Endogeneity.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Asymptotic Theory for IV-Based Reinforcement Learning with Potential Endogeneity

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.232155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ff919683-2e4f-47ab-94b7-05a99ee2375c · outbound

This paper cites Instrumental Variable Value Iteration for Causal Offline Reinforcement Learning.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Instrumental Variable Value Iteration for Causal Offline Reinforcement Learning

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.237033Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d548c79c-5569-492f-bacf-4f08e31279a2 · outbound

This paper cites Off-policy estimation of long-term average outcomes with applications to mobile health.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Off-policy estimation of long-term average outcomes with applications to mobile health

Reference 51

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.705579Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation b53a4e2a-c74e-4d51-9b97-02e1eeb4febb · outbound

This paper cites Batch policy learning in average reward markov decision processes.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Batch policy learning in average reward markov decision processes

Reference 52

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.690923Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 4e5d4ad9-54f4-44a1-ac39-e5d5a85ef690 · outbound

This paper cites Forecasting treatment responses over time using recurrent marginal structural networks.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Forecasting treatment responses over time using recurrent marginal structural networks

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.250321Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 65385c22-c2a2-4eff-b63e-d9162e098533 · outbound

This paper cites Breaking the curse of horizon: Infinite-horizon off-policy estimation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Breaking the curse of horizon: Infinite-horizon off-policy estimation

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.254963Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0cc27e4d-b8ac-4b9f-bd0f-8969dd803f30 · outbound

This paper cites Provably good batch off-policy reinforcement learning without great exploration.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Provably good batch off-policy reinforcement learning without great exploration

Reference 55

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.658294Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 6020fd7c-11f3-408c-8ef3-d621c217b820 · outbound

This paper cites Causal effect inference with deep latent-variable models.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Causal effect inference with deep latent-variable models

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.264028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 011c4092-9749-427a-9ef8-26338579198c · outbound

This paper cites Deconfounding Reinforcement Learning in Observational Settings.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Deconfounding Reinforcement Learning in Observational Settings

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.268555Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fd481239-bf69-4c47-9a24-db357de512c5 · outbound

This paper cites Pessimism in the face of confounders: Provably efficient offline reinforcement learning in partially observable markov decision processes.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Pessimism in the face of confounders: Provably efficient offline reinforcement learning in partially observable markov decision processes

Reference 58

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.636096Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 4a51b86d-dc62-426d-afdc-9fa3765d7c6b · outbound

This paper cites Estimating causal peer influence in homophilous social networks by inferring latent locations.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Estimating causal peer influence in homophilous social networks by inferring latent locations

Reference 59

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.623463Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 32153b46-476a-4467-aeae-7b83e851470e · outbound

This paper cites Off-policy evaluation for episodic partially observable markov decision processes under non-parametric models.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Off-policy evaluation for episodic partially observable markov decision processes under non-parametric models

Reference 60

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.609868Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation fc41d0e5-9d07-4f21-8904-5012e55c1384 · outbound

This paper cites Empirical production function free of management bias.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Empirical production function free of management bias

Reference 61

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.595983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 56e8f4d9-725a-4e58-8577-1a4e69e10266 · outbound

This paper cites A Spectral Approach to Off-Policy Evaluation for POMDPs.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning A Spectral Approach to Off-Policy Evaluation for POMDPs

Reference 62

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.290906Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 37f99efe-7629-4a6a-9394-86ee51e38913 · outbound

This paper cites Off-policy policy evaluation for sequential decisions under unobserved confounding.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Off-policy policy evaluation for sequential decisions under unobserved confounding

Reference 63

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.582136Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 54907508-141e-4877-a4e4-f4268c6c760a · outbound

This paper cites A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning A Novel Embedding Model for Knowledge Base Completion Based on Convolutional Neural Network

Reference 64

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.299285Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d57eeb98-a197-4cfd-92f9-518be18c6ab6 · outbound

This paper cites A review of relational machine learning for knowledge graphs.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning A review of relational machine learning for knowledge graphs

Reference 65

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.567741Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation eca033d3-c3ed-4dac-b4a0-4093929bb8f9 · outbound

This paper cites Automated cars meet human drivers: responsible human-robot coordination and the ethics of mixed traffic.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Automated cars meet human drivers: responsible human-robot coordination and the ethics of mixed traffic

Reference 66

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.553282Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 0502d09e-fd3a-4c68-99bd-16bd2ce1a339 · outbound

This paper cites blessings of multiple causes.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning blessings of multiple causes

Reference 67

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.313162Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cd511ddc-54a8-4ae9-8bf4-841a0c66b884 · outbound

This paper cites Counterexamples to "The Blessings of Multiple Causes" by Wang and Blei.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Counterexamples to "The Blessings of Multiple Causes" by Wang and Blei

Reference 68

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.317636Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f03a237d-00ca-423b-81c7-15fef16315ff · outbound

This paper cites A critical look at the consistency of causal estimation with deep latent variable models.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning A critical look at the consistency of causal estimation with deep latent variable models

Reference 69

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.539284Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 0df06961-fb28-404c-9c24-a728d438e613 · outbound

This paper cites Doubly robust difference-in-differences estimators.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Doubly robust difference-in-differences estimators

Reference 70

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.525737Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation a4e00b95-682b-4952-895e-f771f7975623 · outbound

This paper cites Importance resampling for off-policy prediction.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Importance resampling for off-policy prediction

Reference 71

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.511247Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 76918f35-ec26-4eb2-a005-7527cb92a1ce · outbound

This paper cites Nonparametric regression using deep neural networks with relu activation function.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Nonparametric regression using deep neural networks with relu activation function

Reference 72

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.336054Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c94b25b5-0eb0-49ce-b030-b6d9692cd316 · outbound

This paper cites On counterfactual inference with unobserved confounding.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning On counterfactual inference with unobserved confounding

Reference 73

Resolution: verified exact; local_arxiv, observed 2026-08-11T20:26:49.773072Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 067ac510-944f-4d18-b6cb-84dc2de34cb7 · outbound

This paper cites Does the markov decision process fit the data: Testing for the markov property in sequential decision making.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Does the markov decision process fit the data: Testing for the markov property in sequential decision making

Reference 74

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.495984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation dba602c9-a56e-4e02-af6c-fd7fbd4fcb16 · outbound

This paper cites Deeply-debiased off-policy interval estimation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Deeply-debiased off-policy interval estimation

Reference 75

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.481440Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 01a0abe7-28ec-40c9-b6fa-76afeb142d23 · outbound

This paper cites A minimax learning approach to off-policy evaluation in confounded partially observable markov decision processes.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning A minimax learning approach to off-policy evaluation in confounded partially observable markov decision processes

Reference 76

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.467036Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 9397cc0a-09a2-462f-8e3e-0ea8651c291e · outbound

This paper cites Statistical inference of the value function for reinforcement learning in infinite-horizon settings.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Statistical inference of the value function for reinforcement learning in infinite-horizon settings

Reference 77

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.451972Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation f75aea1e-95db-497e-83dd-6c2ecff17798 · outbound

This paper cites Off-policy confidence interval estimation with confounded markov decision process.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Off-policy confidence interval estimation with confounded markov decision process

Reference 78

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.437357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 611f730e-97af-4690-94ad-937ecc2f2c3f · outbound

This paper cites Mediation pathway selection with unmeasured mediator-outcome confounding.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Mediation pathway selection with unmeasured mediator-outcome confounding

Reference 79

Resolution: verified exact; raw_fallback, observed 2026-08-11T20:26:49.752062Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 5a207d18-b0e6-48f3-9c1d-8d6dfc330435 · outbound

This paper cites Reasoning with neural tensor networks for knowledge base completion.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Reasoning with neural tensor networks for knowledge base completion

Reference 80

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.371847Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8bf13f72-5146-4824-b96b-f6c32cf73b4b · outbound

This paper cites Reinforcement learning: An introduction.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Reinforcement learning: An introduction

Reference 81

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.376356Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e254b7c3-ddd9-4d3c-a61e-477b512f9f93 · outbound

This paper cites Doubly Robust Bias Reduction in Infinite Horizon Off-Policy Estimation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Doubly Robust Bias Reduction in Infinite Horizon Off-Policy Estimation

Reference 82

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.381181Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ff5acfdd-eea0-4bea-915a-509ac1b12643 · outbound

This paper cites An Introduction to Proximal Causal Learning.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning An Introduction to Proximal Causal Learning

Reference 83

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.385666Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f53839b7-c0a4-4ed0-a2b4-dde6c539d20f · outbound

This paper cites Off-policy evaluation in partially observable environments.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Off-policy evaluation in partially observable environments

Reference 84

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.405119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 2b35f4a5-8d54-4921-9d90-dacbeb46223a · outbound

This paper cites Data-efficient off-policy policy evaluation for reinforcement learning.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Data-efficient off-policy policy evaluation for reinforcement learning

Reference 85

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.391180Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 3538c71c-a3a8-4ff6-975c-c9a846b1b822 · outbound

This paper cites High-confidence off-policy evaluation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning High-confidence off-policy evaluation

Reference 86

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.376590Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation aa3f4e79-c057-494b-94b1-6dd011a90948 · outbound

This paper cites Implicit Causal Models for Genome-wide Association Studies.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Implicit Causal Models for Genome-wide Association Studies

Reference 87

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.403988Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8e91b53c-552f-45e5-ad6e-80d394d79687 · outbound

This paper cites Pessimistic Model-based Offline Reinforcement Learning under Partial Coverage.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Pessimistic Model-based Offline Reinforcement Learning under Partial Coverage

Reference 88

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.408990Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b6b9adc8-d1cd-4b59-b49e-c42fafb9b975 · outbound

This paper cites Minimax weight and q-function learning for off-policy evaluation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Minimax weight and q-function learning for off-policy evaluation

Reference 89

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.413790Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f501c8cd-c13f-4e91-ab43-6980c84cd4be · outbound

This paper cites Using embeddings to correct for unobserved confounding in networks.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Using embeddings to correct for unobserved confounding in networks

Reference 90

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.352098Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation da6374d8-9829-4a5f-b237-bcc3689aef74 · outbound

This paper cites Adapting text embeddings for causal inference.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Adapting text embeddings for causal inference

Reference 91

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.423736Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3b16c69a-bd9d-4fc2-a840-e839d600de9d · outbound

This paper cites Relational deep learning: A deep latent variable model for link prediction.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Relational deep learning: A deep latent variable model for link prediction

Reference 92

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.329080Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 1f3480fa-a383-465c-8444-211ed4b6ea20 · outbound

This paper cites Blessing from Human-AI Interaction: Super Reinforcement Learning in Confounded Environments.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Blessing from Human-AI Interaction: Super Reinforcement Learning in Confounded Environments

Reference 93

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.433207Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4b0b5083-cc16-4f7f-bcf0-a517aa9b41f3 · outbound

This paper cites Provably efficient causal reinforcement learning with confounded observational data.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Provably efficient causal reinforcement learning with confounded observational data

Reference 94

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.315863Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation bdf0cca4-42c4-44f5-a381-04d74a0cc6f8 · outbound

This paper cites The blessings of multiple causes.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning The blessings of multiple causes

Reference 95

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.302272Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 62992a5b-55ea-4fb3-a59e-7beabeab7809 · outbound

This paper cites The Deconfounded Recommender: A Causal Inference Approach to Recommendation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning The Deconfounded Recommender: A Causal Inference Approach to Recommendation

Reference 96

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.447182Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 358dc732-754a-4111-847a-086c856d366f · outbound

This paper cites Semiparametrically efficient off-policy evaluation in linear markov decision processes.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Semiparametrically efficient off-policy evaluation in linear markov decision processes

Reference 97

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.288702Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 3c3c5a1d-a062-4258-96ee-c74991263fb6 · outbound

This paper cites Towards optimal off-policy evaluation for reinforcement learning with marginalized importance sampling.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Towards optimal off-policy evaluation for reinforcement learning with marginalized importance sampling

Reference 98

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.274909Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation eb66cdb4-473c-43a7-a7f0-558b3da967f7 · outbound

This paper cites An instrumental variable approach to confounded off-policy evaluation.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning An instrumental variable approach to confounded off-policy evaluation

Reference 99

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T20:26:50.260239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 7f363e52-78a9-4d07-b6c1-8d1bd082a64d · outbound

This paper cites Strategic Decision-Making in the Presence of Information Asymmetry: Provably Efficient RL with Algorithmic Instruments.

Two-way Deconfounder for Off-policy Evaluation in Causal Reinforcement Learning Strategic Decision-Making in the Presence of Information Asymmetry: Provably Efficient RL with Algorithmic Instruments

Reference 100

Resolution: unresolved; no resolver link, observed 2026-08-11T20:26:49.464366Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Coverage vector

Reference resolution

Outbound references

Pith citing papers