Independent research lab · Methods of inference
Better models.
Better understanding.
I'm Jay Sheldon, and I work on methods for learning from data: Bayesian choice models, analytic agents, causal inference and adaptive experiments. This is where I try them out on public data and post the code, including the parts that didn't work.
Where I start from
The world generates the data. A dataset is what's left behind after some process has run: patients responding to a drug, people choosing between options. So before I trust a model, I want to know what it says about that process and what I'd expect to see if it were wrong.
That question has become more pressing. It now takes a few minutes to get a model, working code and a confident write-up out of an AI system. The hard part is knowing whether to believe any of it, and most of this site is me working on that.
Method areas
Bayesian models of choice and preference
Hierarchical Bayes for conjoint and MaxDiff, and the demand simulators built on top of them. This is my day job, so it's where I have the most opinions.
Analytic agents and their evaluation
Agents that pull evidence together, suggest hypotheses and run the analysis. What I mostly want to know is how you'd check their work.
Causal inference
Effects from observational data, with the assumptions written down and a look at how hard the answer leans on each one.
Adaptive experiments
Bandit and sequential designs next to plain balanced ones. Adaptive designs save sample, and I'd like to know what that costs you when it's time to estimate something.
Latest work
Hierarchical Bayesian models in PyMC, from specification to diagnostics
Partial pooling on a public dataset. Covers prior choice, sampling diagnostics, posterior predictive checks and what the model cannot tell you.
Applied work
I also do this for a living. I take on consulting projects, model reviews, agent builds and research collaborations, plus the occasional contract or fractional role. Paid work runs through Significance.ai, my consulting practice.