TheorySpace

Independent research lab · Methods of inference

Better models.
Better understanding.

I'm Jay Sheldon, and I work on methods for learning from data: Bayesian choice models, analytic agents, causal inference and adaptive experiments. This is where I try them out on public data and post the code, including the parts that didn't work.

Where I start from

The world generates the data. A dataset is what's left behind after some process has run: patients responding to a drug, people choosing between options. So before I trust a model, I want to know what it says about that process and what I'd expect to see if it were wrong.

That question has become more pressing. It now takes a few minutes to get a model, working code and a confident write-up out of an AI system. The hard part is knowing whether to believe any of it, and most of this site is me working on that.

Method areas

More detail

Bayesian models of choice and preference

Hierarchical Bayes for conjoint and MaxDiff, and the demand simulators built on top of them. This is my day job, so it's where I have the most opinions.

Analytic agents and their evaluation

Agents that pull evidence together, suggest hypotheses and run the analysis. What I mostly want to know is how you'd check their work.

Causal inference

Effects from observational data, with the assumptions written down and a look at how hard the answer leans on each one.

Adaptive experiments

Bandit and sequential designs next to plain balanced ones. Adaptive designs save sample, and I'd like to know what that costs you when it's time to estimate something.

Latest work

All notes

Applied work

I also do this for a living. I take on consulting projects, model reviews, agent builds and research collaborations, plus the occasional contract or fractional role. Paid work runs through Significance.ai, my consulting practice.