Towards Scaling Inference