Get the priv struct of the right object.