Any time a rifle breaks barrel from action or any other metal to metal part, you will not get perfect realignment. (This generally goes for quick detach rings/bases also). You may be able to get real darn close, but you will not get perfect. The closer you get, the less shift is possible. The HS precision take down rifles are pretty good, but like I said, they cannot be perfect, and you will see a change in zero, hopefully really really small.
MEL