How to setup multistore in multilingual enviroment?

I have store that has multiple languages. I would like to have different store for different language. Currently I have store picker on my home page but if I make it multilingual and pick different stores for different language it do not work. Product stock always shows 0 and prices are not showing in back office. How I need to setup my back office to make it work?