The number of farm workers increase when you build residential buildings or get better ones.