Berry bushes can gain and lose traits depending on their nutrient levels, so if you're just dropping them on low quality soil and not fertilizing them, that's why they're losing positive traits. They're less maintenance than normal farming, but if you want a good harvest without planting a massive farm then it's very fertilizer intensive.