Can my landlord evict me if i have a garden?

Only if he's a b@stard! If it were me, regardless of what the lease said, I'd take it to mean that you are treating his property as your home (albeit temporary) and therefore you are taking good care of it. You can grow almost anything without permanently altering the landscape.