Never too late, it's a question of scale, at home I grow herb, salad and strawberries in 2lt milk cartons and homemade raised beds for flowers, herbs and some veg and fruit we use larger pots for some fruit. It's nice to nip out on a Sunday to grab some rosemary, mint or thyme to use on the lunch, Try growing potatoes in bags for life, just make a few holes in them. There's always something you can do and the taste difference is very noticeable.