Nah, I don't find them hard to grow. Now before I got the timer for the hose... I was forgetting to water. I only "treated" the dirt once, with some fish fertilizer after I planted them. Grew much taller than I hoped for too. I picked up the seeds from Azure Standard, they have awesome prices on heirlooms!!
I do find that sunflowers don't do well for me in containers or raised flower beds.
I'll be buying those same seeds then as I love Azure anyway. I'll give the raised beds a try and if that doesn't work, straight in the ground.