The Most Difficult Aspect In SEO

Performing SEO on any given site require some steps which involves ANALYZING, building links, submitting to google for crawling etc, of all the steps which aspect do you think is the most difficult aspect in SEO, use your personal experience as example