Google - Don't Forget The Bread & Butter Crawling!
I was just adding some content to my Olympics blog and noticed that newly posted content was being added into the serps instantly - but pages on the site that I'd hard-coded in still aren't in a week later.
I know it ranks well (at the moment) for one of the most important phrases of next year, but it still isn't loved enough to deep (cough - one link deep) crawl. But surely they shouldn't be relying so heavily on leveraging our RSS feeds or Feedburner to find new content!
Surely doesn't having an RSS feed for non-blog sites become even more important now? I've even been trying to get one of my clients to create an RSS feed for the past two years with no luck!
Does anyone else have any issues with non blog content on their blog domain?
![]() |
2 Comments:
I have noticed google is crawling new posts on some of my blogs very quickly, I guess it is from the rss feed?
They dont revisit old content and my sticky content that much.
What is getting them to crawl quick though is that the blog pings google, sitemap update alerts google via google sitemaps, is it via a rss feed?
I dont know tha answer just interested what people think.
The blogs involved dont have many links in, so google must be using one of the methods above.
I think they're just going the rss feeds. They own feedburner so have the technology and db in place to take content very quickly.
I just wish they took non-blog content as fast - but we can't have everything.
Now if they allowed blogger to publish pages in .php (other than the homepage) then I can include my nice php scripts that draw in news dynamically - rather than create static ones :-(
ho hum! Merry Christmas by the way matey!
Post a Comment
Subscribe to Post Comments [Atom]
Home:- Home
- RSS Feed
- Miss-Spells Tool
- 0 To 4,000 Visits A Day In Ten Weeks Using Blogging
- The 10 Affects Of Google's Trademark Policy Changes For Affiliates
- So Who Is MyVoucherCodes' Mark Pearson
- Twitter For Affiliate Marketing? Like Shooting Fish In A Barrel
- Top 10 Tools To Improve Affiliate Productivity
- Industry Greats - An Interview With Joe Connor
- Had Enough Of Crappy Link Building Emails
- So What Actually Is Wrong With Some Voucher Code Sites? Case In Point
- Don't Believe The Hype - All That Glitters May Not Be Gold
- Look To The Long Tail For Affiliate Gold
- How Should You Select Merchants To Promote? Part 1: Networks
- Has Seth Godin's Meatball Sundae Gone Off?
- Affiliates: What Has Google Ever Done For Us?
- Don't Do Paid Posts - I Told Ya So!
- My Christmas Winners at Affiliate Window
- No I Won't Sell Links, Sponsored Reviews Or Pay Per Post
- What Will Affiliate Marketing Be Like In 5 Years?
- The End Of Blogging Is Nigh
- Google Analytics Please Give Me For Christmas
- Another Look At Brand Name Bidding
- What Do You Need To Be a Successful Affiliate? The Ten Traits
- 10 Top Tips: Successful Affiliate Marketing During a Recession
- Why I Effectively Left Affiliate Marketing
- And Why I'm Back
- Complete Rubbish About Affiliate Marketing
- All Those Social Media Knockers: Start Listening
- The Great Big Social Land Grab - Call it Bubble 2.0
- Where ASOS Get's Its Traffic From
- SEO Ranking Factors
- Google to Hit "Hidden Links" Sites Harder
- Who Said Doorways & Hidden Link Spam Are Dead?
- Nick Robinson - ASOS Numpty?
- What Can You Learn From The Affiliate Marketing Leaders?
- Down to the Social - Twitter
- Dissecting Affiliate Marketing
- Via Email
- MSN - myname@hotmail.com
- Affiliate Marketing
- Brand Name Bidding
- SEO
- Social Media
- UK Affiliate Networks
- Altogether Digital
- dgm
- Webgains
- The Good 'ole Days: My Adsense Earnings - The Lessons
- Online Marketing Tip Of The Week: My Google Maps
- Meet The Agency: Brilliant Affiliates
- Google Webmaster Tools & Site's Geographic Target
- A Look Back At November 2007
- Guaranteed Results Public Relations - Paid On Resu...
- Crowded House Gig Review - Manchester
- SEO: The Art Of The Obvious
- SEO Magazine Subscription Offer
- What's Going To Be Big In 2008?
- HallNet Ltd
- Hot in 2007
- Shiply
- Hot in 2009
- Hot in 2008
- SEO Warrington
- Get Visible Blogs (Out of date)

Most Popular Posts:
Twitter Updates:
follow me on Twitter
Contact Me
Lee's Views On:
Meet The Networks:
Previous Posts
Social Marketing Stuff
Related Sites
Another Affiliate Marketing Blog
2008 Posts
Jul / Aug / Sept / Oct / Nov / Dec
Jan / Feb / Mar / Apr / May / Jun
2007 Posts
Jul / Aug / Sept / Oct / Nov / Dec
Jan / Feb / Mar / Apr / May / Jun