Benches Uncategorized

14

Helping Google find non-homepages

apple Verified

Imported from the Apple Support Forums via the Wayback Machine 🔗

Hi all,

I know this question has been dealt with before in different ways, but I was wondering if someone could help me out with it given the following circumstances:

I’ve made a couple of sites in iWeb, hosted to Godaddy.

Google has no trouble finding my home pages. I google my site and voila, there it is.

However, I take it that because I use iWeb’s navigation bar, Google knows only about my homepage.

I have another site, not done with iWeb (made by pros), and every page on it is returned with a search of a relevant word. If I search for a topic on one of its subpages, for example, Google will return the URL of that subpage in its results. I’d like the same thing to occur with my iWeb sites, so all their pages are visible to search engines.

So here’s the thing. I’m not concerned about my iWeb homepages getting noticed by Google since that happens on its own (actually, other sites will link to my site when they know I’ve thrown something up). Also, I don’t want to turn off iWeb’s navigation bar. I think it looks great, and I’d rather not replace it.

So… is a sitemap what I need? If so, where do I start? What should be my strategy given that:

• I make my site in iWeb
• I like using iWeb's nav bar
• I use Fetch to FTP my site to Godaddy for hosting
• I’m not worried about Google finding my homepage
• I am worried about Google finding all the other pages
• Outside of making sites in iWeb and FTP’ing to Godaddy, I’m a noob.

Are there alternatives to doing a sitemap, or is that exactly what I need?

Many thanks in advance!

14 replies

Sign in or join Beachball Help to reply.

  1. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    Yes, you need to create and upload a sitemap to your root folder on the server, add your site again in your Google Dashboard and add and verify the sitemap.
    I have a section about SEO here that may help....

    http://www.iwebformusicians.com/SearchEngines/SEO.html

    There's also a topic in the '09 forum that will explain a lot if you ignore the one post that suggests you go to another, totally irrelevant one.

    http://discussions.apple.com/thread.jspa?threadID=1955476&tstart=25

  2. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    Roddy wrote:
    Yes, you need to create and upload a sitemap to your root folder on the server, add your site again in your Google Dashboard and add and verify the sitemap.

    Thanks for the response.

    However, I have not used - and don't know anything about - Google Dashboard.

    Also, this particular site is not in a root folder.

    I have a section about SEO here that may help....

    http://www.iwebformusicians.com/SearchEngines/SEO.html

    thanks. I've actually seen your page and appreciate the wealth of information, but was hoping for more targeted advice.

    If I use the software you advocate, can it get the sitemap to the right subfolder? I would think I would have to manually place it (does it allow that) or have I completely misunderstood what I need to do?

    There's also a topic in the '09 forum that will explain a lot if you ignore the one post that suggests you go to another, totally irrelevant one.

    http://discussions.apple.com/thread.jspa?threadID=1955476&tstart=25

    That is helpful, although I'm still a little confused. Perhaps tomorrow it will be clearer.

    One thing I'm wondering is why I have to tell Google anything. Google can already find my website on its own. Isn't it possible to add something to my website that will direct Google's spider to crawl its pages without having to open a Google account and tinker?

    Thanks again for the help!

  3. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    Sitemap Automator will create the sitemap and save it to a folder but also has a command that will reveal it and you can upload it using FTP.
    Once you have added the sitemap to the sub folder using FTP and you give the correct path to the application it will take over from there.
    There are other ways to create sitemaps but it is kind of tedious if you have to do it a lot.
    Google can find your website but the sitemap guides them through it.
    Google dashboard is fairly easy to use and understand. Just try it out.
    All this stuff is kind of strange at first but you'll soon get the hang of it once you do it a few times.
    I would recommend that you use the trial version of Sitemap Automator to see how easy it is to create a sitemap and, if you have questions, email Paul at Rage Support and he will answer all your questions far better than I can!

  4. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    Roddy wrote:
    Sitemap Automator will create the sitemap and save it to a folder but also has a command that will reveal it and you can upload it using FTP.
    Once you have added the sitemap to the sub folder using FTP and you give the correct path to the application it will take over from there.

    Thanks. Do you know if the program can put it in a subfolder other than the root folder?

    Google can find your website but the sitemap guides them through it.
    Google dashboard is fairly easy to use and understand. Just try it out.

    What if I just make a sitemap and upload to the folder my site is hosted in. Must I also create a Google account and tell Google it's there?

    I read the other thread and Rage site, and most of the information is geared towards people who want to increase their search rankings. I'm not interested in that (some people are blessed with good skin, I'm blessed with good search). Given my sole interest in crawling subpages, is it still necessary to go through the trouble of opening a Google account and doing all that other stuff?

    I would recommend that you use the trial version of Sitemap Automator to see how easy it is to create a sitemap and, if you have questions, email Paul at Rage Support and he will answer all your questions far better than I can!

    What is the nutshell difference between the trial and paid (I presume) version of the program?

    Thanks again for the help, and I will contact Paul if I have additional questions.

    Also - just to understand this - if I created a text box with linked words in it, say, on the bottom of my site, a mirror of Apple's navigation bar - would that be as effective as a site map?

  5. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    You would upload the sitemap to the sub folder and then give the application the path.

    The website - iwebformusicians.com - is built on ten different domain files. Each section is in a sub folder inside the root.
    Each one has its own sitemap.
    The path is http://www.website.com/subfoldername/

    Upload your sitemap and enter its URL in the browser to test this out...

    http://www.website.com/subfoldername/sitemap.xml

    You have to tell Google the path to the sitemap by adding in your Google account. Otherwise the spiders don't know of its existence.

    As you probably know, the spiders need to crawl your text and find keywords so that they can decide on the relevance of your page to any particular search. They need the sitemap to do this.

    I can't remember what the trial version does. I have been using the application since it came out. You would need to try it or ask Paul.

    A text box with links is just the same as having your own custom built navigation which you should consider doing anyway to replace the default one. The spiders still need the map to find it!

  6. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    Roddy wrote:
    You would upload the sitemap to the sub folder and then give the application the path.

    The website - iwebformusicians.com - is built on ten different domain files. Each section is in a sub folder inside the root.
    Each one has its own sitemap.
    The path is http://www.website.com/subfoldername/

    Upload your sitemap and enter its URL in the browser to test this out...

    http://www.website.com/subfoldername/sitemap.xml

    You have to tell Google the path to the sitemap by adding in your Google account. Otherwise the spiders don't know of its existence.

    Thanks - lots of helpful information if I go this route.

    One question: is the sitemap visible to other search engines, or do they need to be told of it as well?

    As you probably know, the spiders need to crawl your text and find keywords so that they can decide on the relevance of your page to any particular search. They need the sitemap to do this.

    I don't believe the site I have that was built by pros has a sitemap, and Google spiders are able to craw around and figure out what's there. It could be that a sitemap helps Google do its thing, but without a sitemap, as long as a Google spider can jump to a linked page (e.g. with traditional navigation), won't it be able to catalog it just the same?

    I can't remember what the trial version does. I have been using the application since it came out. You would need to try it or ask Paul.

    Thanks - I will contact him if I have further questions about his software.

    A text box with links is just the same as having your own custom built navigation which you should consider doing anyway to replace the default one. The spiders still need the map to find it!

    See - that's what I'm now wondering about.

    If I make a text box with links on my page, in addition to iWeb's built in "invisible" navigation bar, shouldn't that be enough? If I decide to build this text box of navigation, won't that direct Google spiders to other pages on my site, and then to any additional links sprouting up on any additional pages? Isn't that what spiders do?

    I'm trying to avoid the hassle with dealing with Google Dashboard and whatnot. Unless there's a compelling reason to open up a Google account and use it, why bother? I don't need any help with Google finding my homepage. Therefore, if I provide a homemade navigation bar (I know I originally said I'd like to avoid this, but given the options, it may be easier and simpler than a sitemap), is there then any advantage to having a sitemap?

    Also - a quick follow up to that is that if having a homemade text box navigation bar is sufficient, would it be enough to have it on the home page, or is there any additional advantage (i.e. assistance to Google's creepy crawly things) to replicate it on additional pages throughout the site?

    Again, thanks!

  7. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    Sitemap Automator notifies Google, Yahoo, Ask.com and MSN.
    My server allows me to notify a bunch of others.

    You can find out if your "professional" site has a sitemap by entering the URL in your browser.

    Hidden text is looked upon as spamming and can get you kicked out of Google. If that happens, its not so easy to get back!

  8. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    Roddy wrote:
    You can find out if your "professional" site has a sitemap by entering the URL in your browser.

    I add /sitemap.xml and /sitemap after the URL of my "professional" website and get nothing - "This Page Cannot Be Found." Therefore, unless there's some other way to test for a sitemap, I don't believe they've implemented one. And yet, if I google a keyword on any of my subpages, it pops up as a top search result. That's what I don't want to loose via iWeb. I'm guessing with more traditional site navigation, Google's spiders have crawled through my professionally-made site and catalogued its content.

    Hidden text is looked upon as spamming and can get you kicked out of Google. If that happens, its not so easy to get back!

    Not talking about hidden text, my friend. I'm relinquishing my resistance to adding homemade navigation if it emancipates me from Google minutiae. I'm suggesting I would make make my own, small, visible navigation bar placed on the bottom of my homepage (and additional pages if it's suggested that it would be good to do that as well) supplementing iWeb's baked-in nav bar that lords over the site at the top.

  9. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    MattiMattMatt wrote:
    I'm relinquishing my resistance to adding homemade navigation if it emancipates me from Google minutiae.

    You may also want to consider relinquishing iWeb in favor of Sandvox Pro — I haven't tried it, but it has the ability to adjust content for search engines on a page-by-page basis. By filling in new fields in the "Page Details" area on a Sandvox document, Sandvox users can indicate exactly how they want their title and short description to appear in search engine listings. See also their screencast:

    _Using Google Webmaster Tools and Google Sitemap_

    ...iWeb '09 would have benefitted from this kind of integration.

     ~ Alancito

  10. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    A navigation bar at the bottom of pages is a good idea if you don't have "next page" buttons.

  11. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    iWeb would benefit from a lot of the user suggested improvements that the development team have completely ignored.

  12. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    Hi,

    In addition to what Roddy suggested I can provide you with some additional information as one of the developers of Sitemap Automator;

    1) A text based navigation bar at the bottom of your page is a very good idea. The text you use to link to each page is important as Google will use it rank your website, so I suggest you link to your most important pages using consistent anchor text (anchor text is the clickable text that links to other pages).

    Without an XML sitemap it is certainly possible to have all your pages indexed by search engines. XML Sitemaps were invented for websites built using FLASH, hard to index javascript (like iWeb sites), complex frames, forms etc... to help search engines find all content. However, they provide many more benefits which I will describe in more detail below.

    To answer some of your questions;
    1) You will have to notify each search engine individually (Yahoo, MSN, Ask.com and Google are the search engines that support XML Sitemaps). Sitemap Automator does this for you.

    2) Your sitemap needs to be in your root directory (under certain circumstances it doesn't have to be, but generally this is the case). Sitemap Automator puts it there for you.

    3) The trial version of Sitemap Automator limits the number of links you can include in your sitemap and does not allow you to notify all search engines about it.

    *Advantages of an XML Sitemap*
    1) As you said, a sitemap will let you make sure that search engines know about your website without you having to change your site

    2) In general, your homepage is considered your most important page. As well, generally speaking, the less amount of clicks it takes to get to each page on your site, the more important that page is considered to search engines. With iWeb, since your navigation bar won't register as a link to search engines, these pages won't get the "credibility" they deserve.

    An XML Sitemap lets you specify exactly which pages are your most important and which are your least important. This gives you somewhat control over which pages may show up in a search engines results page.

    3) An XML Sitemap lets you specify how often a page is update so search engines know when they should come back and look for new content on your site in order to update their databases.

    4) When you have a Google Webmaster Tools account you get a wealth of information about your website including;

    a) reasons why certain pages may not be able to be indexed by search engines

    b) The top search keywords that your website appears for AND the top searched keywords that send you traffic to your site (including recent trends)

    c) Who links to your site and what anchor text they use (anchor text is important for search engines to help rank your website for certain keywords)

    d) Lots more... I highly suggest you create a Google Webmaster Tools account because of all the interesting info you get

    *Some Additional SEO Advice*

    You shouldn't just stop at having your website indexed by Google or other search engines. You want to build your site so it has the best possible chance of ranking at the top of search results for keywords related to your website..

    An XML Sitemap file, a good internal link strategy, getting other sites to link to your site, and placing important keywords in the right place will help you do this.

    If you provide a link to your website, I would be happy to provide specific advice for you.

  13. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    Alancito wrote:

    MattiMattMatt wrote:
    I'm relinquishing my resistance to adding homemade navigation if it emancipates me from Google minutiae.

    You may also want to consider relinquishing iWeb in favor of Sandvox Pro — I haven't tried it, but it has the ability to adjust content for search engines on a page-by-page basis. By filling in new fields in the "Page Details" area on a Sandvox document, Sandvox users can indicate exactly how they want their title and short description to appear in search engine listings.

    Thanks. I looked at the site and it had helpful information. However, as a n00b, I'm more comfortable staying with iWeb, warts and all, for the time being. I do agree with Roddy that it'd be nice if some of the features in Sandvox were available in iWeb.

  14. 0

    Apple Support Community member

    Imported from the Apple Support Forums via the Wayback Machine 🔗

    ragesw wrote:
    In addition to what Roddy suggested I can provide you with some additional information as one of the developers of Sitemap Automator;

    Thanks for all your feedback and advice.

    1) A text based navigation bar at the bottom of your page is a very good idea. The text you use to link to each page is important as Google will use it rank your website, so I suggest you link to your most important pages using consistent anchor text (anchor text is the clickable text that links to other pages).

    Is there an advantage to bringing the nav bar to every page, or doesn't it make a difference? Also, I would imagine most nav text is generic, e.g. "contact us" although some is obviously unique, e.g. "iWeb_09"

    Without an XML sitemap it is certainly possible to have all your pages indexed by search engines. XML Sitemaps were invented for websites built using FLASH, hard to index javascript (like iWeb sites), complex frames, forms etc... to help search engines find all content. However, they provide many more benefits which I will describe in more detail below.

    I appreciate all the sitemap benefits you enumerate. In fact, I'm pretty much convinced and figure I'll build one eventually! However, to answer my original question directly and unambiguously, I take it from your response that:

    THERE IS NO ADVANTAGE WHATSOEVER IN USING A SITEMAP OVER TRADITIONAL HTML PAGE LINK NAVIGATION IN HELPING A SEARCH ENGINE FIND AND CATALOG CONTENT ON NON-HOMEPAGES.

    Again, I believe I understand all the other benefits of sitemaps. But, as I understand it, if you include text links to your other pages, search engines will find them every bit as much as if you use a sitemap.

    2) Your sitemap needs to be in your root directory (under certain circumstances it doesn't have to be, but generally this is the case). Sitemap Automator puts it there for you.

    What if you have a hosting account with different sites in subfolders off of your root folder?

    3) The trial version of Sitemap Automator limits the number of links you can include in your sitemap and does not allow you to notify all search engines about it.

    How many links and search engines does the trial software allow?

    *Advantages of an XML Sitemap*
    1) As you said, a sitemap will let you make sure that search engines know about your website without you having to change your site

    I'm not sure what that means. Search engines know about my site even if I don't change it.

    4) When you have a Google Webmaster Tools account you get a wealth of information about your website including;

    a) reasons why certain pages may not be able to be indexed by search engines

    b) The top search keywords that your website appears for AND the top searched keywords that send you traffic to your site (including recent trends)

    c) Who links to your site and what anchor text they use (anchor text is important for search engines to help rank your website for certain keywords)

    d) Lots more... I highly suggest you create a Google Webmaster Tools account because of all the interesting info you get

    Those are compelling reasons.

    If you provide a link to your website, I would be happy to provide specific advice for you.

    Thanks! However, regarding specific advice, I'd feel more comfortable contacting you privately.

    (also: apologies to you and everyone else who offered helpful advice. I wanted to mark all the responses as helpful, but apparently Apple's forum software only lets me identify a max of 2 comments as helpful!)