PDA

View Full Version : Sitemap Over 4000 ulrs of Ilance !!!!


esmoof
11-26-2008, 12:53 PM
Hello

Recently I am trying to make a sitemap for my auction I use a software, (sitemap writer Pro) send the spiders to raster the site and I get results from more than 4000 urls! :eek:I had to stop it. How is this possible? :confused:

Peter
11-26-2008, 01:38 PM
4000 urls? Without knowing which urls are being indexed it's really hard to say. But consider your:

- Category Maps x 2 (product/service)
- Search Results x 3 (product/service/experts)
- User Profile Pages x (x members in your marketplace)
- Listing Pages
- Much, I mean much more.

The goal to ILance is to take a bare domain (if it's a new site) and indexed it quickly. The fastest turnaround on google was 7 hours I believe. Meaning a customer had installed ILance on a new domain that never had traffic and was indexed very quickly. So I'd like to know if this is actually a "problem" or if it's a good thing. Again it all depends :)

Do you have any example data to review? Upload as attachment if need be.

Regards,
Peter

esmoof
11-26-2008, 02:54 PM
I made several crawls with spiders, because they had very large urls and it stops. I attach a file .xml to see what with 1200 Approx.

Peter
11-27-2008, 01:14 PM
I will review that file shortly and when I have some information to add I will.

Thanks again for your speedy reply.

-Peter

esmoof
11-28-2008, 05:34 AM
Thanks Peter, I hope your answer to be able to do my sitemap

Peter
11-28-2008, 04:10 PM
Okay so I've reviewed the xml file and it appears to be correct. There is hundreds of combinations to use when you're using the search menu, additionally, when search engines connect they have limited access which prevents them from logging into your site using the login form etc, this is why you see returnurl=xxx and redirecturl=xx... But to be honest, those are all valid urls.

What you could consider doing is using another program to generate your site map and filter it to not index so many urls.. there are options in these products that can help you limit the amount of links if they appear similar .. but if you notice mostly all of those urls are unique in the file.

This is what search engines see. If a user on the google search engine searches for certain keywords that match or is relevent to your index urls in the xml file then you are moving your site in the proper direction.

What is the problem exactly?

Regards,
Peter

esmoof
12-01-2008, 06:19 AM
I like to make SEO in my auction. I think the sitemap it is very important, to get better ranks in search engines. As you know the first thing a robot to reach the site is to search the sitemap for better indexing the page, as it is the first thing they seek. The key words if they are too important, but the robots does not provide information on the structure of the page.
Does the sitemap in this case would have to do it by hand? Because I see that my webstools do not work.