Loading


Advertisement:

Author Topic: Indexing of manual pages in search engines[Solved]  (Read 1163 times)

theinvisible

  • Full Member
  • ***
  • Posts: 207
Indexing of manual pages in search engines[Solved]
« on: December 19, 2016, 11:22:14 am »
How to index the manual pages created using admin dash in search engines? Pages like contact, about etc. I need that pages too indexed in search engines? How can i make that happen with robots.txt?
« Last Edit: January 02, 2017, 04:28:00 pm by theinvisible »

Aficionado

  • Hero Member
  • *****
  • Posts: 4023
  • Good things come to those who wait
Re: Indexing of manual pages in search engines
« Reply #1 on: December 19, 2016, 11:38:46 am »
No need to do anything, if the pages are available from your Osclass website, they will be indexed.

There are not ? It takes some time to get crawled and indexed, depending on your site authority in the eyes of Google.

theinvisible

  • Full Member
  • ***
  • Posts: 207
Re: Indexing of manual pages in search engines
« Reply #2 on: December 21, 2016, 01:07:25 pm »
I don't think so. Because these pages are not there in the sitemaps generated. And i checked it with some private search engine crawler and the pages are not crawled and  indexed in that.

Aficionado

  • Hero Member
  • *****
  • Posts: 4023
  • Good things come to those who wait
Re: Indexing of manual pages in search engines
« Reply #3 on: December 21, 2016, 01:37:23 pm »
I don't think so. Because these pages are not there in the sitemaps generated. And i checked it with some private search engine crawler and the pages are not crawled and  indexed in that.

Sitemaps are not needed for Classifieds because of the nature of ads. Sitemaps could help for deep nested pages that can't easily be found by crawlers.

BUT Osclass manual pages are on home, so nothing to worry about. If they are not indexed, then you have an other problem.

theinvisible

  • Full Member
  • ***
  • Posts: 207
Re: Indexing of manual pages in search engines
« Reply #4 on: December 21, 2016, 02:43:28 pm »
I don't think so. Because these pages are not there in the sitemaps generated. And i checked it with some private search engine crawler and the pages are not crawled and  indexed in that.

Sitemaps are not needed for Classifieds because of the nature of ads. Sitemaps could help for deep nested pages that can't easily be found by crawlers.

BUT Osclass manual pages are on home, so nothing to worry about. If they are not indexed, then you have an other problem.

Can you please check my site? Because i don't find these pages in google search
url is https://goo.gl/QuVrZ2

Aficionado

  • Hero Member
  • *****
  • Posts: 4023
  • Good things come to those who wait
Re: Indexing of manual pages in search engines
« Reply #5 on: December 21, 2016, 03:15:39 pm »
I did. Most of your ads are indexed (some new are not but this is normal). So you are ok.

Your static pages About and Contact for example are not. How old are those pages ?


Aficionado

  • Hero Member
  • *****
  • Posts: 4023
  • Good things come to those who wait
Re: Indexing of manual pages in search engines
« Reply #6 on: December 21, 2016, 03:20:31 pm »
Can anyone PLEASE check the following is he runs a OSclass website ?

Check if About and Contact static (manual) pages are Indexed in google ? How to check ? Hover your site About or Contact, copy the link and paste it in Google search. If the EXACT page is returned then the page IS Indexed.

And let us know pls.

(because MY manual pages are also NOT indexed)
« Last Edit: December 21, 2016, 03:22:29 pm by Aficionado »

SmaRTeY

  • Osclass Hero
  • Hero Member
  • *
  • Posts: 2228
Re: Indexing of manual pages in search engines
« Reply #7 on: December 21, 2016, 03:31:21 pm »
Hi Aficionado,

following your instructions I also do NOT see my contact / about pages on top nor in the other google results.
Interesting issue, will see if I can find a reason....

P.s. I am still on 3.6.1


Regards,
Eric

Aficionado

  • Hero Member
  • *****
  • Posts: 4023
  • Good things come to those who wait
Re: Indexing of manual pages in search engines
« Reply #8 on: December 21, 2016, 03:33:02 pm »
Hi Aficionado,

following your instructions I also do NOT see my contact / about pages on top nor in the other google results.
Interesting issue, will see if I can find a reason....


Regards,
Eric

Hi there Eric !!

Yes this is rather strange, i can't find anything wrong in those pages BUT for some reason they are NOT indexed in all search engines. And i do have some 5600+ indexed ads in Google Webmaster info.

VERY STRANGE !

Aficionado

  • Hero Member
  • *****
  • Posts: 4023
  • Good things come to those who wait
Re: Indexing of manual pages in search engines
« Reply #9 on: December 21, 2016, 03:34:09 pm »
I don't think so. Because these pages are not there in the sitemaps generated. And i checked it with some private search engine crawler and the pages are not crawled and  indexed in that.

Stay tuned, we will solve this.

theinvisible

  • Full Member
  • ***
  • Posts: 207
Re: Indexing of manual pages in search engines
« Reply #10 on: December 21, 2016, 03:55:12 pm »
Hi Aficionado,

following your instructions I also do NOT see my contact / about pages on top nor in the other google results.
Interesting issue, will see if I can find a reason....

P.s. I am still on 3.6.1


Regards,
Eric

You guys don't know this? OMG! I knew about this since a long time. I have search engine crawler php script. When i crawled my site with that i saw my static pages in the statistics but they are omitted from indexing due to rules in robot.txt something like that. I don't remmeber what exactly was, but i'm trying to recrawl it and i will post a screenshot if i get that once again.

Thanks for the support guys

Aficionado

  • Hero Member
  • *****
  • Posts: 4023
  • Good things come to those who wait
Re: Indexing of manual pages in search engines
« Reply #11 on: December 21, 2016, 04:01:19 pm »

You guys don't know this? OMG! I knew about this since a long time. I have search engine crawler php script. When i crawled my site with that i saw my static pages in the statistics but they are omitted from indexing due to rules in robot.txt something like that. I don't remmeber what exactly was, but i'm trying to recrawl it and i will post a screenshot if i get that once again.

Thanks for the support guys

Well, since i saw no errors in my google webmaster account, how should i (we) know ?

I don't think it is a robot.txt issue.
« Last Edit: December 21, 2016, 04:02:54 pm by Aficionado »

theinvisible

  • Full Member
  • ***
  • Posts: 207
Re: Indexing of manual pages in search engines
« Reply #12 on: December 21, 2016, 04:01:49 pm »
I did. Most of your ads are indexed (some new are not but this is normal). So you are ok.

Your static pages About and Contact for example are not. How old are those pages ?

Both pages are 2 years old

theinvisible

  • Full Member
  • ***
  • Posts: 207
Re: Indexing of manual pages in search engines
« Reply #13 on: December 21, 2016, 04:08:53 pm »
I'm attaching a screenshot. check this. Its something with meta tags. Am i right?
« Last Edit: December 21, 2016, 04:12:34 pm by theinvisible »

Aficionado

  • Hero Member
  • *****
  • Posts: 4023
  • Good things come to those who wait
Re: Indexing of manual pages in search engines
« Reply #14 on: December 21, 2016, 04:17:20 pm »
It seems OsclassWizards theme puts

Code: [Select]
<meta name="robots" content="noindex, nofollow, noarchive" />
<meta name="googlebot" content="noindex, nofollow, noarchive" />

in those pages.

Bender also. Why ? It is beyond me.
« Last Edit: December 21, 2016, 04:20:12 pm by Aficionado »