Valhalla Legends Archive

Programming => Web Development => Topic started by: RhiNo on July 25, 2003, 06:32 AM

Title: site submission?
Post by: RhiNo on July 25, 2003, 06:32 AM
Can anyone please help me by telling me how to get my site listed on google and yahoo.  I noticed vL has thiers on google so i figured someone here would know so thanx for the help if anyone knows.
Title: Re:site submission?
Post by: WinSocks on July 25, 2003, 08:26 AM
i think i saw src in vb to upload your url to google,
at http://www.planet-source-code.com

under Internet/html section, i think like 7th-8th page in ,mabey  ::)

[added]
here is the exact url fo rit, mabey this will help you...
http://www.planet-source-code.com/vb/scripts/ShowCode.asp?txtCodeId=38676&lngWId=1
Title: Re:site submission?
Post by: Spht on July 25, 2003, 08:48 AM
Quote from: LoRD`NiKKoN on July 25, 2003, 08:26 AM
i think i saw src in vb to upload your url to google,
at http://www.planet-source-code.com

under Internet/html section, i think like 7th-8th page in ,mabey  ::)

[added]
here is the exact url fo rit, mabey this will help you...
http://www.planet-source-code.com/vb/scripts/ShowCode.asp?txtCodeId=38676&lngWId=1

Or just go here: http://www.google.com/addurl.html
Since that's all the program is really doing.
Title: Re:site submission?
Post by: RhiNo on July 25, 2003, 03:30 PM
Thanx much guys. btw my website is
Quotecensored
we sell custom built computers, server, rackmounts, and work stations

Edit: [Grok] Don't advertise on our forum.
Title: Re:site submission?
Post by: j0k3r on July 26, 2003, 04:23 PM
It's in his sig too.
Title: Re:site submission?
Post by: drake on July 26, 2003, 08:26 PM
Actually Google is such a huge search engine and its spiders/robots are so advanced that usually within less then a week of your website's existence, its already found it and added it to its database. I never submit to searchs yet all my sites just get added. Thats why searchs engines work so well for illegal sites, cause they are meant to actually search the net without you have to submit them anything. Submitting just speeds up the process.
Title: Re:site submission?
Post by: Noodlez on July 28, 2003, 04:31 AM
how exactly do spiders work? does it check a database of newly registered domains? if so... how does it find geocitie sites and such which are hosted on existing domains
Title: Re:site submission?
Post by: WinSocks on July 28, 2003, 08:01 AM
spiders from what i understand not very much of, but from what i heard, they just ping random sites fitting the specific specs of the current search query it's undergoing, and if it meets the standards for be submitteted into thier index or database for their searchengine. Once verified to be submitted it send the <url, Keywords, Description> to the Robot that filters out unwanted sites to be submitted, but it mainly searches for Meta Tags in a html/php documents..
i.e

<Meta name="LoRD`NiKKoN" content="Author">
<Meta name="2003 &copy; ViaL<>NeT" content="CopyRight">
<Meta name="This Site is the Best!" content="Description"> <----
<Meta name="Blah, Blah, Blah, Blah" content="KeyWords"> <----- The one aboev and this one are the ones mainly looked at


Once it's done the query and filtering of all the urls with unwanted keywords, like Warez, Porn, XXX, Sex, Marijuana, Cop Killing, or anything else thats on the filter list, will not be added to the submitted list.

Well thats all i know about them. If i'm incorrect please correct me....

I supposivly going to be developing one for my vb project, so once i start that up i would be more of help :\
Title: Re:site submission?
Post by: Adron on July 28, 2003, 12:17 PM
The basic function of a spider is to follow links. Picking random places to visit won't work very well.
Title: Re:site submission?
Post by: Spht on July 28, 2003, 12:46 PM
Quote from: Noodlez on July 28, 2003, 04:31 AM
how exactly do spiders work? does it check a database of newly registered domains? if so... how does it find geocitie sites and such which are hosted on existing domains

Well, I can not say in general how spiders/crawlers work. I have had discussions about Google's crawler ("GoogleBot"), however. Google has a period during each month when its server updates its database of back-links and page ranking (sorting). This process lasts from about 3 to 5 days and is performed by GoogleBot.

When it finds a new web site (from following links found on pages it knows), it will visit the page every couple of days checking for content changes. For pages that don't appear to be updating, it will no longer be so up-to-date on its listings of the web site. If the targetted web site appears to be constantly updating, GoogleBot will continue to visit it and update its records on a daily basis.

So if there's a known web page to Google which is updated often, a link could be placed on that web site to a new web page, and it could be within a couple days for Google to know of the new web site and list it on its directories.
Title: Re:site submission?
Post by: Adron on July 28, 2003, 01:01 PM
So, basically spiders crawl the web. If you're not part of the web, you won't be automagically found.
Title: Re:site submission?
Post by: RhiNo on July 28, 2003, 01:33 PM
so i should find a few people on google and link to them and get them to link to me so "googlebot" finds my site?
Title: Re:site submission?
Post by: Douglife on July 28, 2003, 01:40 PM
Quote Posted by: RhiNo  
Posted on: Today at 01:33:30pm  
so i should find a few people on google and link to them and get them to link to me so "googlebot" finds my site?  

Rhino: no, what you need to do is to use the google link provided earlier in this posting and add yourself, then continue to update your page more than once a week, more action will allow you to be noticed and move up in the chain of weblinks.
Title: Re:site submission?
Post by: Spht on July 28, 2003, 01:41 PM
Quote from: Douglife on July 28, 2003, 01:40 PM
Quote Posted by: RhiNo  
Posted on: Today at 01:33:30pm  
so i should find a few people on google and link to them and get them to link to me so "googlebot" finds my site?  

Rhino: no, what you need to do is to use the google link provided earlier in this posting and add yourself, then continue to update your page more than once a week, more action will allow you to be noticed and move up in the chain of weblinks.


Both are possible solutions. Google found the BotDev web site from other listing pages which linked to it.
Title: Re:site submission?
Post by: Adron on July 28, 2003, 03:51 PM
Do you actually *know* that? Isn't it possible that some random visitor entered it into google's submission page?
Title: Re:site submission?
Post by: drake on July 29, 2003, 03:15 AM
Well I can tell you that my spider worked like described by one of the people up above.

I developed a spider that when given a URL, it would go to it and index it into a database based upon information from within the HTML then it would grab all the links in that HTML and do the same with those pages.

The thing about spiders is that they quickly take on a lot of pages at once and start consuming a lot of bandwidth and processing time. So basically don't actually try to create your own search engine unless you actually have the hardware and connection to run a bot that can scour the web.
Title: Re:site submission?
Post by: WinSocks on July 29, 2003, 12:12 PM
Well there are different styles of Spiders or SearchBots thats are in use, they all have unique ways of performing their "crawling methods". So really they mostly don't act the same when adding links to thier DB. Yahoo uses a Index database, so you have to submit your link, they won't find it for you... Lazy Bastards :P
Title: Re:site submission?
Post by: drake on July 29, 2003, 03:49 PM
couldn't of said it better myself.
Title: Re:site submission?
Post by: Forged on September 03, 2003, 09:04 PM
I didnt submit my site but it comes up on yahoo and google, but then again one of my vistors could have done it.
Title: Re:site submission?
Post by: Camel on September 04, 2003, 02:54 PM
Why do people post in topics months after they've died?
Title: Re:site submission?
Post by: Adron on September 04, 2003, 03:02 PM
Maybe they just don't check the dates - they come here, they're bored, they read posts, and finally see something that clicks, where they can post. And of course they do.
Title: Re:site submission?
Post by: Forged on September 04, 2003, 06:11 PM
sorry I wasnt paying attention and this was a first page topic I didnt think it was that old.
Title: Re:site submission?
Post by: j0k3r on September 04, 2003, 09:16 PM
Quote from: Camel on September 04, 2003, 02:54 PM
Why do people post in topics months after they've died?

First post is July 25th... It hasn't even been two months yet so to say it is months dead is obsurd(sp?). I would also hardly consider it dead, it is not locked, but then again the question has been pretty much thoroughly answered.
Title: Re:site submission?
Post by: Adron on September 05, 2003, 04:28 AM
I don't complain that much about this type of discussion topics being brought to life - sometimes after the topic has rested for a month, you'll have new ideas and new input to add to it.
Title: Re:site submission?
Post by: Kp on September 05, 2003, 02:45 PM
Quote from: j0k3r on September 04, 2003, 09:16 PMI would also hardly consider it dead, it is not locked, but then again the question has been pretty much thoroughly answered.
My interpretation, which I think is pretty common, is that a thread is usually dead once it's gone more than a week or so without new input.  Obviously the amount of time before a thread is 'dead' depends a great deal on the frequency with which people check the forum - if people only checked on Sunday evenings, a thread which had been idle since last Sunday would hardly be considered dead. :)

Also, like Adron, I don't see any harm in ressurecting old topics if the new responses are appropriate to the thread.
Title: Re:site submission?
Post by: Adron on September 06, 2003, 07:01 AM
Quote from: Kp on September 05, 2003, 02:45 PM
Also, like Adron, I don't see any harm in ressurecting old topics if the new responses are appropriate to the thread.

The responses should not only be appropriate, but new. That may be included in "appropriate", but sometimes people will resurrect a thread by answering a question from the first post, that has already been answered in exactly the same way by other people. That, I don't like.

It does happen to me too, but I tend to either edit out the redundant answers or delete my post completely once I get to reading the previous answers.