• Welcome to Valhalla Legends Archive.
 

site submission?

Started by RhiNo, July 25, 2003, 06:32 AM

Previous topic - Next topic

drake

Well I can tell you that my spider worked like described by one of the people up above.

I developed a spider that when given a URL, it would go to it and index it into a database based upon information from within the HTML then it would grab all the links in that HTML and do the same with those pages.

The thing about spiders is that they quickly take on a lot of pages at once and start consuming a lot of bandwidth and processing time. So basically don't actually try to create your own search engine unless you actually have the hardware and connection to run a bot that can scour the web.

WinSocks

Well there are different styles of Spiders or SearchBots thats are in use, they all have unique ways of performing their "crawling methods". So really they mostly don't act the same when adding links to thier DB. Yahoo uses a Index database, so you have to submit your link, they won't find it for you... Lazy Bastards :P

drake

couldn't of said it better myself.

Forged

I didnt submit my site but it comes up on yahoo and google, but then again one of my vistors could have done it.
QuoteI wish my grass was Goth so it would cut itself

Camel

Why do people post in topics months after they've died?

Adron

Maybe they just don't check the dates - they come here, they're bored, they read posts, and finally see something that clicks, where they can post. And of course they do.

Forged

sorry I wasnt paying attention and this was a first page topic I didnt think it was that old.
QuoteI wish my grass was Goth so it would cut itself

j0k3r

Quote from: Camel on September 04, 2003, 02:54 PM
Why do people post in topics months after they've died?

First post is July 25th... It hasn't even been two months yet so to say it is months dead is obsurd(sp?). I would also hardly consider it dead, it is not locked, but then again the question has been pretty much thoroughly answered.
QuoteAnyone attempting to generate random numbers by deterministic means is, of course, living in a state of sin
John Vo

Adron

I don't complain that much about this type of discussion topics being brought to life - sometimes after the topic has rested for a month, you'll have new ideas and new input to add to it.

Kp

Quote from: j0k3r on September 04, 2003, 09:16 PMI would also hardly consider it dead, it is not locked, but then again the question has been pretty much thoroughly answered.
My interpretation, which I think is pretty common, is that a thread is usually dead once it's gone more than a week or so without new input.  Obviously the amount of time before a thread is 'dead' depends a great deal on the frequency with which people check the forum - if people only checked on Sunday evenings, a thread which had been idle since last Sunday would hardly be considered dead. :)

Also, like Adron, I don't see any harm in ressurecting old topics if the new responses are appropriate to the thread.
[19:20:23] (BotNet) <[vL]Kp> Any idiot can make a bot with CSB, and many do!

Adron

Quote from: Kp on September 05, 2003, 02:45 PM
Also, like Adron, I don't see any harm in ressurecting old topics if the new responses are appropriate to the thread.

The responses should not only be appropriate, but new. That may be included in "appropriate", but sometimes people will resurrect a thread by answering a question from the first post, that has already been answered in exactly the same way by other people. That, I don't like.

It does happen to me too, but I tend to either edit out the redundant answers or delete my post completely once I get to reading the previous answers.