Conversation Engine Thoughts
December 30th, 2004
Diego has been writing about a project of his the “Conversation Engine”. I thought I would add a few thoughts to the fray that might help.
For discovery a simple RPC-Ping can be used, this can then add that site onto the spidering queue. To maintain the small scale test of the engine to begin with a whitelist of sites that are allowed to ping. Each page should be spidered multiple times over time to take advantage of trackback and pings. This could be coupled with trying to take the date/time out of the published posts. This may be a little difficult but still possible.