1. David Hawking , Web Search Engines: Part 1 and Part 2 IEEE Computer, June 2006.
Very nice, simple articles providing an overview to web searching here ... In the first part, I was interested in mechanics of crawling. It all makes sense given the size of the web. I am particularly pleased by the idea of "politeness" because ... well ... it's just nice to be polite. Part II discusses many of the details behind indexing. Even in this simplified form, the intricacies of indexing appear really tedious. Again the amount of tools needed to harness the web is large, but not surprisingly so.
2. Shreeves, S. L., Habing, T. O., Hagedorn, K., & Young, J. A. (2005). Current developments and future trends for the OAI protocol for metadata harvesting. Library Trends, 53(4), 576-589.
Although this article is a few years old, it seems that I would be hesitant to begin adopting the OAI protocols until the dust settles. As the authors point out, there seem to be (big, in my opinion) gaps in the registry. I am interested to find out what's happened in the three years since this publication.
3. MICHAEL K. BERGMAN, “The Deep Web: Surfacing Hidden Value”
Bergman's seafaring analogy for the deep web conjures images of The Abyss and makes this vast amount of information an undiscovered territory. His investigation into what constitutes a "deep web" site is equally fascinating - and somewhat alarming. His observation of the increasing growth of the "deep web" make me wonder how web searching will change to accommodate this growth.
Subscribe to:
Post Comments (Atom)
Posts
2 comments:
i was also heartened to learn that web crawlers take manners into account.
I find it interesting that human terms are used to define machine instructions such as politeness.
The OAI protocols brought to mind the real need for standards. Its seems to me that the deep web would become more searchable with agreed upon, universally accepted standards.
Post a Comment