TODAY -
✦

E-Pao! Education :: World Wide Web: A Digital Library

World Wide Web: A Digital Library
By: Sanasam Ranbir Singh *



In the span of a decade, the World Wide Web, in short WWW has grown from a small research project into a vast repository of information and a new medium of communication. Today, many organizations (Governmental, Non-Governmental), Institutions, Business organizations etc., use Web as their information media and Internet has become an indispensable part of day-to-day life. Unlike other great networks of the past century, - such as the electronic power grid, the telephone system, or the highway and rail system, - the Web does not have an engineered architecture. Rather, it is a virtual network of content and hyperlinks with over a billion interlinked “pages” created by the uncoordinated actions of tens of millions of individuals.

WWW can be viewed as a graph, in which each node represents the page and edges connecting the nodes are the hyperlinks. The topology of this graph determines Web’s connectivity and consequently how effectively can we locate information on it. But, its enormous size estimated at least 8x108 documents and rapidly growing poses a big challenge to search related pages for specific topic. Major search engine companies have often claimed that they can keep up with the size of the Web. But, due to its continuous changing of documents, links and rapidly growing nature make it impossible to catalogue all the vertices and edges. The estimated coverage of the web by some search engines is given in table below.

Search EngineCoverage (%)
HotBot57.5
AltaVista46.5
Northern Light32.9
Excite23.1
Infoseek16.5
Lycos4.41


Table 1: Estimated coverage of each search engine (average over 575 queries performed during 15 to 17 December 1997) [10].

Because of the decentralized nature of its growth, the Web has been widely believed to lack of structure and organization as a whole. Analysis of the Web’s network of hyperlinks have revealed an intricate structure that is providing to be valuable for organizing information, improving search methods and understanding the Web in a broader technological and serial context. HITS [2], SALSA[3] are some of the widely used hyperlink structure based algorithms and surprisingly found to provide good results. Many studies like PHITS[4], PageRank[1] etc. are farther studies on HITS. Several studies like spectral filtering[7], HyCon[6] find that combining content and link structure of the web provides better result. Our recent study, confidence based web search[6] finds to provide surprisingly good result by monitoring users’ web page access records. Precise classification of the web pages into categories is a key factor in web indexing that plays a major role to improve web search performance and provide quality pages. LSA (Latent semantic analysis), PLSA (probabilistic LSA), k-nearest neighbor etc. are some of the algorithms used to classify web pages.

A recent study [8] indicates that the Web contains a large, strongly connected core in which every page can reach every other by a path of hyperlinks. This core contains most of the prominent sites on the Web. The remaining pages can be characterized by their relation to the core: Upstream nodes can reach the core but cannot be reached from it, downstream nodes can be reach from the core but cannot reach it and “tendrils” contain nodes that can neither reach the core nor be reached from the core.

Searching for relevant pages of specific topic from this huge library poses a large degree of complexity due to its unstructured and dynamic in nature. Available search engines can be broadly classified into two such as content-based search engine and citation-based search engine based on the mechanisms used. Content-based search engines use only the document content and use them for key word matching operation. Users query topic is used as the keyword and find out the documents containing the keyword in the web. Some of the full text content-based search engines are Lycos (www.lycos.com), Alta Vista (www.altavista.digital.com), Excite (www. Excite.com), HotBot (www.hotbot.com), In-foseek (www.infoseek.com), Northern Light (www.nlsearch.com) etc. Several researches find that content-based search engines often provide poor quality results. Hyperlink structure based search engines use citations as well as content of the pages and provide better results than content-based search engines. Google (www.google.com), clever etc. are some of the hyperlink-based search engines.

There are many issues like extraction of the features from the pages, organizational structure of web, identifying community of pages, crawling the web, large-scale search engine and its architecture, web structure, personalized web search, page ranking methods, optimizing web structure, web indexing etc. which are required for better web mining. Due to good amount of resources for research in Web, many researchers are attracted into this area.

References:
[1] Sergey Brin, Lawrence Page. The anatomy of a large-Scale hypertextual Web search engine. In Proc. 7th Int. World Wide Web Conf., 1998.
[2] J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of ACM (JASM), 46, 1999.
[3] R. Lempel and S. Moran. The stochastic approach for link-structure analysis (SALSA) and the TKC effect. In 9th Int. WWW Conference, Amsterdam, Nrtherlands, May 2000.
[4] D. Cohn and H. Chang. Learning to probabilistically identify authoritative documents. Preprint, 2000.
[5] D. Mukhopadhyay, D. Giri, S. R. Singh. A Confidence Based Methodology to Deduce User Oriented Page Ranking in Searching the Web. Preprint, 2003.
[6] D. Mukhopadhyay, S. R. Singh. HyCon: A Hyperlink and Content based Topic Search Technique. Preprint, 2003.
[7] S. Chakrabarti, B. Dom, R. Kumar, P. Raghavan, S. Rajagopalam, A. Tomkins. Spectral filtering for resource discovery. Preprint, 1998.
[8] Jon Kleinberg, Steve Lawrence. The structure of the Web. In Science Vol. 294, 30 November 2001.
[9] S. Deerwester et. al. Indexing by latent semantic analysis. Journal of the Society for Information Sc. 1990.
[10] Stave Lawrence and C. Lee Gilis. Searching the World Wide Web. Science, Vol.280, 3 April 1998. www.science.com.


Sanasam Ranbir Singh is a scholar at the Dept. Of Comp. Sc. & Engg. Haldia Institute Of Technology, West Bengal, India

* Comments posted by users in this discussion thread and other parts of this site are opinions of the individuals posting them (whose user ID is displayed alongside) and not the views of e-pao.net. We strongly recommend that users exercise responsibility, sensitivity and caution over language while writing your opinions which will be seen and read by other users. Please read a complete Guideline on using comments on this website.




LATEST IN E-PAO.NET
  • Langban Tha Katchaba @Haying #2 : Gallery
  • Violence in Manipur 2023-2026 : Timeline
  • Prof Kamal Mitra Chenoy : Obituary
  • Tale of Ahu, Alang & Apapang: Amur Falcon
  • Consumerism :: Poem
  • Condemns Khamenlok Killings
  • Humble Appeal to All Concerns
  • Envious of the Chief Minister
  • Delivering a powerful point
  • Catholic Valley Schools Sports #1: Gallery
  • When the extraordinary becomes ordinary
  • The Map We Chose :: Poem
  • Dhakeswar Potsangbam : ToI Wellness Award
  • Nigeria calls on world to turn AMR pledges
  • Understanding the pressure students face
  • Training on Mushroom at Khagempali
  • Pointing finger of accusation
  • Digital Revolution & MK Binodini Devi
  • Exploring The Vanishing Self #15
  • Letter From A Lost Crony :: Poem
  • Procedural lapses in dismissal of Dr Bimol
  • Manipur Sanaleibak (The Golden land)
  • Training on Seismic Hazard @MU
  • 2026 edition of Hnahsin Kut
  • Oncology & Neurosurgery OPD launched
  • Yaoshang Thabal Competition #5: Gallery
  • Orchids of Manipur
  • Pharmacists: A misunderstood profession
  • Vision Service Week at Ibotonsana School
  • Drone Tech Bootcamp at NIT Meghalaya
  • Athokpam Krishnakanta : World 2% Scientist
  • No Solution Without Identifying "Kuki"
  • Stands in Solidarity with Prof Bimol
  • Taking the idea of Manipur to Senapati
  • Yumjao Lairembi Haraoba #3: Gallery
  • 'Enoong Ngallamdai' :: Movie Review
  • VanDyke Release: Diplomacy or US pressure
  • Mental Health Awareness at High Court
  • 2026 NAMA Research Grant [Upd]
  • Fermented food for beauty
  • Mizoram Targets 5-7% Tourism Share
  • The hills continue to burn
  • Hearthside Story of Naothingkhong #2
  • Between Delhi Power & Valley's Protagonists
  • The Zeliangrongpui at a crossroad
  • Mushroom Cultivation Training at Konthoujam
  • Break from within :: Poem
  • White Canes to Govt Ideal Blind School
  • Concerned: Conflict - Yimkhiung & Tikhir
  • Mizoram Travel Fest 2026
  • Condolence : Kh Armstrong Charang
  • Turning Imphal into a dumping site
  • Sushila & Bichu @Airport #2: Gallery
  • When prime-time spectacle replaces priorities
  • For a new world organization for peace
  • Intl Day for Disaster Risk Reduction @MTU
  • Solidarity with Professor Angomcha Bimol
  • Intl Day for Disaster Reduction @Wangkhei
  • Condemns Barbaric Killings
  • Schools, roads, power & water supply
  • 'Meeyamgi Khollao Khongchat' #2 : Gallery
  • RIST Talk #76: Gravitational-Wave
  • Breast cancer month, October, 2026
  • Free Screening of "Ishanou"
  • Unlocking potentials of 7 horticultural crops
  • Skies and me :: Poem
  • Eramdam hanna kanbiyu
  • The hills, the SoO camps
  • Mera Chaorel Houba @ Kangla #1 : Gallery
  • China's Mayor Economy
  • My muse :: Poem
  • Condemns Killings & Beheading of Civilian
  • Who doesn't do Vote Chori ?
  • EZE Perfumes Enters Northeast
  • One to one meet with PM
  • Exploring The Vanishing Self #14
  • 61st Hunger Marchers' Day #3 : Gallery
  • Humlennganba, Saka : Eming
  • Two interviews, one empty table
  • A landscape of silence :: Poem
  • NSS Runathon for Peace 2026
  • Gender equality- central to diplomatic leaders
  • Manipuri Calendar for year 2027 : Download
  • Meiteilon not Tibeto-Burman language: Rvw
  • Visit to George Gordon's tomb at Canchipur
  • Anandkumar Naorem: World Top 2% Scientist
  • Protect the hills to protect the valley
  • Call for Papers on Manipuri Pony
  • Ashok Singhal Ji - A Karmayogi
  • Addressing the basics of life
  • 228th Bheigyachandra @Nabadwip #1: Gallery
  • Wildlife Week Celebration at Thanga
  • Evolving women's role in Manipur tourism
  • Where do we go from here ?
  • Training Programme on Mushroom
  • Festival look for Navratras
  • Condolence : Demise of Adino Phizo
  • Significant Delhi invite to 3 leaders
  • Heterogeneous Structure of Meitei Society
  • Concert @ 18th Orange Fest #1: Gallery
  • When water management was Statecraft
  • Who switched off the respect :: Poem
  • All is not yet lost for Manipur
  • Wildlife Conservation: Securing the Future
  • Exam : Post of Under Secretary (Law)
  • Understanding narco-terrorism
  • 1500 Burma Refugees Families in 1968-1973
  • 17th World Bamboo Day : Gallery
  • Land affected families: NH-202 in Ukhrul
  • Training Programme on PCB Repair
  • World Habitat Day 2026
  • AMR survivor & WHO call to protect medicines
  • Cut fuel taxes, not food
  • Creating chaos on roads of Imphal
  • Sushila & Bichu @Airport #1: Gallery
  • Manipuri Pony: Case for Animal Science Univ
  • Hemp plant for sustainable textile & Manipur
  • Flame of the lamp & our cultural sensibility
  • Without you :: Poem
  • Welcomes Lalremsiami, Lalthantluangi
  • On the growing roadside eateries
  • Naga Peace Process: Indo-Naga Talk: Timeline
  • 36 Names: Manipur at the Asian Games
  • Abok Ki Singju to Premiere
  • A vision fragmented by corruption :: Poem
  • Gandhi Ji's 3 monkeys and Manipur
  • AI-powered X-Rays are helping find TB
  • Mizoram Reward Lalremsiami, Lalthantluangi
  • 15 years in power Vs 10 years in power
  • Exploring The Vanishing Self #13
  • US-Manipur Digital Archiving Workshop
  • 8th Cultural/ Freshers' Meet for Rongmei
  • The Same Smoke :: Poem
  • Supriya looks at HYROX World C'ships
  • AI4SEVA Hackathon @IT SEZ, Mantripukhri
  • 38th Foundation Day- NIELIT Imphal #2
  • Heikru Hidongba @Bijoy Govinda : Gallery
  • Manipur's Indigenous Natural Farming System
  • Basic human needs a struggle for Sinakeithei
  • Demise of Pame, Marinmai, Lianvela
  • When I met the pugilist Sarita
  • 38th Foundation Day of NIELIT Imphal #1
  • Mizoram's Anthurium Festival Returns
  • Poll fever seems to be catching up
  • My attempt - Meiteilon is not Tibeto-Burman
  • XXXII National Thang-Ta C'ship concluded
  • One Village One Product: A better alternative
  • When machines can answer, who will judge ?
  • Explain motive- Tronglaobi Terror Attack
  • Merger of 5 elected members of NPP
  • Namghar Unites Assam & Maharashtra
  • Trade and commerce : In a limbo
  • 130th Irawat Anniversary : Gallery
  • Lamyanba Irabot Day at Itanagar
  • Irabot's Ideals Remembered at Mumbai
  • Coffee as a sustainable alternative to poppy
  • Her Godname :: Poem
  • Polyendocrine Metabolic Ovarian Syndrome
  • Rejoinder to NPCC
  • Need to get priorities right
  • Irawat and Meetei National question
  • XXXII National Junior Thang-Ta C'ship
  • World Heart Day 2026: Don't miss a beat
  • Science in everyday life
  • Nature Education Workshop
  • Rejoinder to Dr S C Jamir
  • Daslakshan Mahaparva: Festival of 10 supreme
  • Focus back on SoO camps
  • Raengdai Vs NEROCA : Durand Cup : Gallery
  • October Calendar for Year 2026 : Tools
  • Lebensraum or ethnic cleansing
  • World Alzheimer's Day 2026
  • Sensitization Workshop on POSH
  • Mourns Passing of Aribam Shantimo
  • Lecture on 'Indigenous Knowledge Systems'
  • Rejects allegations by NPCC President
  • The narrative Manipur needs
  • Tour Diaries of Maxwell & Higgins #2
  • Laitonjam Rishikanta @ Asian Bodybuilding
  • First poster of Interlude released
  • In the womb of time :: Poem
  • Running an abnormal State
  • Khunung Eshei & Mukna competitions
  • Conference: Challenge in Sustainable Science
  • Rolling back the highway blockade
  • Exploring The Vanishing Self #12
  • Manipur Mesopotamia Force WWI : Gallery
  • PhD in Manipur : Fund it, Fix it
  • Many Voices, One State: Manipur's dilemma
  • Me and Moon: Both do the night shift : Poem
  • Putting rights: Body autonomy & sexual health
  • Green Tea for beauty
  • Yaoshang Thabal @Khurai #2: Gallery
  • AI = Arangpham Intelligence, the Frankenstein
  • World Pharmacists' Day 2026
  • Tapes of 1979 Film 'Ashroy' Discovered
  • From Pangaea to the unpredictable Earth
  • In a Crooked Room :: Poem
  • Debt recovery should be done, but within law
  • Regionalism : New political flavour
  • Chali-Saba - Kang Ningol Palli #1: Gallery
  • Book Release: Exploring The Vanishing Self
  • The Echo After Forever :: Poem
  • The paradox of Kukiland
  • Dr Wairokpam Yaiphaba : Fulbright Fellowship
  • Essay, Painting & Speech Competitions
  • Manipur : Mixture of opposites
  • Naothingkhong & Pitanga #1: Hearthside Story
  • Meiteilon is still not a Tibeto-Burman language
  • 52nd Foundation Day of AMWJU : Gallery
  • The chokehold on Manipur's potential
  • Another Langban has com :: Poem
  • Ageing needs a gendered human rights
  • Mizoram's 2026 festival season opened
  • Inspect the SoO camps
  • 61st Hunger Marchers' Day #2 : Gallery
  • lEkoLdugi warisiH :: Seireng
  • Can Strong Anti-Racism Law save NE Indians
  • Before Building a Viksit Bharat, Learning
  • Quality planting for Pineapple & Banana
  • Seminar: Career Options in Life Sciences
  • Fitclass Gym Moti Nagar Opens
  • Burning hills of Manipur
  • Culturals @Beating of Retreat #4 : Gallery
  • Justice for 6 Liangmai Nagas #2 : Gallery
  • 17th World Bamboo Day 2026
  • 12th Manipur Legislative Assembly : Gallery
  • The 731, and those who may follow
  • Exploring The Vanishing Self #11
  • Little Flower School, 1973 batch : Gallery
  • Bichu Kharibam: FIH Magic Skill Award
  • Tour Diaries of Maxwell & Higgins #1
  • Ningol Phida - Shumang Leela #2 : Gallery
  • Study: Social Worker on Counselling Practice
  • India-Myanmar boundary : Mistakes of 1967
  • Radio E-pao: 5 new songs updated
  • Chiru Maroi : Scientific Documentation
  • Academic Administration Course @MU
  • To our star Tamo Vicky, Vikram Chongtham
  • Vice President visited Manipur : Gallery
  • Langban Tha Katchaba @Haying #1 : Gallery
  • Hiring @ 4-Star Hotel in Udupi
  • Ibudhou Pakhangba Haraoba #1 : Gallery
  • Protest by Researchers @DM Univ : Gallery
  • Meitei Esei
  • US Ambassador @ CM Mantripukhri : Gallery
  • Chongtham Vikram: Delhi Cannot Explain Away
  • A teacher does not leave when his classroom
  • 'Meeyamgi Khollao Khongchat' #1 : Gallery
  • Candle Light- Chongtham Vikram : Gallery
  • Manipuri Pony Heritage Talk to Students
  • Colonial records: Hill Areas, 1891-1947
  • Joint Resolution: Abrogation of SoO
  • Elimination of Racial Discrimination
  • Justice for 6 Liangmai Nagas #1 : Gallery
  • Manipur Can Simply Be Manipur
  • PhD Admission at Assam University
  • Teachers' Day Celebration : Gallery
  • Census 2027 for Manipur deferred
  • Read Meitei Mayek news in romanized English
  • 24-hour Gen Strike (Sep 1) : Gallery
  • Panthoibi Anoi Khuthek #1 : Gallery
  • 48-hour General Strike by JFD #3 : Gallery
  • The flame of Haipou Jadonang
  • Kang Khichri Chaba #2 : Gallery
  • Relevance of NRC, 1951 for immigrants
  • Featured Front Page Photo 2026 #4: Gallery
  • The King Who Caught a Bird : Konthoupa
  • Meira Rally 'No NRC, No Census' : Gallery
  • 48-hour General Strike by JFD #2 : Gallery
  • 35th Manipuri Language Day, 20 August
  • The chappals we leave behind
  • Search 25 years of e-pao.net
  • Colonial Knowledge Production in NE India #23
  • 360° panoramic view of spots in Manipur
  • Final Merit List : Manipur Civil Services 2022
  • PUCL Tribunal report: A shadow of partiality #3
  • PUCL Tribunal report: A shadow of partiality #2
  • PUCL Tribunal report: A shadow of partiality #1