TODAY -

E-Pao! Education :: World Wide Web: A Digital Library

World Wide Web: A Digital Library
By: Sanasam Ranbir Singh *



In the span of a decade, the World Wide Web, in short WWW has grown from a small research project into a vast repository of information and a new medium of communication. Today, many organizations (Governmental, Non-Governmental), Institutions, Business organizations etc., use Web as their information media and Internet has become an indispensable part of day-to-day life. Unlike other great networks of the past century, - such as the electronic power grid, the telephone system, or the highway and rail system, - the Web does not have an engineered architecture. Rather, it is a virtual network of content and hyperlinks with over a billion interlinked pages created by the uncoordinated actions of tens of millions of individuals.

WWW can be viewed as a graph, in which each node represents the page and edges connecting the nodes are the hyperlinks. The topology of this graph determines Webs connectivity and consequently how effectively can we locate information on it. But, its enormous size estimated at least 8x108 documents and rapidly growing poses a big challenge to search related pages for specific topic. Major search engine companies have often claimed that they can keep up with the size of the Web. But, due to its continuous changing of documents, links and rapidly growing nature make it impossible to catalogue all the vertices and edges. The estimated coverage of the web by some search engines is given in table below.

Search EngineCoverage (%)
HotBot57.5
AltaVista46.5
Northern Light32.9
Excite23.1
Infoseek16.5
Lycos4.41


Table 1: Estimated coverage of each search engine (average over 575 queries performed during 15 to 17 December 1997) [10].

Because of the decentralized nature of its growth, the Web has been widely believed to lack of structure and organization as a whole. Analysis of the Webs network of hyperlinks have revealed an intricate structure that is providing to be valuable for organizing information, improving search methods and understanding the Web in a broader technological and serial context. HITS [2], SALSA[3] are some of the widely used hyperlink structure based algorithms and surprisingly found to provide good results. Many studies like PHITS[4], PageRank[1] etc. are farther studies on HITS. Several studies like spectral filtering[7], HyCon[6] find that combining content and link structure of the web provides better result. Our recent study, confidence based web search[6] finds to provide surprisingly good result by monitoring users web page access records. Precise classification of the web pages into categories is a key factor in web indexing that plays a major role to improve web search performance and provide quality pages. LSA (Latent semantic analysis), PLSA (probabilistic LSA), k-nearest neighbor etc. are some of the algorithms used to classify web pages.

A recent study [8] indicates that the Web contains a large, strongly connected core in which every page can reach every other by a path of hyperlinks. This core contains most of the prominent sites on the Web. The remaining pages can be characterized by their relation to the core: Upstream nodes can reach the core but cannot be reached from it, downstream nodes can be reach from the core but cannot reach it and tendrils contain nodes that can neither reach the core nor be reached from the core.

Searching for relevant pages of specific topic from this huge library poses a large degree of complexity due to its unstructured and dynamic in nature. Available search engines can be broadly classified into two such as content-based search engine and citation-based search engine based on the mechanisms used. Content-based search engines use only the document content and use them for key word matching operation. Users query topic is used as the keyword and find out the documents containing the keyword in the web. Some of the full text content-based search engines are Lycos (www.lycos.com), Alta Vista (www.altavista.digital.com), Excite (www. Excite.com), HotBot (www.hotbot.com), In-foseek (www.infoseek.com), Northern Light (www.nlsearch.com) etc. Several researches find that content-based search engines often provide poor quality results. Hyperlink structure based search engines use citations as well as content of the pages and provide better results than content-based search engines. Google (www.google.com), clever etc. are some of the hyperlink-based search engines.

There are many issues like extraction of the features from the pages, organizational structure of web, identifying community of pages, crawling the web, large-scale search engine and its architecture, web structure, personalized web search, page ranking methods, optimizing web structure, web indexing etc. which are required for better web mining. Due to good amount of resources for research in Web, many researchers are attracted into this area.

References:
[1] Sergey Brin, Lawrence Page. The anatomy of a large-Scale hypertextual Web search engine. In Proc. 7th Int. World Wide Web Conf., 1998.
[2] J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of ACM (JASM), 46, 1999.
[3] R. Lempel and S. Moran. The stochastic approach for link-structure analysis (SALSA) and the TKC effect. In 9th Int. WWW Conference, Amsterdam, Nrtherlands, May 2000.
[4] D. Cohn and H. Chang. Learning to probabilistically identify authoritative documents. Preprint, 2000.
[5] D. Mukhopadhyay, D. Giri, S. R. Singh. A Confidence Based Methodology to Deduce User Oriented Page Ranking in Searching the Web. Preprint, 2003.
[6] D. Mukhopadhyay, S. R. Singh. HyCon: A Hyperlink and Content based Topic Search Technique. Preprint, 2003.
[7] S. Chakrabarti, B. Dom, R. Kumar, P. Raghavan, S. Rajagopalam, A. Tomkins. Spectral filtering for resource discovery. Preprint, 1998.
[8] Jon Kleinberg, Steve Lawrence. The structure of the Web. In Science Vol. 294, 30 November 2001.
[9] S. Deerwester et. al. Indexing by latent semantic analysis. Journal of the Society for Information Sc. 1990.
[10] Stave Lawrence and C. Lee Gilis. Searching the World Wide Web. Science, Vol.280, 3 April 1998. www.science.com.


Sanasam Ranbir Singh is a scholar at the Dept. Of Comp. Sc. & Engg. Haldia Institute Of Technology, West Bengal, India

* Comments posted by users in this discussion thread and other parts of this site are opinions of the individuals posting them (whose user ID is displayed alongside) and not the views of e-pao.net. We strongly recommend that users exercise responsibility, sensitivity and caution over language while writing your opinions which will be seen and read by other users. Please read a complete Guideline on using comments on this website.




LATEST IN E-PAO.NET
  • 24-hour Gen Strike (Sep 1) : Gallery
  • Violence in Manipur 2023-2026 : Timeline
  • JNIMS Paper IV : A roadmap for reform
  • An uncle calloused hand carried Manipur boxer
  • Natural Farming: A New Business Frontier
  • What ails the SoO arrangement
  • LGBI Airport Enhances Landing Safety
  • Taking NRC case to Delhi
  • Panthoibi Anoi Khuthek #1 : Gallery
  • Book on the History of Manipur released
  • Insights of Natural Farming in Day Today Life
  • Training on Mushroom Cultivation
  • Brutality of wars and conflicts
  • 'Govt Accountable for N Teikhang Killings'
  • 20th Charter Nite Celebrated
  • From Naga MLAs to Amit Shah
  • 48-hour General Strike by JFD #3 : Gallery
  • Wungshungmi, Kaduangaipouu : Eming
  • Culturals from Manipur at Delhi Fashion Week
  • Leaders versus politicians
  • The Mask !! :: Poem
  • Indonesian - community-led HIV responses
  • Stand to put census on hold
  • The flame of Haipou Jadonang
  • Kang Khichri Chaba #2 : Gallery
  • Manipur's Peace Begin With Refusal to Hate
  • The Highway of Hope & the Road of Blood
  • Bleeding Mother :: Poem
  • NEET-UG 2026 Pangal Students of Tripura
  • Meghalaya shines: Delhi Fashion Week 2026
  • 'Tell your folks to be human'
  • Exploring The Vanishing Self #8
  • September Calendar for Year 2026 : Tools
  • One Table, Many Tongues
  • Use of Rice Husk on Controlling Insect Pest
  • The First Bus :: Poem
  • Census deferred & NRC begins
  • Flood-Affected Communities in Upper Assam
  • Relevance of NRC, 1951 for immigrants
  • Natural Farming in Ancient Manipur
  • JNIMS Paper III : A case in point
  • National Sports Day 2026 Inaugurated
  • Condemns Killing of 5 Naga Civilians
  • 'Meetei Needs ST protection'
  • Need to go beyond issuing warnings
  • 61st Hunger Marchers' Day #1 : Gallery
  • Featured Front Page Photo 2026 #4: Gallery
  • Plain Flowerpecker sighted in Kasom Khullen
  • A mother's hope :: Poem
  • Condemns Killing of Naga Civilians
  • 1st day of Northeast India Space Workshop
  • Ticket to Hornbill 2026 Announced
  • Guns, guns everywhere in the hills
  • The King Who Caught a Bird : Konthoupa
  • JNIMS Paper II : The anatomy of a disconnect
  • GI-Tagged Natural Farming Could Turn NE
  • Condoles Passing of Huirem Ongbi Ibeni
  • Tree Plantation Drive 1.7 - Koirengei
  • NE Bands at Soundscapes of India
  • Make the JMG Report Public
  • Growing call to update NRC
  • Meira Rally 'No NRC, No Census' : Gallery
  • Day Dreaming of a Vision for a True Change
  • ChipCraft: RTL, IP Integration Course
  • Before the Census, Count the Future :: Poem
  • Khelo India Samvaad in Senapati
  • Induction Programme for Group-A & B Officers
  • Chumoukedima Councillors joined NPF
  • Questions people should raise
  • FC Reangdai Vs TRAU : Durand Cup : Gallery
  • Fast-Growing Tree Species: Link in Farming
  • Manipuri Sahitya Parishad Awards 2026
  • MTU Disaster Risk Reduction Club
  • Meeting with IDPs
  • Imphal-Guwahati Route continue on 3rd Day
  • Ambedkar Medical Aid Scheme Extended
  • 48-hour General Strike by JFD #2 : Gallery
  • Ghosts of Khadawmi: Numbers, Nationhood
  • Why Healthcare must be governed differently
  • Tree Plantation, "Loushangkhong Ningol Van"
  • Shobha Shukla "Justice unbound" : Book Rvw
  • Makeup meltdown during Monsoon
  • Science for Viksit Bharat at IBSD
  • Unresolved questions continue to hang
  • Exploring The Vanishing Self #7
  • Gen Z Rising: Pandora's Box Is Open ?
  • Northeast India Space Workshop 2026
  • Wanglembam Gobin: National Teachers Award
  • Broken heart :: Poem
  • Khemchand's bus & laity
  • Mumbai-Ghy as "Bhupen Hazarika Express"
  • Manipur Expeditionary Force, World War I
  • Waqf Amendment Act: An Analysis
  • 80th Independence Day @ Senapati : Gallery
  • Lanchenba : National record at 52nd Aquatics
  • The petition in Parliamentary democracy
  • Support for Children with Special Needs
  • Cracking down on protesters
  • 135th Patriots' Day @ Thangal Tomb : Gallery
  • India-Myanmar territorial exchange
  • The quiet alienation of living in Manipur
  • Babina wins AHPI Leadership Awards 2026
  • Brazil's favelas are reimagining HIV prevention
  • Foreign funds & responsible civil society
  • Dipholu release postponed
  • Taking the NRC demand to Delhi
  • 48-hour General Strike by JFD #1 : Gallery
  • Most neglected root causes of Manipur crisis
  • If the State moves on Agarwood now
  • The genesis of wars and conflicts :: Poem
  • Support to "No NRC, No Census"
  • The gem of transparent public procurement
  • Understanding the angst of the people
  • 35th Manipuri Language Day, 20 August
  • 'Beating of the Retreat' #2 : Gallery
  • Citizens of Manipur can reverse the downslide
  • Condolence Message : Niketu Iralu
  • Delhi Fashion Week 2026 launched
  • Community-based model transforming HIV
  • Eco-Sustainable 'Pine Home' Project
  • Assembly resolution of 2022: Update NRC
  • 77th Indian Republic Day #5 : Gallery
  • Engagement: SCGJWD Logistics & Transworld
  • 'Toy Gun' Featured in at BISFF 2026
  • India shrinking relationship with neighbours
  • A generation that undervalue experiences
  • Visit to displaced Naga families at Makhan
  • 8th Foundation Day of World Meetei Council
  • Rising call for NRC first, census later
  • 80th Independence Day @ 1st MR : Gallery
  • Durand Cup : Touching the hearts
  • 2nd "Fields of Hope" at Bengaluru
  • The torchbearers of Independent Bharat
  • Working Women : Flight, hope & challenges
  • Time to focus on the hills
  • Abok Ki Singju: A Student Film
  • 80th Independence Day at 1st MR Ground
  • 80th Independence Day at Senapati
  • Peace begins with us :: Poem
  • Delhi Fashion Week 2026 Auditions
  • Reliance Foundation's Scholarships open
  • Remembering the martyrs of 1891
  • NEROCA Vs TRAU: Durand Cup #2 : Gallery
  • Manipur: The best place on earth If we change
  • Why Manipur Needs Special Economic Zone
  • 7-Week Free Cancer Screening
  • Safe Release of 3 Thadou Individuals
  • Cambodia's HIV success
  • Normalcy still a far cry away
  • 135th Patriots' Day @ Hicham : Gallery
  • In Search of Peace in Manipur
  • Manipur: NRC before it will accept Census
  • India-Myanmar border dispute & land swap
  • 135th Patriots' Day at Arunachal
  • What is ABHA ?
  • How to eliminate the smell from home
  • Call to surrender all illegal arms
  • A Brief History of DM College
  • 2026 MaolKeki Memorial Scholarships
  • MU's intervention in Manipur's crisis
  • Hiroshima and Nagasaki revisited
  • Harshit Dhingaun: "Best Bollywood Host"
  • Organ Donation : The gift of life
  • LGBI Airport Advances Water Sustainability
  • Power supply : The rising need
  • Ibudhou Thangjing Haraoba #2 : Gallery
  • MKF Robert Memorial Internship Award
  • Indigenous Peoples Day @Chingmeirong
  • A bodybuilding saga from Ukhrul
  • World Elephant Day 2026
  • Endorsed Rio's letter to Home Minister
  • YAS Employee Association suspends Strike
  • Call to enlist Meiteis in ST category
  • Raengdai Vs TRAU - Durand Cup : Gallery
  • Youth Advocacy, Civil Society, & Peacebuilding
  • Panthung (The Last Spring Of Love)
  • The Price of Your Vote :: Poem
  • Manipuri custom into a green movement
  • 'Govt Must Pursue Census Deferment'
  • Flawed convention on violence against women
  • Lying in state since June 10
  • Wakol Laoba : A Philosophical Analysis
  • Moirang Phi: Living fabric of Manipuri Culture
  • 15 Reels- Preservation Digitisation in Italy
  • The Clotted Cream of Desire :: Poem
  • 5th Tree Plantation at Porompat
  • Resilience of Hope :: Poem
  • Handloom: Weaving the future of Viksit Bharat
  • Reaching out to Kangpokpi
  • Exploring The Vanishing Self #5
  • Lifetime Achievement Award for 4 Scientists
  • 13th CM Kang Tournament : Gallery
  • N Tomchou : Gold @ Asian Weightlifting
  • Shards of Home :: Poem
  • Entrepreneurship Development Program
  • Mohan Bhagwat & Gen Z
  • 77th Indian Republic Day #4 : Gallery
  • The chappals we leave behind
  • Takhellambam Rani: National Handloom Award
  • Col M Ranjit's book: Long journey west
  • FNTA (Frontier Nagaland) deal defies logic
  • 54 months to end AIDS and TB
  • Rs 1 crore flood relief drive in Assam
  • Issues and issues before Imphal
  • Mandengbam Jadumani @ Airport : Gallery
  • A consortium of scientific organizations
  • Extortion the Tyrant, Inflation the Demon
  • Hope :: Poem
  • 16th Foundation Day: Meghalaya Film Maker
  • Monsoon foot care
  • Growing call to weed out illegals
  • Naophangpa & the Boy Who Saved Kangla
  • Tingkuradin : Sacred text of Tingkao Ragwang
  • Nurturing Green Minds Youth & Eco Clubs
  • A tribute to Ruskin Bond
  • Ambedkar in Parliamentary ICU :: Poem
  • Cut to community-led service could spark HIV
  • Flood Relief initiative of Rs 21 Lakh
  • The service in healthcare : The human touch
  • Raengdai Vs Navy Durand Cup : Gallery
  • Policy Shift from Jhum to Sustainable Farming
  • Where the Earth Learns to Be Still :: Poem
  • MAGIZH : A homecoming, a legacy
  • Non-notified load shedding or technical issues
  • Japan can teach India on educational reform
  • Rs 21 crores for Assam flood relief
  • Guns going silent since 1997
  • Colonial Knowledge Production in NE India #24
  • Naga Peace Process: Indo-Naga Talk: Timeline
  • Search 25 years of e-pao.net
  • Remembering the Forgotten Army
  • YengjaKhige : Story on friendship released
  • Rani Gaidinliu Girls' Hostel in Pune
  • Exploring The Vanishing Self #4
  • NEROCA Vs TRAU: Durand Cup #1 : Gallery
  • Candle Light Vigil @Kangla : Gallery
  • Zomi Leaders meet CM @Imphal : Gallery
  • Honoring 3 Global Achievers from Manipur
  • NE Book Fair Imphal @Lamphel #1 : Gallery
  • Leinana Yomlibi - A Dynamic Musical Offering
  • Thailand's community-led HIV revolution
  • Mirabai Chanu won a gold medal
  • North East India Fest @ London : Gallery
  • Kang Khichri Chaba #1 : Gallery
  • Products of Artisans from Relief Camps
  • Colonial Knowledge Production in NE India #23
  • 135th Durand Cup: Manipur's football empire
  • 17th Anniv of Rabina & Sanjit: Gallery
  • Kang Chingba @Kakwa, Singjamei : Gallery
  • Posts @ Life Sciences, Manipur Univ
  • A rainy day @ Ima Keithel : Gallery
  • Ahingee Laan @ JNMDA #3 : Gallery
  • Early History of Manipuri Sahitya Parishad #3
  • The Forgotten Kings : A Hearthside Story
  • A gory slaughter :: Poem
  • Kang Chingba @Thangal Keithel : Gallery
  • Kang Chingba @Govindajee Temple : Gallery
  • 63rd Mr Manipur @ MU #5 : Gallery
  • Seasonal Fishes @Ima Keithel #3: Gallery
  • Solo Dance: Wahengbam Debina #2: Gallery
  • Yumjao Lairembi Haraoba #2 : Gallery
  • 63rd Mr Manipur @ MU #4 : Gallery
  • Day 3 : Yaoshang Sports : Gallery
  • Sillam Sintha Jagoi @ATINGA : Gallery
  • 360° panoramic view of spots in Manipur
  • ANSAM Rally demanding justice : Gallery
  • 25th The Great June Uprising #2 : Gallery
  • Candle Light Vigil @ New Checkon : Gallery
  • Massacres perpetrated by Kukis during British
  • Remains of 6 Naga hostages @JNIMS: Gallery
  • Tronglaobi: 2 children laid to rest : Gallery
  • Final Merit List : Manipur Civil Services 2022
  • PUCL Tribunal report: A shadow of partiality #3
  • PUCL Tribunal report: A shadow of partiality #2
  • PUCL Tribunal report: A shadow of partiality #1