TODAY -

E-Pao! Education :: World Wide Web: A Digital Library

World Wide Web: A Digital Library
By: Sanasam Ranbir Singh *



In the span of a decade, the World Wide Web, in short WWW has grown from a small research project into a vast repository of information and a new medium of communication. Today, many organizations (Governmental, Non-Governmental), Institutions, Business organizations etc., use Web as their information media and Internet has become an indispensable part of day-to-day life. Unlike other great networks of the past century, - such as the electronic power grid, the telephone system, or the highway and rail system, - the Web does not have an engineered architecture. Rather, it is a virtual network of content and hyperlinks with over a billion interlinked “pages” created by the uncoordinated actions of tens of millions of individuals.

WWW can be viewed as a graph, in which each node represents the page and edges connecting the nodes are the hyperlinks. The topology of this graph determines Web’s connectivity and consequently how effectively can we locate information on it. But, its enormous size estimated at least 8x108 documents and rapidly growing poses a big challenge to search related pages for specific topic. Major search engine companies have often claimed that they can keep up with the size of the Web. But, due to its continuous changing of documents, links and rapidly growing nature make it impossible to catalogue all the vertices and edges. The estimated coverage of the web by some search engines is given in table below.

Search EngineCoverage (%)
HotBot57.5
AltaVista46.5
Northern Light32.9
Excite23.1
Infoseek16.5
Lycos4.41


Table 1: Estimated coverage of each search engine (average over 575 queries performed during 15 to 17 December 1997) [10].

Because of the decentralized nature of its growth, the Web has been widely believed to lack of structure and organization as a whole. Analysis of the Web’s network of hyperlinks have revealed an intricate structure that is providing to be valuable for organizing information, improving search methods and understanding the Web in a broader technological and serial context. HITS [2], SALSA[3] are some of the widely used hyperlink structure based algorithms and surprisingly found to provide good results. Many studies like PHITS[4], PageRank[1] etc. are farther studies on HITS. Several studies like spectral filtering[7], HyCon[6] find that combining content and link structure of the web provides better result. Our recent study, confidence based web search[6] finds to provide surprisingly good result by monitoring users’ web page access records. Precise classification of the web pages into categories is a key factor in web indexing that plays a major role to improve web search performance and provide quality pages. LSA (Latent semantic analysis), PLSA (probabilistic LSA), k-nearest neighbor etc. are some of the algorithms used to classify web pages.

A recent study [8] indicates that the Web contains a large, strongly connected core in which every page can reach every other by a path of hyperlinks. This core contains most of the prominent sites on the Web. The remaining pages can be characterized by their relation to the core: Upstream nodes can reach the core but cannot be reached from it, downstream nodes can be reach from the core but cannot reach it and “tendrils” contain nodes that can neither reach the core nor be reached from the core.

Searching for relevant pages of specific topic from this huge library poses a large degree of complexity due to its unstructured and dynamic in nature. Available search engines can be broadly classified into two such as content-based search engine and citation-based search engine based on the mechanisms used. Content-based search engines use only the document content and use them for key word matching operation. Users query topic is used as the keyword and find out the documents containing the keyword in the web. Some of the full text content-based search engines are Lycos (www.lycos.com), Alta Vista (www.altavista.digital.com), Excite (www. Excite.com), HotBot (www.hotbot.com), In-foseek (www.infoseek.com), Northern Light (www.nlsearch.com) etc. Several researches find that content-based search engines often provide poor quality results. Hyperlink structure based search engines use citations as well as content of the pages and provide better results than content-based search engines. Google (www.google.com), clever etc. are some of the hyperlink-based search engines.

There are many issues like extraction of the features from the pages, organizational structure of web, identifying community of pages, crawling the web, large-scale search engine and its architecture, web structure, personalized web search, page ranking methods, optimizing web structure, web indexing etc. which are required for better web mining. Due to good amount of resources for research in Web, many researchers are attracted into this area.

References:
[1] Sergey Brin, Lawrence Page. The anatomy of a large-Scale hypertextual Web search engine. In Proc. 7th Int. World Wide Web Conf., 1998.
[2] J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of ACM (JASM), 46, 1999.
[3] R. Lempel and S. Moran. The stochastic approach for link-structure analysis (SALSA) and the TKC effect. In 9th Int. WWW Conference, Amsterdam, Nrtherlands, May 2000.
[4] D. Cohn and H. Chang. Learning to probabilistically identify authoritative documents. Preprint, 2000.
[5] D. Mukhopadhyay, D. Giri, S. R. Singh. A Confidence Based Methodology to Deduce User Oriented Page Ranking in Searching the Web. Preprint, 2003.
[6] D. Mukhopadhyay, S. R. Singh. HyCon: A Hyperlink and Content based Topic Search Technique. Preprint, 2003.
[7] S. Chakrabarti, B. Dom, R. Kumar, P. Raghavan, S. Rajagopalam, A. Tomkins. Spectral filtering for resource discovery. Preprint, 1998.
[8] Jon Kleinberg, Steve Lawrence. The structure of the Web. In Science Vol. 294, 30 November 2001.
[9] S. Deerwester et. al. Indexing by latent semantic analysis. Journal of the Society for Information Sc. 1990.
[10] Stave Lawrence and C. Lee Gilis. Searching the World Wide Web. Science, Vol.280, 3 April 1998. www.science.com.


Sanasam Ranbir Singh is a scholar at the Dept. Of Comp. Sc. & Engg. Haldia Institute Of Technology, West Bengal, India

* Comments posted by users in this discussion thread and other parts of this site are opinions of the individuals posting them (whose user ID is displayed alongside) and not the views of e-pao.net. We strongly recommend that users exercise responsibility, sensitivity and caution over language while writing your opinions which will be seen and read by other users. Please read a complete Guideline on using comments on this website.




LATEST IN E-PAO.NET
  • Colonial Knowledge in NE India #4
  • Violence in Manipur 2023-2025 : Timeline
  • Namphake Monastery @ Dibrugarh : Gallery
  • Fire safety: preventive measures
  • Peculiar plants & incidents unique to Manipur
  • Artificial Intelligence & environment
  • Cutting off the nose to spite the face
  • Relief for daily wagers as shutdown called off
  • Protest @Checkon -AT arrest [Jun 9] : Gallery
  • The question of territorial integrity of Manipur
  • Animal Farm's allegory in dynamics of Manipur
  • Their hands deserve books, not burdens
  • JNV empowers Tamenglong students
  • We can do better- people with HIV live healthy
  • Bandh: The Cry Beneath the Silence :: Poem
  • Cutting short 240 hours general strike
  • Shutdown lifted, curfew eased, mobile ban
  • Protests - AT arrest [Jun 8 night] : Gallery
  • Review of 'Rain Stopping in Manipur'
  • Highway blockades trigger soaring prices
  • Voice of the Masses :: Poem
  • Congress may claim if none
  • Learning new skills related to AI
  • Delhi, Raj Bhavan: Losing the plot ?
  • CBI arrest after Governor clemency assurance
  • Aftermath of flooding @ Khurai #1 : Gallery
  • Amuthoiba, Gaisimpu, Horyaola : eMing
  • Appeals Home Minister not to renew SoO
  • Self-defence :: Poem
  • When will humans learn nature's lessons ?
  • Forgotten voices of drug users in Manipur
  • High-yielding RC Manichakhao-1
  • PC Editorial Blank Space : June 09 2025
  • TSE Editorial Blank Space : June 09 2025
  • Flooding at JNIMS Hospital #2 : Gallery
  • North East NSS Festival @ MU : Gallery
  • Namphakey - A Thai Tradition in Assam
  • Understanding Manipur's recurring floods
  • Constitutional role, professional functions
  • Moscow Wushu C'ship: Manipur - 16 medals
  • The Power of Poppy - 84 :: Poem
  • 27th Meira Paibi Numit : Gallery
  • Micromanager vs Leader
  • Valedictory Function of NE NSS Festival
  • WED at various campuses in Manipur
  • World Environment Day 2025
  • Trump's tariff legacy & its global echo
  • Skin Cycling
  • MU: On reaching a milestone
  • WED observance amid flood crisis
  • Flooding at JNIMS Hospital #1 : Gallery
  • Environment Day @Chingmeirong : Gallery
  • Manipur's unyielding struggle for identity
  • Manipur youth lead the way in organic farming
  • Moscow Wushu : Manipur 2 gold & 16 medals
  • World Environment Day at MTI-HUB
  • World Environment Day at Ukhrul
  • Local actions for a global plastic-free future
  • Raj Bhavan since Feb 13, 2025
  • Time to focus on post-flood activities
  • Colonial Knowledge in NE India #3
  • Manipur is more than a name
  • Manipur Hill Areas Act, 1967 : Download
  • Cervical cancer remains 4th biggest cancer
  • Frontline Lessons of entrepreneurial burnout
  • Till death do us apart :: Poem
  • Pelvic Inflammatory Disease: Hidden enemy
  • The rain from May 28 to Jun 3
  • Resettlement assurance by ministry officials
  • Flooding Imphal East [31 May] #3 : Gallery
  • Strategic erosion of State authority in Manipur
  • Application : Film Appreciation Course
  • H Ranita leads revolution through SMILE
  • Water logging and floods of MLAs
  • NE In-Charge: Shri Sharda Sarvagya Peeth
  • Stand against border fencing
  • Lessons to learn from consecutive flood
  • Flooding Imphal East [31 May] #2 : Gallery
  • Call for permanent solution to recurring Flood
  • Manipur : Champions 25th Natl Wushu C'ship
  • North East NSS Festival 2025 at MU
  • Healing with Art for children at Relief Camps
  • Restricted movement on NH-02 stalls growth
  • The cadence of life :: Poem
  • The other side of the tragedy
  • Fund misuse slur as Imphal faces flood
  • Flooding Imphal East [31 May] #1 : Gallery
  • Precedent Rodent: The new architect of flood
  • Declare flood in Manipur as "State Calamity"
  • Commitment to end tobacco must translate...
  • The World Goes On :: Poem
  • Tracing the arc of tool making
  • Of rain & more rain & flood
  • NE no more immune to natural disasters
  • Sarangthem Nirupama at Miss Universe India
  • S Nirupama @Miss Universe : Gallery
  • Leimapokpam Ranjita: Nightingale Award
  • Dina Oinam transforming "Waste to Wealth"
  • The Power of Poppy - 83 :: Poem
  • Stop Targeting Against Meetei IDPs
  • Urges Action on Flood Negligence
  • Manipur Hill Areas Act, 1967 #4
  • Helpless Meiteis in their own land, Manipur
  • 9 Signs of a Person Who Truly Leads
  • Open Letter to Prime Minister
  • My life journey: Texas - Lone Star State
  • Summer hair masks
  • 'Free movement will take time'
  • Food grain sufficiency amid flood threat
  • Colonial Knowledge in NE India #2
  • June Calendar for Year 2025 : Tools
  • Women entrepreneurs on biodiversity
  • Management: Etymology- academic discipline
  • Quiet Things :: Poem
  • Condemns attack on NE Shopowner in Delhi
  • Shifting goalpost : Emerging political experts
  • Peaceful protest, so far
  • 2nd Emoinu Fish Festival #2 : Gallery
  • INNOTECH Fest 2025 for Manipur Startup
  • Condolence of Prof J V Narlikar at MU
  • Toxic politics of selling addiction to children
  • Citizens pay, officials delay
  • Tripura Esports Championship Season 1
  • Back from Delhi on 'positive' notes
  • Rooting for withdrawal of PR post Gwaltabi
  • Protesters to Raj Bhavan [May 25]: Gallery
  • The silent guardian of Manipur's environment
  • Strengthening Emergency Medicine in Manipur
  • Manipur's fragile truce between identity
  • Manipur Budget 2025-26: Unequal sharing #2
  • NE youths jobseeker in Delhi : Hospitality
  • My mother, Miss World :: Poem
  • A popular Govt: A better option ?
  • Governor skirts protesters, heightens tension
  • Human Chain @Airport road [May 26]: Gallery
  • Sanatan Sammelan in Manipur
  • 'Great Myna' conservation reaping success
  • WMC Manipur Unit AGM held
  • Wabi Sabi: A unique Japanese philosophy
  • Rescind Siang Dam, Arunachal
  • Another round of talk at Delhi
  • COCOMI-MHA meeting amid Gwaltabi
  • Manipur Hill Areas Act, 1967 #3
  • MoU signed between MDB & GPR Law
  • Guide for Job Seekers & Emerging Leaders
  • NERIST & NIELIT Itanagar Sign MoU
  • The Last Step: Celebrating Manipuri Dance
  • Faint Cries :: Poem
  • Reservation: Privilege or Real Justice ?
  • The virus is still very much alive
  • Bitter, sweet moments of Shirui Lily fest
  • Miss Shirui Pageant Contestant: Gallery
  • Meetei Mayek Summer Camp in Kolkata
  • Where hills hum hope, but ground trembles
  • Manipur railway driving growth & connectivity
  • Point-of-care health technologies
  • The Power of Poppy - 82 :: Poem
  • Colonial Knowledge in NE India #1
  • Manipur Budget 2025-26: Unequal sharing #1
  • Edible insects in biodiversity conservation
  • Mukesh Ambani at NE Investors Summit
  • Bees inspired by nature to nourish us all
  • Influencers! Responsibility should also go viral
  • Natural sunscreen: Exploring safe alternatives
  • Central forces dictating terms in the plains
  • Land of Shirui Lily: Manipur is this & more
  • 48 hrs Bandh: protest security forces: Gallery
  • Manipur is no empty word to be played with
  • Admission for B.Tech, M.Tech at DUIET
  • Condemnation: Govt & Mahar Regiment
  • Dress code, debating etiquette in democracy
  • Cervical cancer prevention through HPV
  • Beauty :: Poem
  • Utter disregard of public sentiment
  • Whispers between Beads & Silences #2
  • Bonds of love across the Burmese border
  • Investigate the action of Mahar Regiment
  • Shirui Lily Festival fosters brotherhood
  • Shining a light on retinoblastoma
  • Trump for Nobel peace prize
  • Protest Rally: Journalist harassment: Gallery
  • Action against harassment to journalists
  • Still, believe :: Poem
  • Change How You Think About Time
  • Nagas preserve heritage through handloom
  • India's declared undeclared war
  • Sanatan Sammelan 2025 at Imphal
  • No 'Manipur' in Manipur order
  • Improvised security steps for Shirui Lily fest !
  • Purul (Hiimai) Paoki Fest #3 : Gallery
  • Youth Empowerment at Shirui Lily Festival
  • Indo-Naga Talks (From 2012) :: Timeline
  • Justice Bhushan Ramkrishna Gavai
  • Audit for TB deaths is missing in #EndTB
  • Realm of Power :: Poem
  • Hospitals: Learn a bit about hospitality
  • Keeping the ST for Meiteis demand alive
  • Raking up ST issue as tension grips state
  • Manipur Hill Areas Act, 1967 #2
  • Welcome & Appeal from Shirui Village
  • Thoudam Akashini: Champion master athlete
  • National Endangered Species Day 2025
  • Avert Ego, Soul Near Me :: Poem
  • Clarification regarding News Coverage on AIR
  • Coming back after 4 years: Shirui Lily Fest
  • Festival to test efficiency of SFs
  • 76th Indian Republic Day #5 : Gallery
  • Khuraijam Phulendra Singh
  • Media role in preserving culture & harmony
  • World Hypertension Day 2025
  • Army Veterans pay tribute to Martyr Constable
  • The Power of Poppy - 81 :: Poem
  • Yaoshang Cooking competition : Gallery
  • Rejoice Singh: Makeup / Prosthetic: Gallery
  • Project Associate @ Assam University
  • Internship @ IEEE CIS Kolkata Chapter
  • Article 371C : Role of Governor & HAC #2
  • Recognize real ability, not marks
  • The rise of information warfare
  • Skin care routine for summer
  • Over three months of President's Rule
  • Toiling to reinstate Govt sans consensus
  • Whispers between Beads & Silences #1
  • Just to See :: Poem
  • Artisan blends craft to empower women
  • Chief Justice at Moirang Relief Camp
  • Lalruattluanga win at TrendVision Finale
  • Manipur mourn Deepak Chingakham
  • Strategic shift to underdeveloped regions
  • Candid NSCN (IM) make stand clear
  • Tourism festival under threat
  • 'Yelhou Yangkok Artist' Exhibit #3 : Gallery
  • Cultural @ Tri-Nation Football #2 : Gallery
  • HSLC 2025: Full Result (Check Roll No)
  • HSLC 2025: Important Info & Grading System
  • HSLC 2025 : Compartmental candidates
  • HSLC 2025 : Comparative Statement
  • HSLC 2025 : Statistical Abstract
  • HSLC 2025 : District Pass Percentage
  • HSLC 2025 : Govt School Pass %
  • HSLC 2025 : Aided School Pass %
  • HSLC 2025 : Private School Pass %
  • 21st Ningtham Kumhei #2 : Gallery
  • People's Convention on 3rd May #2 : Gallery
  • Interview with Rejoice Singh- Makeup Artist
  • Featured Front Page Photo 2025 #2: Gallery
  • Nongkhrang Ehanba @ Lilong : Gallery
  • People's Convention on 3rd May #1 : Gallery
  • Radio E-pao: New Channel - Khunung Eshei
  • Khongjom Day - April 23 #2 : Gallery
  • The Waterbirds of Loktak Lake
  • Imoinu Erat Thouni @Kangla : Gallery
  • Statues of 7 Maichous @Kyamgei : Gallery
  • Riya Khwairakpam : HSE Science Topper
  • Keisham Hannah : HSE Arts Topper
  • Warepam Lidia : HSE Commerce Topper
  • HSE 2025 Result : Science Full Result
  • HSE 2025 Result : Arts Full Result
  • HSE 2025 Result : Commerce Full Result
  • HSE 2025 Information / Abbreviation
  • HSE 2025 Topper : Science
  • HSE 2025 Topper : Arts
  • HSE 2025 Topper : Commerce
  • HSE 2025 : Pass Percentage
  • HSE 2025 : Result Abstract
  • HSE 2025 : Candidates with Highest Marks
  • Khongjom Day - April 23 #1 : Gallery
  • Cheiraoba by Manipuri in Korea : Gallery
  • Ougri Lirol :: Part 1 : Ooba Video
  • President's Rule in Manipur : 1967 - 2025
  • Downloadable Manipuri Calendar :: 2025