TODAY -

E-Pao! Education :: World Wide Web: A Digital Library

World Wide Web: A Digital Library
By: Sanasam Ranbir Singh *



In the span of a decade, the World Wide Web, in short WWW has grown from a small research project into a vast repository of information and a new medium of communication. Today, many organizations (Governmental, Non-Governmental), Institutions, Business organizations etc., use Web as their information media and Internet has become an indispensable part of day-to-day life. Unlike other great networks of the past century, - such as the electronic power grid, the telephone system, or the highway and rail system, - the Web does not have an engineered architecture. Rather, it is a virtual network of content and hyperlinks with over a billion interlinked “pages” created by the uncoordinated actions of tens of millions of individuals.

WWW can be viewed as a graph, in which each node represents the page and edges connecting the nodes are the hyperlinks. The topology of this graph determines Web’s connectivity and consequently how effectively can we locate information on it. But, its enormous size estimated at least 8x108 documents and rapidly growing poses a big challenge to search related pages for specific topic. Major search engine companies have often claimed that they can keep up with the size of the Web. But, due to its continuous changing of documents, links and rapidly growing nature make it impossible to catalogue all the vertices and edges. The estimated coverage of the web by some search engines is given in table below.

Search EngineCoverage (%)
HotBot57.5
AltaVista46.5
Northern Light32.9
Excite23.1
Infoseek16.5
Lycos4.41


Table 1: Estimated coverage of each search engine (average over 575 queries performed during 15 to 17 December 1997) [10].

Because of the decentralized nature of its growth, the Web has been widely believed to lack of structure and organization as a whole. Analysis of the Web’s network of hyperlinks have revealed an intricate structure that is providing to be valuable for organizing information, improving search methods and understanding the Web in a broader technological and serial context. HITS [2], SALSA[3] are some of the widely used hyperlink structure based algorithms and surprisingly found to provide good results. Many studies like PHITS[4], PageRank[1] etc. are farther studies on HITS. Several studies like spectral filtering[7], HyCon[6] find that combining content and link structure of the web provides better result. Our recent study, confidence based web search[6] finds to provide surprisingly good result by monitoring users’ web page access records. Precise classification of the web pages into categories is a key factor in web indexing that plays a major role to improve web search performance and provide quality pages. LSA (Latent semantic analysis), PLSA (probabilistic LSA), k-nearest neighbor etc. are some of the algorithms used to classify web pages.

A recent study [8] indicates that the Web contains a large, strongly connected core in which every page can reach every other by a path of hyperlinks. This core contains most of the prominent sites on the Web. The remaining pages can be characterized by their relation to the core: Upstream nodes can reach the core but cannot be reached from it, downstream nodes can be reach from the core but cannot reach it and “tendrils” contain nodes that can neither reach the core nor be reached from the core.

Searching for relevant pages of specific topic from this huge library poses a large degree of complexity due to its unstructured and dynamic in nature. Available search engines can be broadly classified into two such as content-based search engine and citation-based search engine based on the mechanisms used. Content-based search engines use only the document content and use them for key word matching operation. Users query topic is used as the keyword and find out the documents containing the keyword in the web. Some of the full text content-based search engines are Lycos (www.lycos.com), Alta Vista (www.altavista.digital.com), Excite (www. Excite.com), HotBot (www.hotbot.com), In-foseek (www.infoseek.com), Northern Light (www.nlsearch.com) etc. Several researches find that content-based search engines often provide poor quality results. Hyperlink structure based search engines use citations as well as content of the pages and provide better results than content-based search engines. Google (www.google.com), clever etc. are some of the hyperlink-based search engines.

There are many issues like extraction of the features from the pages, organizational structure of web, identifying community of pages, crawling the web, large-scale search engine and its architecture, web structure, personalized web search, page ranking methods, optimizing web structure, web indexing etc. which are required for better web mining. Due to good amount of resources for research in Web, many researchers are attracted into this area.

References:
[1] Sergey Brin, Lawrence Page. The anatomy of a large-Scale hypertextual Web search engine. In Proc. 7th Int. World Wide Web Conf., 1998.
[2] J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of ACM (JASM), 46, 1999.
[3] R. Lempel and S. Moran. The stochastic approach for link-structure analysis (SALSA) and the TKC effect. In 9th Int. WWW Conference, Amsterdam, Nrtherlands, May 2000.
[4] D. Cohn and H. Chang. Learning to probabilistically identify authoritative documents. Preprint, 2000.
[5] D. Mukhopadhyay, D. Giri, S. R. Singh. A Confidence Based Methodology to Deduce User Oriented Page Ranking in Searching the Web. Preprint, 2003.
[6] D. Mukhopadhyay, S. R. Singh. HyCon: A Hyperlink and Content based Topic Search Technique. Preprint, 2003.
[7] S. Chakrabarti, B. Dom, R. Kumar, P. Raghavan, S. Rajagopalam, A. Tomkins. Spectral filtering for resource discovery. Preprint, 1998.
[8] Jon Kleinberg, Steve Lawrence. The structure of the Web. In Science Vol. 294, 30 November 2001.
[9] S. Deerwester et. al. Indexing by latent semantic analysis. Journal of the Society for Information Sc. 1990.
[10] Stave Lawrence and C. Lee Gilis. Searching the World Wide Web. Science, Vol.280, 3 April 1998. www.science.com.


Sanasam Ranbir Singh is a scholar at the Dept. Of Comp. Sc. & Engg. Haldia Institute Of Technology, West Bengal, India

* Comments posted by users in this discussion thread and other parts of this site are opinions of the individuals posting them (whose user ID is displayed alongside) and not the views of e-pao.net. We strongly recommend that users exercise responsibility, sensitivity and caution over language while writing your opinions which will be seen and read by other users. Please read a complete Guideline on using comments on this website.




LATEST IN E-PAO.NET
  • HSE 2025 Result : Science Full Result
  • HSE 2025 Result : Arts Full Result
  • HSE 2025 Result : Commerce Full Result
  • HSE 2025 Information / Abbreviation
  • HSE 2025 Topper : Science
  • HSE 2025 Topper : Arts
  • HSE 2025 Topper : Commerce
  • HSE 2025 : Pass Percentage
  • HSE 2025 : Result Abstract
  • HSE 2025 : Candidates with Highest Marks
  • Violence in Manipur 2023-2025 : Timeline
  • Khongjom Day - April 23 #1 : Gallery
  • Thang Ta finds new energy amid peace
  • Tawang: Geostrategic importance for India
  • Thadou appeal for community understanding
  • Census 2001 & delimitation in Manipur
  • Condemns Pahalgam Terror- Calls for Action
  • Failing to read & control situation
  • Visible efforts essential for public trust
  • MK Binodini Devi's short story 'Tune'
  • Prof Moirangthem Marjit chairs SETSM, Hanoi
  • Will the two Asian giants always be in Rivalry?
  • Rebellion surfaces in rebel group NSCN-IM
  • Child Labour :: Poem
  • Pharmaceutical Waste: Threat to public health
  • Call for delimitation, NRC : Check illegal
  • Death knell for noble healthcare schemes
  • 175th Anniv- Maharaj Narasingh #2 : Gallery
  • World Earth Day : Gallery
  • Understand Suicide & Mental Health Support
  • Manipur champion @ Natl School Games
  • World Earth Day celebrated at MTU
  • The Earth Day 2025: Our power, our planet
  • How long will PR continue ?
  • Eviction drive need of the hour
  • Tamnalai : World Theater Day #1: Gallery
  • Chumthang Makhong : Play Synopsis
  • The demands of village volunteers
  • Missing you :: Poem
  • AI offers hope for beekeepers battling pest
  • Rural women, climate shock: Beijing report
  • From March 8, 2025 to April 22, 2025
  • Boosting morale of job seekers
  • Radio E-pao: 5 new songs added ...
  • The Power of Confident Communication
  • 2nd State Level Soccer Futsal Championship
  • April 21: National Public Relations Day
  • The resurrection of Jesus & its impact
  • Bhalla saab solution kithe ?
  • Training on Mushroom Cultivation
  • JNIMS turned into a dumping site
  • Sub-par work as centre vows US-level roads
  • Cheiraoba by Manipuri in Korea : Gallery
  • Kallakchei, Hungchor, Gainilung : eMing
  • Sri Lanka "Ayubowan" lasting impression
  • GoI must prepare to handle post-Muivah
  • Vice President felicitated Mughavi Tuccu
  • The Power of Poppy - 77 :: Poem
  • Rabies outbreak in Manipur
  • Athoubashinggi Numit #2 : Gallery
  • Pangolin & fight against Climate Change
  • Condemn violent assault against Konsakhul
  • Spring's symphony in my farmhouse :: Poem
  • National Conference on Elderly at RGU
  • The corruption & materialism of Judas
  • Manipur under PR for over 2 months
  • Bid to form government amid public scrutiny
  • 175th Anniv- Maharaj Narasingh #1 : Gallery
  • AI & technology in Manipur's agriculture
  • 4 Manipur players in Indian Women's Hockey
  • Gender justice & health equity are linked but ...
  • Digital marketing: Oxygen of modern business
  • Spring fruits that boost collagen in your body
  • Pot holed roads & others: Surviving Manipur
  • Frustration over centre failure to resolve crisis
  • Pichakari @Govindajee Temple #2 : Gallery
  • Poshan Pakhwada @ MU : Gallery
  • Startup Surge Manipur: Startup Venture Fund
  • My messy room :: Poem
  • Why WAQF Act, 2025 is unconstitutional
  • Emerging politics at play
  • National Fire Service Week
  • Observance of Thang-Ta Day #2 : Gallery
  • Cheiraoba in South Korea
  • Festival of Maram Achouba Khoushaba
  • The Hidden Strength in Falling Short
  • World Health Day 2025 & our Environment
  • Career after marriage: Flight or confusion?
  • Ban on SUP has come into force
  • Preying on abandoned houses
  • Sajibu Cheiraoba Chak Katpa #2 : Gallery
  • Climate Change : Spring revival in Ukhrul
  • Merger Agreement: Meaningless paper ?
  • Yaingang in sunscreens
  • Will all children be born free of HIV by 2030 ?
  • Athoubashinggi Numit #1 : Gallery
  • Day 4 : Yaoshang Sports #1 : Gallery
  • Narendra Ningomba - 'Iboyaima Award 2025'
  • Naga leaders Isak Sumi & Tikhak expound
  • Parrotisation in post-colonial intellectualism
  • Call me Burma :: Poem
  • Claim the crown if you have 30 !
  • Marching towards the 2 year mark
  • Train service vow amid fear over migrants
  • Cheirao-chingkaba @Chinga : Gallery
  • Why words matter in Manipur
  • Appeal for a Way Forward in Manipur
  • Birth Anniv of BR Ambedkar at MU
  • Final Call : Phase-2 of MFA 2024-25
  • The Power of Poppy - 76 :: Poem
  • Astronauts as a Career Choice
  • 16th Annual Art Exhibition #1: Gallery
  • Classic FA's Inspirational Journey in RFDL
  • Shifting weather patterns driving dengue cases
  • Early Childhood Caries: Public health concern
  • Lord Ramacandra's glorious examples
  • Media, women, & sensationalism
  • Cocking a snook at Delhi meet
  • Lobbying for preferred place of posting
  • Indo-Naga Talks (From 2012) :: Timeline
  • Ougri Lirol :: Part 1 : Ooba Video
  • Privileges & Safeguards for STs of Manipur
  • Personal & Professional Development
  • Ode to Peace :: Poem
  • Entries for 17th Manipur State Film Awards
  • Makeup tips to illuminate your look this spring
  • AI-based drones to revolutionise agriculture
  • Of shabby & pot holed roads: Defining Imphal
  • Mizoram feeling heat of sheltering refugees
  • The last ember glows : Will we let it burn ?
  • Business Idea Competition @ Manipur Univ
  • 1/2 of women cant make decision on health
  • 2nd State Level Soccer Futsal Championship
  • The life of Mahavir Bhagwan
  • 'Yummy Talent Fest' at Shillong
  • Another ban on single use plastic
  • Reasons for dissent against AFSPA
  • Mei Loukhatpa @Laipubam : Gallery
  • RK Bidur : Honouring a legacy
  • Appreciates peace dialogue at Delhi
  • Sigiriya : Sri Lanka's top tourist attraction
  • Mami Numit & Foundation Day SN Chand
  • Study Tour to Sikkim & Darjeeling
  • Mum on pre-conditions at Delhi
  • Tension over land disputes amid ethnic feud
  • Indigenous People's Fest #2 : Gallery
  • Jugeshwar Kshetrimayum: Martial Art Champ
  • Delimitation based on Census 2001 - II
  • Defending Our Faith, Our Lands, Our Rights
  • Tariffs: Time for Manipur to Rethink Its Future
  • Is deliverance always proportional to faith ?
  • 3rd AGM of Madhurupa Cancer Society
  • Phamba Challadi Hippa Challi
  • BJP on the back foot
  • Yaoshang Halankar #1 : Gallery
  • Condemns heinous incident at Konsakhul
  • Hun-Thadou Cultural Festival Concluded
  • World Health Day 2025
  • Living in Zone-V: The vulnerability
  • Solidarity with Myanmar Earthquake Victims
  • Career in sports can be rewarding
  • After Delhi meet of April 5, what next ?
  • Multiple rounds of tripartite talks inevitable
  • Pot Lannaba : Mera Houchongba #2 : Gallery
  • Delimitation : Why NRC must precede
  • Manipur tourism - insights from Sri Lanka
  • Mathematics as most useful & easiest subject
  • 10 Habits That Will Make You Unstoppable
  • The Power of Poppy - 75 :: Poem
  • Freedom of authorship Vs editorial policy
  • 3-language study model that aligns with NEP
  • Observance of World Aquatic Animal Day
  • World Autism Awareness Day 2025
  • Upliftment of Langmei Hr Secondary School
  • Setting pre-conditions for Delhi talk
  • Cong leaders note menace of drugs, influx
  • Yaoshang Mei Thaba #3 : Gallery
  • CAU produces hygienic Hawaijar maker
  • Delimitation based on Census 2001 #1
  • Is long HIV treatment good as daily pills ?
  • Sunburn : EDM festival at Shillong
  • Boost your skin with spring fruits
  • 23 months on and Delhi still lost !
  • Growing pitch for NRC
  • Thabal Chongba reclaims its cultural soul
  • Caregiver burden of raising an Autistic child
  • Supreme Court Judges visit : Gallery
  • Manipur: Champion 21st Natl Mountain Biking
  • Solution to water crisis
  • The Eternal I
  • Setting pre-conditions for talks
  • AFSPA expanded in 'peaceful' valley
  • Id-ul-Fitr @ Yairipok, Kshetrigao : Gallery
  • NRC before Delimitation in Manipur
  • Zeilad Lake : A common heritage
  • Right to safe abortion cannot be dislocated
  • World Theater Day
  • The shackles of ideas in digital India
  • The stand against delimitation
  • Myanmar earthquakes & vulnerable Northeast
  • Shortcomings - Delimitation in Manipur
  • "Tulsi Nonglik" at CAU, Lamphelpat
  • The Power of Preparation
  • Catherine Soyamphi: Turn waste into wealth
  • 'Common Platform' and 'Common Draft'
  • The Wounded Mercenary :: Poem
  • Mohan and Modi in Nagpur
  • Sajibu Cheiraoba Chak Katpa #1 : Gallery
  • 27th PANE Foundation Day
  • MoU with Nittur IAS Academy
  • Sleep State Impasse : A mass digital disorder
  • TIM to attend Hun Thadou Cultural Fest
  • First-ever ABH-incompatible Kidney transplant
  • Yaoshang Sports @ Kwakeithel #2 : Gallery
  • April Calendar for Year 2025 : Tools
  • Tamnalai :: Play Synopsis
  • Sajibu Cheiraoba- Meitei New Year Day: Book
  • Rise of AI: Story of future, dreams & nightmare
  • Funding crisis into opportunity to end TB
  • The Power of Poppy - 74 :: Poem
  • Saroi Khangba @ Imphal #2 : Gallery
  • Indigenous Women's Rights in Manipur
  • A review of In Xanadu: A Quest
  • Open Letter to Shri Amit Shah
  • Strategy for resource mobilization
  • Haircare tips to bloom in spring
  • Over a month since PR came into force
  • Near consensus on NRC update
  • Dr Aheibam Koireng: A prolific academician
  • Abolish Institution of Hereditary Chieftainship
  • Seminar on Career Choice at Kanglatongbi
  • TCI condemns Kuki diktats
  • Diktat to cancel Hun-Thadou fest
  • Objection To "Hun" Celebration
  • How to choose right career after XII class ?
  • Details of drug smuggling coming to light
  • Robust anti-drug units must to nail kingpins
  • Rare grasshoppers, crickets recorded in Zeilad
  • The Laiphadibi :: Poem
  • Policy proposal for ending ethnic conflicts
  • Entrepreneurship with mushroom cultivation
  • Condemns illegal diktat by Kuki SoO groups
  • A woman - Does she need fixing ?
  • Understanding Ponzi, digital banking fraud
  • Step down nudge to political appointees
  • Rivers turning into dumping zone
  • The Power of Forgiveness & Leadership
  • Yaoshang Sports @ Kwakeithel #1 : Gallery
  • Non-violence for defeating Kuki militants
  • World Water Day @ MU : Gallery
  • 14th AMWJU Annual Sports Meet #2 : Gallery
  • Thang-Ta for emotional balance
  • Yaoshang Mei Thaba #2 : Gallery
  • Day 5: Yaoshang Sports : Gallery
  • National Bamboo Festival : Gallery
  • Yaoshang Pichakari #2 : Gallery
  • Yaoshang Mei Loukhatpa #4 : Gallery
  • Yaoshang Mei Loukhatpa @Kangla : Gallery
  • Yaoshang Mei Thaba @ Imphal #1 : Gallery
  • 1st AMAND Football Cup @ Pune : Gallery
  • The Untold Meaning of MEETEI and MEITEI
  • In Memory of Aheibam Koireng
  • Featured Front Page Photo 2025 #1: Gallery
  • Moirangthem Marjit chairs CCCIS, Hong Kong
  • President's Rule in Manipur : 1967 - 2025
  • AIR Radio Imphal Station - Live streaming
  • Meitei Mayek Tamba : Online Classroom #5
  • Downloadable Manipuri Calendar :: 2025
  • GHOST of PEACE :: Download Booklet