Analysis of AJAX Web Crawler for Hidden Web  
  Authors : Beena Mahar; Dr C. k. Jha


Today the advance technology can dynamically change the index, content and the structure of the web page. The web crawler uses static web page to produce less content during page loading. But in AJAX web crawler this problem is sort out. In this paper we analysis the concepts of Ajax web crawler that support AJAX and make the custom tasks that’s become web information very efficient. AJAX is a web development technique for building responsive web application. This paper gives an overview of the AJAX technique and explores ideas for teaching this technique in modules related to internet technologies and web development. We also analyze a depth overview of AJAX web crawler for the hidden web 2.0 which presents new and fresh challenges. An analysis on various facts is presented which include the design, working and realization of the AJAX web crawler that can be effectively obtain AJAX dynamic hidden web.


Published In : IJCAT Journal Volume 2, Issue 12

Date of Publication : December 2015

Pages : 463 - 468

Figures :02

Tables : --

Publication Link :Analysis of AJAX Web Crawler for Hidden Web




Beena Mahar : Research Scholar, Department of Computer science Banasthali University, Rajasthan- India

Dr C. k. Jha : Associate Professor, Department of Computer science Banasthali University, Rajasthan- India








Hidden web


web crawler

working of AJAX

Web 2.0

web indexing

indexing technique

When the web is crawled, any search engine parses the file to generate an index that points to the corresponding various result. This is a process where create an index. These indexes helps search engine for retrieval of result very vastly. For example it may take much time for search engine to scan a file which contain thousands of many pages but if in index is create then they eliminate the need for search engine to go through the file at the time search results are needed. The main drawback of creating an index is that it needs huge and extra memory for storage of indexes.










[1] Faustin Kagororal, Junyi Li, Damien Hanyurwimfural, Lancine Camaral, “Effectiveness of Web Application Security Scanners at Detecting Vulnerabilities behind AJAX/JSON”, In Int. Journal of Innovative Research in Science, Engineering and Technology, volume 4, Issue 6, June 2015 [2] Seema Rani, Anil Kumar, Jyoti Yadav, ”Design and Implementation of a Novel Semantic Indexing Technique for Hidden Web Pages”, In Int. Journal of Innovative Research in computer and Communications Engineering, volume 3, Issue 5, May-2015 [3] A Rosaline Mary, B Visvanath, ”Evaluation of web search engine-a comparative study”, In Research Gate 2015 [4] Bhupendra Singh, Shashank Sahu,”Model for performance testing of AJAX based web applications”, In Int. Journal of Research in Engineering and Technology, volume 3, Issue 4, eISSN 2319-1163,pISSN 2321-7308, 2014 [5] Bhupendra Singh, Shashank Sahu,”A Noval approach for evaluation of applying AJAX in the web site”, In Int. Journal of Research in Engineering and Technology, volume 3, Issue 8, eISSN 2319-1163,pISSN 2321-7308, 2014 [6] Rahul Kumar, Anurag Jain and Chetan Agarwl,”Survey of web crawling algorithms”, In the Int. Journal of Advances in Visions Computing(AVC), volume 1, Issue 2/3, 2014 [7] Aviral Nigam, NIT-Calicut, “Web Crawling Algorithms”, In the International Journal of Computer Science and Artificial Intelligence, volume 4, Issue 3,Pages 63-67, 2014 [8] Li Jie Cuil, Hui He, Hong-Wei Xuan,Jin Gang,”Design and Development of an AJAX Web Crawler”, In SERSC , volume 17, pages 6-10, 2013 [9] Li Jie Cuil, Hui He and Hong Wei Xunal, “Analysis and Implementation of an Ajax enabled Web Crawler”, In Int. Journal of Future Generation Communication and Networking, volume 6, Issue 2, 2013 [10] Swati Mali, Dr. B.B Meshram, “Implementation of multiuser personal web crawler”, In CSI 6th Int. Conf. on SE(CONSEG), IEEE Conf. Publication, 2012 [11] F. Iftikhar, S. Gull, M Shoaib, S. Shoaib and K Karim, “An AJAX Powered forms based approach for Crawling the deep web” , In the Pakistan Journal of Science, volume 63, Issue 3, Sep- 2011 [12] Cristian Duda, Gianni Frey, Donald Kossmann, Reto Matter, Chong Zhou, “AJAXCraw: Making AJAX applications Searchable”, In Int. Conference on Data Engineering IEEE -2009 [13] AJAX Public Library master Plan 2011-2026, Ajax public library board [14] Doddy Satyasree , “AJAX Term Paper” Hochschule Furtwangen University, Version:0.1, 2009 [15] Bing Luo,”Design and Implementation of internet search engine crawlers supported AJAX”, HangZhou , ZheJiang University , 2007 [16] Zhuo Lei Xiao, “Research on the search engine based on the AJAX technology”, WnHan University of Science and Technology [17] C Duda, G Frey and D Kossmann, “Ajax search: crawling , Indexing and Searching web 2.0 Applications”, In the Processing of the VLDB endowment Archive, volume 1, Issue 2, pages 1440-1443, 2008 [18] A. Mesbah, E. Bozdag and A.V. Deursen, “Crawling AJAX by inferring user interface state changes”, In the Proc. Of 8th Int. Conf. on Web Engineering (ICWE), Washington DC,USA, IEEsE-CSI , pages 122-134, 2008 [19] S. Raghavan and H. Garcia-Moline, “Crawling the hidden web” In Proc. of the Conf. on Very Large Data Bases-VLDB Roma Italy, pages 129-138, 2001.