Crawljax

Crawljax is a free and open source web crawler for automatically crawling and analyzing dynamic Ajax-based Web applications. [1]

One major point of difference between Crawljax and other traditional web crawlers is that Crawljax is an event-driven dynamic crawler, capable of exploring JavaScript-based DOM state changes. Crawljax can be used to crawl and create a static mirror of any Ajax web application.[2]

References

  1. ^ Mesbah, Ali; Van Deursen, Arie; Lenselink, Stefan (2012). "Crawling Ajax-Based Web Applications through Dynamic Analysis of User Interface State Changes". ACM Transactions on the Web. 6: 1–30. doi:10.1145/2109205.2109208. S2CID 1351916.
  2. ^ "Understand JavaScript SEO Basics | Google Search Central".