Web Scraping with JSOUP in JAVA

-
Web Scraping with JSOUP API in JAVA


jsoup: Java HTML Parser

    jsoup is a Java based library to work with HTML based content. It provides a very convenient API to extract and manipulate data, using the best of DOM, CSS, and jquery-like methods. It implements the WHATWG HTML5 specification, and parses HTML to the same DOM as modern browsers do.

  1. Multiple Read Support - It reads and parses HTML using URL, file, or string.
  2. CSS Selectors - It can find and extract data, using DOM traversal or CSS selectors.
  3. DOM Manipulation - It can manipulate the HTML elements, attributes, and text.
  4. Prevent XSS attacks-It can clean user-submitted content against a given safe white-list, to prevent XSS attacks.
  5. Tidy- It outputs tidy HTML.
  6. Handles invalid data - jsoup can handle unclosed tags, implicit tags and can reliably create the document structure.


here is example of sample code: 

import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;

public class Test {

    public static void main(String[] args) throws Exception {
        String url = "https://niravpatelonjava.blogspot.in";
        Document document = Jsoup.connect(url).get();

        String text = document.select("div").first().text();
        System.out.println(text);

        Elements links = document.select("a");
        for (Element link : links) {
            System.out.println(link.attr("href"));
        }
    }
 
 
 
referenced by : https://jsoup.org

Comments

Post a Comment

Popular posts from this blog

Array in Java

-
Image
Array in Java             Array is a collection of similar type of elements that have contiguous memory location.Java array is an object the contains elements of same datatype. it is a data structure where we store similar elements. We can store only fixed set of elements in a java array. Arrays in Java are homogeneous data structures implemented in Java as objects Advantage of Java Array     : 1) Code Optimization : It makes the code optimized, we can retrieve or sort the data easily. 2) Random access       : We can get any data located at any index position     Disadvantage of Java Array : 1) Size Limit : We can store only fixed size of elements in the array. It doesn't grow its size at runtime. To solve this problem, collection framework is used in java.   There are two types of array. Single Dimensional Array Multidimensional Array ...
Read more

Java LinkedList class in Collection

-
Image
Java LinkedList class in Collection --  LinkedList class uses doubly linked list to store the elements and data. It provide a linked-list data structure.get free coins thetechieking --  It inherits the AbstractList class and implements List and Deque interfaces in java. --  LinkedList class is non synchronized. --  LinkedList class follow insertion order.  --  LinkedList class can allow duplicate elements to store data. --  manipulation is faster than ArrayList because no shifting needs. Declaration of LinkedList class in java : -- public class LinkedList<E> extends AbstractSequentialList<E>    implements List<E>, Deque<E>, Cloneable, Serializable   Constructors of Java LinkedList :  LinkedList()   LinkedList(Collection c) Methods of LinkedList class : 1) boolean add ( Object element ) : -- It appends the element to the end of the list. 2) void add ( int ...
Read more

Java ArrayList class in collections

-
Image
Java ArrayList class in collections --  ArrayList class uses a dynamic array for storing the elements. It inherits AbstractList class and implements List interface in java.  --  ArrayList class can allows random access because array works at  the index basis.  --  ArrayList is non synchronized class in java. --  ArrayList class maintains insertion order to data --  ArrayList can contain duplicate elements. --  manipulation is slow in ArrayList class because a lot of shifting      needs to operation with data.   ArrayList class have three Constructor.    1) ArrayList ( )   2) ArrayList ( Collection c )   3) ArrayList ( int capacity )    Some Methods of  ArrayList class   1) void add ( int index, Object element )    -   insert the specified element at the specified position index in a list.   2) boo...
Read more