Web Scraping with JSOUP in JAVA

-
Web Scraping with JSOUP API in JAVA


jsoup: Java HTML Parser

    jsoup is a Java based library to work with HTML based content. It provides a very convenient API to extract and manipulate data, using the best of DOM, CSS, and jquery-like methods. It implements the WHATWG HTML5 specification, and parses HTML to the same DOM as modern browsers do.

  1. Multiple Read Support - It reads and parses HTML using URL, file, or string.
  2. CSS Selectors - It can find and extract data, using DOM traversal or CSS selectors.
  3. DOM Manipulation - It can manipulate the HTML elements, attributes, and text.
  4. Prevent XSS attacks-It can clean user-submitted content against a given safe white-list, to prevent XSS attacks.
  5. Tidy- It outputs tidy HTML.
  6. Handles invalid data - jsoup can handle unclosed tags, implicit tags and can reliably create the document structure.


here is example of sample code: 

import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;

public class Test {

    public static void main(String[] args) throws Exception {
        String url = "https://niravpatelonjava.blogspot.in";
        Document document = Jsoup.connect(url).get();

        String text = document.select("div").first().text();
        System.out.println(text);

        Elements links = document.select("a");
        for (Element link : links) {
            System.out.println(link.attr("href"));
        }
    }
 
 
 
referenced by : https://jsoup.org

Comments

Post a Comment

Popular posts from this blog

Java LinkedList class in Collection

-
Image
Java LinkedList class in Collection --  LinkedList class uses doubly linked list to store the elements and data. It provide a linked-list data structure.get free coins thetechieking --  It inherits the AbstractList class and implements List and Deque interfaces in java. --  LinkedList class is non synchronized. --  LinkedList class follow insertion order.  --  LinkedList class can allow duplicate elements to store data. --  manipulation is faster than ArrayList because no shifting needs. Declaration of LinkedList class in java : -- public class LinkedList<E> extends AbstractSequentialList<E>    implements List<E>, Deque<E>, Cloneable, Serializable   Constructors of Java LinkedList :  LinkedList()   LinkedList(Collection c) Methods of LinkedList class : 1) boolean add ( Object element ) : -- It appends the element to the end of the list. 2) void add ( int ...
Read more

Array in Java

-
Image
Array in Java             Array is a collection of similar type of elements that have contiguous memory location.Java array is an object the contains elements of same datatype. it is a data structure where we store similar elements. We can store only fixed set of elements in a java array. Arrays in Java are homogeneous data structures implemented in Java as objects Advantage of Java Array     : 1) Code Optimization : It makes the code optimized, we can retrieve or sort the data easily. 2) Random access       : We can get any data located at any index position     Disadvantage of Java Array : 1) Size Limit : We can store only fixed size of elements in the array. It doesn't grow its size at runtime. To solve this problem, collection framework is used in java.   There are two types of array. Single Dimensional Array Multidimensional Array ...
Read more

Constructors in Java

-
Image
Constructors in Java. -- A constructor is a special method of function  that is used to   initialize an object in java. --  every class has a constructor by default. --  compiler build a default constructor for that class. --  constructor are executed at time of object creation of class.  --  there are no return type in java constructor --  An interface cannot have the constructor in java. --  Constructors cannot be private modifire. --  Constructors name must be similar to that of the class name.   There are 2 type of constructor in Java :     1) Default Constructor.  2) Parameterized constructor.     1) Default Constructor. --  A java constructor that has no parameter is known as default constructor. thats build by compiler. --  if we write a constructor with parameter or non-parameter then compiler does not create default construct...
Read more