Web Scraping with JSOUP in JAVA

-
Web Scraping with JSOUP API in JAVA


jsoup: Java HTML Parser

    jsoup is a Java based library to work with HTML based content. It provides a very convenient API to extract and manipulate data, using the best of DOM, CSS, and jquery-like methods. It implements the WHATWG HTML5 specification, and parses HTML to the same DOM as modern browsers do.

  1. Multiple Read Support - It reads and parses HTML using URL, file, or string.
  2. CSS Selectors - It can find and extract data, using DOM traversal or CSS selectors.
  3. DOM Manipulation - It can manipulate the HTML elements, attributes, and text.
  4. Prevent XSS attacks-It can clean user-submitted content against a given safe white-list, to prevent XSS attacks.
  5. Tidy- It outputs tidy HTML.
  6. Handles invalid data - jsoup can handle unclosed tags, implicit tags and can reliably create the document structure.


here is example of sample code: 

import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;

public class Test {

    public static void main(String[] args) throws Exception {
        String url = "https://niravpatelonjava.blogspot.in";
        Document document = Jsoup.connect(url).get();

        String text = document.select("div").first().text();
        System.out.println(text);

        Elements links = document.select("a");
        for (Element link : links) {
            System.out.println(link.attr("href"));
        }
    }
 
 
 
referenced by : https://jsoup.org

Comments

Post a Comment

Popular posts from this blog

Java LinkedList class in Collection

-
Image
Java LinkedList class in Collection --  LinkedList class uses doubly linked list to store the elements and data. It provide a linked-list data structure.get free coins thetechieking --  It inherits the AbstractList class and implements List and Deque interfaces in java. --  LinkedList class is non synchronized. --  LinkedList class follow insertion order.  --  LinkedList class can allow duplicate elements to store data. --  manipulation is faster than ArrayList because no shifting needs. Declaration of LinkedList class in java : -- public class LinkedList<E> extends AbstractSequentialList<E>    implements List<E>, Deque<E>, Cloneable, Serializable   Constructors of Java LinkedList :  LinkedList()   LinkedList(Collection c) Methods of LinkedList class : 1) boolean add ( Object element ) : -- It appends the element to the end of the list. 2) void add ( int index, Object element ) : -- It inserts the element at the position
Read more

Java ArrayList class in collections

-
Image
Java ArrayList class in collections --  ArrayList class uses a dynamic array for storing the elements. It inherits AbstractList class and implements List interface in java.  --  ArrayList class can allows random access because array works at  the index basis.  --  ArrayList is non synchronized class in java. --  ArrayList class maintains insertion order to data --  ArrayList can contain duplicate elements. --  manipulation is slow in ArrayList class because a lot of shifting      needs to operation with data.   ArrayList class have three Constructor.    1) ArrayList ( )   2) ArrayList ( Collection c )   3) ArrayList ( int capacity )    Some Methods of  ArrayList class   1) void add ( int index, Object element )    -   insert the specified element at the specified position index in a list.   2) boolean addAll ( Collection c )    -  used to append all of the elements in the specified collection to the       end of this
Read more

Constructors in Java

-
Image
Constructors in Java. -- A constructor is a special method of function  that is used to   initialize an object in java. --  every class has a constructor by default. --  compiler build a default constructor for that class. --  constructor are executed at time of object creation of class.  --  there are no return type in java constructor --  An interface cannot have the constructor in java. --  Constructors cannot be private modifire. --  Constructors name must be similar to that of the class name.   There are 2 type of constructor in Java :     1) Default Constructor.  2) Parameterized constructor.     1) Default Constructor. --  A java constructor that has no parameter is known as default constructor. thats build by compiler. --  if we write a constructor with parameter or non-parameter then compiler does not create default constructor. example of default constructor : class JavaConstructor {        JavaConstructo
Read more