How to get all links of any website using Python

-
This code will extract all links form the website and will show to you

Requirements

1)    beautifulsoup4
2)    requests

Steps to install requirements

1) open cmd as admin
2) Type pip install beautifulsoup4
3) wait for installation
4) after completion of installation type pip install requests
5) wait for installation completion

Code

import requests
from bs4 import BeautifulSoup
url = "https://www.python.org"

links = []
website = requests.get(url)
website_text = website.text
soup = BeautifulSoup(website_text)
for link in soup.findAll('a'):
    links.append(link.get('href'))
for link in links:
    if not link:
        pass
    elif "http" in link :
        print(link)
    else:
        print(url+link)
print(len(links))


Comment down queries below if any are there

Comments

Post a Comment

Popular posts from this blog

Never Ending Loop but when will end doesn't know program in python

-
Image
About the Program In this program we are going to code the simple python program with loop. But a catch is when the loop will terminate no one knows maybe never maybe in 5 minutes or maybe in 5 sec  Program import random  a = 137  print(a)  b = 0  while True:      b+=1      r=random.randint(1,10000000000)      print(str(b)+" "+str(r))      if r==a:          print(r," is succesfully founded")          break  What is happening with the code  The code is going into the loop and in loop it is taking a random number and checking with our initialized number if found it gets exit comment down the number when your loops gets exit. tip :- to execute program fast just change the    r=random.randint(1,10000000000) to     r=random.randint(1,1000) 
Read more

Rectangle with pencil in paint with the help of Python programming

-
Image
How to create rectangle with the help of pencil in python as per below? Here is the answer. Requirements :- PYAUTOGUI Library of the Python  Code import pyautogui import time pyautogui.moveTo(320,320) time.sleep(0.1) pyautogui.mouseDown() x=320 y=320 while y<=420: pyautogui.moveTo(x,y) while x<=540: x=x+110 pyautogui.moveTo(x,y) x=320 y=y+1 pyautogui.mouseUp() Steps to perform operation: !)     Open Visual Studio Code (if not installed download from here ) 2)     Create python file then Copy and paste the code 3)     Open paint -> select pencil or brush and arrange window as given below 4)     Run the code . 5)     wait for the code to stop Done ! you had drawn rectangle with the help of the pencil comment down below for any query. (Caution : Modifying code can make code operate in infinite loop so perform operation with caution)
Read more