ex 12 - urllink

Last updated on October 25, 2022

https://www.youtube.com/embed/g9flPDG9nnY

# To run this, download the BeautifulSoup zip file
# http://www.py4e.com/code3/bs4.zip
# and unzip it in the same directory as this file

from urllib.request import urlopen
from bs4 import BeautifulSoup
import ssl

# Ignore SSL certificate errors
ctx = ssl.create_default_context()
ctx.check_hostname = False
ctx.verify_mode = ssl.CERT_NONE

url = input('Enter - ')
html = urlopen(url, context=ctx).read()
soup = BeautifulSoup(html, "html.parser")

# Retrieve all of the anchor tags
tags = soup('a')
for tag in tags:
    # Look at the parts of a tag
    print('TAG:', tag)
    print('URL:', tag.get('href', None))
    print('Contents:', tag.contents[0])
    print('Attrs:', tag.attrs)

remember to put bs4 in the same folder as the python file

Output

Warning (from warnings module):
  File "C:\Users\Admin\Firstpython\Exs\bs4\element.py", line 15
    warnings.warn(
UserWarning: The soupsieve package is not installed. CSS selectors cannot be used.
Enter - http://www.dr-chuck.com/
TAG: <a href="https://www.learnerprivacy.org/">
<img align="center" alt="Photo Credit: Brent Severance" src="Chuck_Square_B&amp;W.jpg" style="border: white 2px solid;" width="160"/>
</a>
URL: https://www.learnerprivacy.org/
Contents: 

Attrs: {'href': 'https://www.learnerprivacy.org/'}
TAG: <a href="https://www.si.umich.edu/" target="_blank">School of Information</a>
URL: https://www.si.umich.edu/
Contents: School of Information
Attrs: {'href': 'https://www.si.umich.edu/', 'target': '_blank'}
TAG: <a href="https://www.ratemyprofessors.com/ShowRatings.jsp?tid=1159280" target="_blank">
<img alt="Rate This Professor" src="/images/rate-my-professor.jpg" width="140"/></a>
URL: https://www.ratemyprofessors.com/ShowRatings.jsp?tid=1159280
Contents: 

Attrs: {'href': 'https://www.ratemyprofessors.com/ShowRatings.jsp?tid=1159280', 'target': '_blank'}
TAG: <a href="https://www.learnerprivacy.org">Podcast</a>
URL: https://www.learnerprivacy.org
Contents: Podcast
Attrs: {'href': 'https://www.learnerprivacy.org'}
TAG: <a href="https://www.dr-chuck.com/csev-blog/">Blog</a>
URL: https://www.dr-chuck.com/csev-blog/
Contents: Blog
Attrs: {'href': 'https://www.dr-chuck.com/csev-blog/'}
TAG: <a href="https://www.twitter.com/drchuck/" target="_blank">@drchuck Twitter</a>
URL: https://www.twitter.com/drchuck/
Contents: @drchuck Twitter
Attrs: {'href': 'https://www.twitter.com/drchuck/', 'target': '_blank'}
TAG: <a href="https://www.dr-chuck.com/dr-chuck/resume/speaking.htm" target="_blank">Keynote Speaker</a>
URL: https://www.dr-chuck.com/dr-chuck/resume/speaking.htm
Contents: Keynote Speaker
Attrs: {'href': 'https://www.dr-chuck.com/dr-chuck/resume/speaking.htm', 'target': '_blank'}
TAG: <a href="https://www.slideshare.net/csev" target="_blank">Slideshare</a>
URL: https://www.slideshare.net/csev
Contents: Slideshare
Attrs: {'href': 'https://www.slideshare.net/csev', 'target': '_blank'}
TAG: <a href="/dr-chuck/resume/index.htm" target="_blank">Resume and Bio</a>
URL: /dr-chuck/resume/index.htm
Contents: Resume and Bio
Attrs: {'href': '/dr-chuck/resume/index.htm', 'target': '_blank'}
TAG: <a href="https://amzn.to/1K5Q81K" target="_blank">Amazon Author Page</a>
URL: https://amzn.to/1K5Q81K
Contents: Amazon Author Page
Attrs: {'target': '_blank', 'href': 'https://amzn.to/1K5Q81K'}
TAG: <a href="https://www.coursera.org/instructor/drchuck" target="_blank">My Coursera Page</a>
URL: https://www.coursera.org/instructor/drchuck
Contents: My Coursera Page
Attrs: {'target': '_blank', 'href': 'https://www.coursera.org/instructor/drchuck'}
TAG: <a href="http://afs.dr-chuck.com/papers/" target="_blank">Chuck's Papers</a>
URL: http://afs.dr-chuck.com/papers/
Contents: Chuck's Papers
Attrs: {'href': 'http://afs.dr-chuck.com/papers/', 'target': '_blank'}
TAG: <a href="https://itunes.apple.com/us/podcast/computing-conversations/id731495760" target="_blank">IEEE Audio Podcast</a>
URL: https://itunes.apple.com/us/podcast/computing-conversations/id731495760
Contents: IEEE Audio Podcast
Attrs: {'href': 'https://itunes.apple.com/us/podcast/computing-conversations/id731495760', 'target': '_blank'}
TAG: <a href="https://www.youtube.com/playlist?list=PLHJB2bhmgB7dFuY7HmrXLj5BmHGKTD-3R" target="_blank">IEEE Video Interviews</a>
URL: https://www.youtube.com/playlist?list=PLHJB2bhmgB7dFuY7HmrXLj5BmHGKTD-3R
Contents: IEEE Video Interviews
Attrs: {'href': 'https://www.youtube.com/playlist?list=PLHJB2bhmgB7dFuY7HmrXLj5BmHGKTD-3R', 'target': '_blank'}
TAG: <a href="https://developers.imsglobal.org/" target="_blank">IMS LTI</a>
URL: https://developers.imsglobal.org/
Contents: IMS LTI
Attrs: {'href': 'https://developers.imsglobal.org/', 'target': '_blank'}
TAG: <a href="https://www.youtube.com/user/csev" target="_blank">YouTube Channel </a>
URL: https://www.youtube.com/user/csev
Contents: YouTube Channel 
Attrs: {'href': 'https://www.youtube.com/user/csev', 'target': '_blank'}
TAG: <a href="https://vimeo.com/drchuck/videos" target="_blank">Video on Vimeo</a>
URL: https://vimeo.com/drchuck/videos
Contents: Video on Vimeo
Attrs: {'href': 'https://vimeo.com/drchuck/videos', 'target': '_blank'}
TAG: <a href="https://backpack.openbadges.org/share/4f76699ddb399d162a00b89a452074b3/" target="_blank">My Open Badges</a>
URL: https://backpack.openbadges.org/share/4f76699ddb399d162a00b89a452074b3/
Contents: My Open Badges
Attrs: {'href': 'https://backpack.openbadges.org/share/4f76699ddb399d162a00b89a452074b3/', 'target': '_blank'}
TAG: <a href="https://www.linkedin.com/in/charlesseverance/" target="_blank">
<img alt="View Chuck Severance's profile on LinkedIn" border="0" height="33" src="https://www.linkedin.com/img/webpromo/btn_viewmy_120x33.png" width="120"/>
</a>
URL: https://www.linkedin.com/in/charlesseverance/
Contents: 

Attrs: {'href': 'https://www.linkedin.com/in/charlesseverance/', 'target': '_blank'}
TAG: <a href="https://www.researchgate.net/profile/Charles_Severance/" target="_blank" title="Charles R. Severance"><img alt="Charles R. Severance" src="https://www.researchgate.net/images/public/profile_share_badge.png"/></a>
URL: https://www.researchgate.net/profile/Charles_Severance/
Contents: <img alt="Charles R. Severance" src="https://www.researchgate.net/images/public/profile_share_badge.png"/>
Attrs: {'title': 'Charles R. Severance', 'href': 'https://www.researchgate.net/profile/Charles_Severance/', 'target': '_blank'}
TAG: <a href="https://www.learnerprivacy.org/" target="_blank">My LearnerPrivacy.org podcast</a>
URL: https://www.learnerprivacy.org/
Contents: My LearnerPrivacy.org podcast
Attrs: {'href': 'https://www.learnerprivacy.org/', 'target': '_blank'}
TAG: <a href="https://www.py4e.com/" target="_blank">Python for Everybody</a>
URL: https://www.py4e.com/
Contents: Python for Everybody
Attrs: {'href': 'https://www.py4e.com/', 'target': '_blank'}
TAG: <a href="https://www.dj4e.com/" target="_blank">Django for Everybody</a>
URL: https://www.dj4e.com/
Contents: Django for Everybody
Attrs: {'href': 'https://www.dj4e.com/', 'target': '_blank'}
TAG: <a href="https://www.wa4e.com/" target="_blank">Web Applications for Everybody</a>
URL: https://www.wa4e.com/
Contents: Web Applications for Everybody
Attrs: {'href': 'https://www.wa4e.com/', 'target': '_blank'}
TAG: <a href="https://www.coursera.org/course/insidetheinternet" target="_blank">Internet History, Technnology and Security</a>
URL: https://www.coursera.org/course/insidetheinternet
Contents: Internet History, Technnology and Security
Attrs: {'href': 'https://www.coursera.org/course/insidetheinternet', 'target': '_blank'}
TAG: <a href="https://www.sakaiproject.org/" target="_blank">The Sakai Collaboration
and Learning Environment</a>
URL: https://www.sakaiproject.org/
Contents: The Sakai Collaboration
and Learning Environment
Attrs: {'href': 'https://www.sakaiproject.org/', 'target': '_blank'}
TAG: <a href="https://www.tsugi.org/" target="_blank">Tsugi: A framework for learning tools</a>
URL: https://www.tsugi.org/
Contents: Tsugi: A framework for learning tools
Attrs: {'href': 'https://www.tsugi.org/', 'target': '_blank'}
TAG: <a href="https://developers.imsglobal.org/" target="_blank">IMS Learning Tools
Interoperability</a>
URL: https://developers.imsglobal.org/
Contents: IMS Learning Tools
Interoperability
Attrs: {'href': 'https://developers.imsglobal.org/', 'target': '_blank'}
TAG: <a href="http://www.py4e.com/book" target="_blank">Python For Everybody: Exploring Data in Python 3</a>
URL: http://www.py4e.com/book
Contents: Python For Everybody: Exploring Data in Python 3
Attrs: {'href': 'http://www.py4e.com/book', 'target': '_blank'}
TAG: <a href="/sakai-book">Sakai: Building an Open Source Community</a>
URL: /sakai-book
Contents: Sakai: Building an Open Source Community
Attrs: {'href': '/sakai-book'}
TAG: <a href="http://www.amazon.com/gp/product/1624311393/ref=as_li_ss_tl?ie=UTF8&amp;camp=1789&amp;creative=390957&amp;creativeASIN=1624311393&amp;linkCode=as2&amp;tag=drchu02-20" target="_blank">Raspberry Pi (21st Century Skills Innovation Library)</a>
URL: http://www.amazon.com/gp/product/1624311393/ref=as_li_ss_tl?ie=UTF8&camp=1789&creative=390957&creativeASIN=1624311393&linkCode=as2&tag=drchu02-20
Contents: Raspberry Pi (21st Century Skills Innovation Library)
Attrs: {'href': 'http://www.amazon.com/gp/product/1624311393/ref=as_li_ss_tl?ie=UTF8&camp=1789&creative=390957&creativeASIN=1624311393&linkCode=as2&tag=drchu02-20', 'target': '_blank'}
TAG: <a href="http://www.amazon.com/gp/product/059680069X/ref=as_li_ss_tl?ie=UTF8&amp;camp=1789&amp;creative=390957&amp;creativeASIN=059680069X&amp;linkCode=as2&amp;tag=drchu02-20" target="_blank">Using Google App Engine</a>
URL: http://www.amazon.com/gp/product/059680069X/ref=as_li_ss_tl?ie=UTF8&camp=1789&creative=390957&creativeASIN=059680069X&linkCode=as2&tag=drchu02-20
Contents: Using Google App Engine
Attrs: {'href': 'http://www.amazon.com/gp/product/059680069X/ref=as_li_ss_tl?ie=UTF8&camp=1789&creative=390957&creativeASIN=059680069X&linkCode=as2&tag=drchu02-20', 'target': '_blank'}
TAG: <a href="http://www.amazon.com/Performance-Computing-Architectures-Optimization-Benchmarks/dp/156592312X/" target="_blank">High Performance Computing</a>
URL: http://www.amazon.com/Performance-Computing-Architectures-Optimization-Benchmarks/dp/156592312X/
Contents: High Performance Computing
Attrs: {'href': 'http://www.amazon.com/Performance-Computing-Architectures-Optimization-Benchmarks/dp/156592312X/', 'target': '_blank'}
TAG: <a href="http://oreilly.com/catalog/9781565923126/" target="_blank">O'Reilly 1998</a>
URL: http://oreilly.com/catalog/9781565923126/
Contents: O'Reilly 1998
Attrs: {'href': 'http://oreilly.com/catalog/9781565923126/', 'target': '_blank'}
TAG: <a href="http://cnx.org/content/col11136/latest/" target="_blank">Connexions 2010</a>
URL: http://cnx.org/content/col11136/latest/
Contents: Connexions 2010
Attrs: {'href': 'http://cnx.org/content/col11136/latest/', 'target': '_blank'}
TAG: <a href="http://www.youtube.com/playlist?list=PLHJB2bhmgB7dFuY7HmrXLj5BmHGKTD-3R" target="_blank">
IEEE Computer - Computing Conversations Interviews</a>
URL: http://www.youtube.com/playlist?list=PLHJB2bhmgB7dFuY7HmrXLj5BmHGKTD-3R
Contents: 
IEEE Computer - Computing Conversations Interviews
Attrs: {'href': 'http://www.youtube.com/playlist?list=PLHJB2bhmgB7dFuY7HmrXLj5BmHGKTD-3R', 'target': '_blank'}
TAG: <a href="https://www.vimeo.com/17207620" target="_blank">
Dr. Chuck sings the blues </a>
URL: https://www.vimeo.com/17207620
Contents: 
Dr. Chuck sings the blues 
Attrs: {'href': 'https://www.vimeo.com/17207620', 'target': '_blank'}
TAG: <a href="https://www.youtube.com/watch?v=BVKpW02hsrU" target="_blank">
Dr. Chuck goes motocross racing</a>
URL: https://www.youtube.com/watch?v=BVKpW02hsrU
Contents: 
Dr. Chuck goes motocross racing
Attrs: {'href': 'https://www.youtube.com/watch?v=BVKpW02hsrU', 'target': '_blank'}
TAG: <a href="https://www.youtube.com/watch?v=sa2WsgCvn7c" target="_blank">
A Film About Brent and His ATV
</a>
URL: https://www.youtube.com/watch?v=sa2WsgCvn7c
Contents: 
A Film About Brent and His ATV

Attrs: {'href': 'https://www.youtube.com/watch?v=sa2WsgCvn7c', 'target': '_blank'}
TAG: <a href="https://www.vimeo.com/17213019" target="_blank">
Audition Tape</a>
URL: https://www.vimeo.com/17213019
Contents: 
Audition Tape
Attrs: {'href': 'https://www.vimeo.com/17213019', 'target': '_blank'}
TAG: <a href="https://www.youtube.com/watch?v=FJ078sO35M0" target="_blank">
Dr. Chuck goes stock car racing</a>
URL: https://www.youtube.com/watch?v=FJ078sO35M0
Contents: 
Dr. Chuck goes stock car racing
Attrs: {'href': 'https://www.youtube.com/watch?v=FJ078sO35M0', 'target': '_blank'}
TAG: <a href="http://afs.dr-chuck.com/citoolkit" target="_blank">
The Community Information Toolkit</a>
URL: http://afs.dr-chuck.com/citoolkit
Contents: 
The Community Information Toolkit
Attrs: {'href': 'http://afs.dr-chuck.com/citoolkit', 'target': '_blank'}
TAG: <a class="twitter-timeline" data-widget-id="282172185219567616" href="https://twitter.com/drchuck">Tweets by @drchuck</a>
URL: https://twitter.com/drchuck
Contents: Tweets by @drchuck
Attrs: {'class': ['twitter-timeline'], 'href': 'https://twitter.com/drchuck', 'data-widget-id': '282172185219567616'}
>>>

Notes mentioning this note

Python

Open all notes in NOTION

ex 12 - urllink

Output

Notes mentioning this note

ນີ້ຄືກຣາຟທີ່ລິ້ງໄປຫາທຸກໜ້າໃນ garden ນີ້ 🕸️.