文章詳情頁

python beautiful soup庫入門安裝教程

瀏覽：2日期：2022-08-06 18:29:08

目錄beautiful soup庫的安裝beautiful soup庫的理解beautiful soup庫的引用BeautifulSoup類回顧demo.htmlTag標簽Tag的nameTag的attrs（屬性）Tag的NavigableStringHTML基本格式標簽樹的下行遍歷標簽樹的上行遍歷標簽的平行遍歷bs庫的prettify()方法bs4庫的編碼beautiful soup庫的安裝

pip install beautifulsoup4beautiful soup庫的理解

beautiful soup庫是解析、遍歷、維護“標簽樹”的功能庫

beautiful soup庫的引用

from bs4 import BeautifulSoupimport bs4BeautifulSoup類

BeautifulSoup對應一個HTML/XML文檔的全部內(nèi)容

回顧demo.html

import requestsr = requests.get('http://python123.io/ws/demo.html')demo = r.textprint(demo)

<html><head><title>This is a python demo page</title></head><body>The demo python introduces several python courses.Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a id='link1'>Basic Python</a> and <a id='link2'>Advanced Python</a>.</body></html>Tag標簽

基本元素說明 Tag 標簽，最基本的信息組織單元，分別用<>和</>標明開頭和結(jié)尾

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.title)tag = soup.aprint(tag)

<title>This is a python demo page</title><a >Basic Python</a>

任何存在于HTML語法中的標簽都可以用soup.訪問獲得。當HTML文檔中存在多個相同對應內(nèi)容時，soup.返回第一個

Tag的name

基本元素說明 Name 標簽的名字，

…

的名字是’p’,格式：.name

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.a.name)print(soup.a.parent.name)print(soup.a.parent.parent.name)

ap bodyTag的attrs（屬性）

基本元素說明 Attributes 標簽的屬性，字典形式組織，格式：.attrs

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')tag = soup.aprint(tag.attrs)print(tag.attrs[’class’])print(tag.attrs[’href’])print(type(tag.attrs))print(type(tag))

{’href’: ’http://www.icourse163.org/course/BIT-268001’, ’class’: [’py1’], ’id’: ’link1’}[’py1’]http://www.icourse163.org/course/BIT-268001<class ’dict’><class ’bs4.element.Tag’>Tag的NavigableString

Tag的NavigableString

基本元素說明 NavigableString 標簽內(nèi)非屬性字符串，<>…</>中字符串，格式：.string

Tag的Comment

基本元素說明 Comment 標簽內(nèi)字符串的注釋部分，一種特殊的Comment類型

import requestsfrom bs4 import BeautifulSoupnewsoup = BeautifulSoup('This is not a comment','html.parser')print(newsoup.b.string)print(type(newsoup.b.string))print(newsoup.p.string)print(type(newsoup.p.string))

This is a comment<class ’bs4.element.Comment’>This is not a comment<class ’bs4.element.NavigableString’>HTML基本格式標簽樹的下行遍歷

屬性說明 .contents 子節(jié)點的列表，將所有兒子結(jié)點存入列表 .children 子節(jié)點的迭代類型，與.contents類似，用于循環(huán)遍歷兒子結(jié)點 .descendents 子孫節(jié)點的迭代類型，包含所有子孫節(jié)點，用于循環(huán)遍歷

BeautifulSoup類型是標簽樹的根節(jié)點

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.head)print(soup.head.contents)print(soup.body.contents)print(len(soup.body.contents))print(soup.body.contents[1])

<head><title>This is a python demo page</title></head>[<title>This is a python demo page</title>][’n’, The demo python introduces several python courses., ’n’, Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a >Basic Python</a> and <a >Advanced Python</a>., ’n’]5The demo python introduces several python courses.

for child in soup.body.children:print(child) #遍歷兒子結(jié)點for child in soup.body.descendants:print(child) #遍歷子孫節(jié)點標簽樹的上行遍歷

屬性說明 .parent 節(jié)點的父親標簽 .parents 節(jié)點先輩標簽的迭代類型，用于循環(huán)遍歷先輩節(jié)點

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.title.parent)print(soup.html.parent)

<head><title>This is a python demo page</title></head><html><head><title>This is a python demo page</title></head><body>The demo python introduces several python courses.Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a >Basic Python</a> and <a >Advanced Python</a>.</body></html>

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')for parent in soup.a.parents: if parent is None:print(parent) else:print(parent.name)

pbody html [document]標簽的平行遍歷屬性說明 .next_sibling 返回按照HTML文本順序的下一個平行節(jié)點標簽 .previous.sibling 返回按照HTML文本順序的上一個平行節(jié)點標簽 .next_siblings 迭代類型，返回按照HTML文本順序的后續(xù)所有平行節(jié)點標簽 .previous.siblings 迭代類型，返回按照HTML文本順序的前續(xù)所有平行節(jié)點標簽

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.a.next_sibling)print(soup.a.next_sibling.next_sibling)print(soup.a.previous_sibling)print(soup.a.previous_sibling.previous_sibling)print(soup.a.parent)

and <a id='link2'>Advanced Python</a>Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:NonePython is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a id='link1'>Basic Python</a> and <a id='link2'>Advanced Python</a>.

for sibling in soup.a.next_sibling:print(sibling) #遍歷后續(xù)節(jié)點for sibling in soup.a.previous_sibling:print(sibling) #遍歷前續(xù)節(jié)點

python beautiful soup庫入門安裝教程

bs庫的prettify()方法

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.prettify())

<html> <head> <title> This is a python demo page </title> </head> <body> The demo python introduces several python courses. Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses: Basic Python </a> and <a id='link2'> Advanced Python </a> . </body></html>

.prettify()為HTML文本<>及其內(nèi)容增加更加’n’.prettify()可用于標簽，方法：.prettify()

bs4庫的編碼

bs4庫將任何HTML輸入都變成utf-8編碼python 3.x默認支持編碼是utf-8,解析無障礙

import requestsfrom bs4 import BeautifulSoupsoup = BeautifulSoup('中文','html.parser')print(soup.p.string)print(soup.p.prettify())

中文 中文

到此這篇關(guān)于python beautiful soup庫入門安裝教程的文章就介紹到這了,更多相關(guān)python beautiful soup庫入門內(nèi)容請搜索好吧啦網(wǎng)以前的文章或繼續(xù)瀏覽下面的相關(guān)文章希望大家以后多多支持好吧啦網(wǎng)！

Python 編程

上一條：Python BeautifulSoup基本用法詳解(通過標簽及class定位元素)下一條：Python torch.flatten()函數(shù)案例詳解

相關(guān)文章：

1. Python使用oslo.vmware管理ESXI虛擬機的示例參考2. Jsp servlet驗證碼工具類分享3. .NET6打包部署到Windows Service的全過程4. python GUI庫圖形界面開發(fā)之PyQt5滑塊條控件QSlider詳細使用方法與實例5. IntelliJ IDEA 好用插件之a(chǎn)nalyze inspect code詳解6. JetBrains IntelliJ IDEA 配置優(yōu)化技巧7. idea2020.1無法自動加載maven依賴的jar包問題及解決方法8. PHP程序員簡單的開展服務治理架構(gòu)操作詳解(一)9. vue項目中使用bpmn為節(jié)點添加顏色的方法10. 解決idea update project 更新選項消失的問題

排行榜

					
					Python使用oslo.vmware管理ESXI虛擬機的示例參考
Jsp servlet驗證碼工具類分享
解決Django提交表單報錯:CSRF token missing or incorrect的問題
.NET6打包部署到Windows Service的全過程
IntelliJ IDEA 好用插件之a(chǎn)nalyze inspect code詳解
JetBrains IntelliJ IDEA 配置優(yōu)化技巧
Django:使用filter的pk進行多值查詢操作
PHP程序員簡單的開展服務治理架構(gòu)操作詳解(一)
idea2020.1無法自動加載maven依賴的jar包問題及解決方法
解決idea update project 更新選項消失的問題
Intellij idea熱部署插件JRebel的使用
				