beautifulsoup4教程（四）css选择器

beautifulsoup4教程（一）基础知识和第一个爬虫

beautifulsoup4教程（二）bs4中四大对象

beautifulsoup4教程（三）遍历和搜索文档树

beautifulsoup4教程（四）css选择器

---

六、CSS选择器

6.1 通过标签名查找

print soup.select('title')print soup.select('a')print soup.select('b')result:[<title>The Dormouse's story</title>][<a class="sister" href="http://example.com/elsie" id="link1"><!-- Elsie --></a>, <a class="sister" href="http://example.com/lacie" id="link2">Lacie</a>, <a class="sister" href="http://example.com/tillie" id="link3">Tillie</a>][<b>The Dormouse's story</b>]

6.2 通过类名查找

print soup.select('.story')result:[<p class="story">Once upon a time there were three little sisters; and their names were\n<a class="sister" href="http://example.com/elsie" id="link1"><!-- Elsie --></a>,\n<a class="sister" href="http://example.com/lacie" id="link2">Lacie</a> and\n<a class="sister" href="http://example.com/tillie" id="link3">Tillie</a>;\nand they lived at the bottom of a well.</p>, <p class="story">...</p>]

6.3 通过id名查找

print soup.select('#link1')result:print soup.select('#link1')

6.4 组合查找

多个过滤条件需要用空格隔开,从前往后是逐层筛选，选择器作用的不是 同一个结点。

print soup.select('p #link1')print soup.select('a #link1')result:[<a class="sister" href="http://example.com/elsie" id="link1"><!-- Elsie --></a>][]

通过下面这种方式会更好理解

print soup.select('p >#link1')print soup.select('a >#link1')result:[<a class="sister" href="http://example.com/elsie" id="link1"><!-- Elsie --></a>][]

6.5 属性查找

print soup.select('p >a')print soup.select('p >a[href="http://example.com/tillie"]')result:[<a class="sister" href="http://example.com/elsie" id="link1"><!-- Elsie --></a>, <a class="sister" href="http://example.com/lacie" id="link2">Lacie</a>, <a class="sister" href="http://example.com/tillie" id="link3">Tillie</a>][<a class="sister" href="http://example.com/tillie" id="link3">Tillie</a>]

6.6 列表迭代

• 通过上述方法返回的都是列表，是可迭代对象。

print soup.select('p >a')print type(soup.select('p >a'))print "===="print soup.select('p >a')[0]print "===="for a in soup.select('p >a'):    print a    result:[<a class="sister" href="http://example.com/elsie" id="link1"><!-- Elsie --></a>, <a class="sister" href="http://example.com/lacie" id="link2">Lacie</a>, <a class="sister" href="http://example.com/tillie" id="link3">Tillie</a>]<type 'list'>====<a class="sister" href="http://example.com/elsie" id="link1"><!-- Elsie --></a>====<a class="sister" href="http://example.com/elsie" id="link1"><!-- Elsie --></a><a class="sister" href="http://example.com/lacie" id="link2">Lacie</a><a class="sister" href="http://example.com/tillie" id="link3">Tillie</a>