beautifulsoup scraping paragraphs from html

Solutions on MaxInterview for beautifulsoup scraping paragraphs from html by the best coders in the world

Search
showing results for - "beautifulsoup scraping paragraphs from html"
Claudia
30 Aug 2018
1from bs4 import BeautifulSoup
2
3# Simple HTML
4SIMPLE_HTML = '''<html>
5<head></head>
6<body>
7<h1>This is a title</h1>
8<p class="subtitle">Lorem ipsum dolor sit amet.</p>
9<p>Here's another p without a class</p>
10<ul>
11    <li>Sarah</li>
12    <li>Mary</li>
13    <li>Charlotte</li>
14    <li>Carl</li>
15</ul>
16</body>
17</html>'''
18
19simple_soup = BeautifulSoup(SIMPLE_HTML, 'html.parser')      # use html.parser in order to understand the simple HTML
20
21# Find paragraph
22def find_paragraph():
23    print(simple_soup.find('p', {'class': 'subtitle'}).string)
24
25
26def find_other_paragraph():
27    paragraphs = simple_soup.find_all('p')                                                     # give all the paragraphs
28    other_paragraph = [p for p in paragraphs if 'subtitle' not in p.attrs.get('class', [])]    # iterate over the paragraphs and give back if not a class paragraph
29    print(other_paragraph[0].string)                                                           # attrs.get() give back None if paragraph not found
30                                                                                               # instead of None we return an empty list [] is case paragraph not found
31    
32find_paragraph() 
33find_other_paragraph()
source
similar questions
use beautifulsoup or scrapy to scrape a book storeget all paragraph tags beautifulsoupgetting heading from a webpage in beautifulsoupwebbscraping website with beautifulsoupbeautifulsoup scraping list from htmlget website content with beautifulsoupbeautifulsoup getting data from a websitescrapy get text custom tagsbeautifulsoup 28raw htmlhow to extract data from website using beautifulsoupscrape all the p tags in a pythonscrapy pass string as htmlhow to scrape data from a html page saved locallybeautifulsoup python set text
queries leading to this page
beautifulsoup shrink html as you scrape itaccess video file with beautifulsoupbeautifulsoup scrape htmlbeautifulsoup scrap from article tagbeautifulsoup to scrape htmlhow to scrape paragraph from bneautifulsoupscraping article beautifulsouphow to scrape the a tag by using beautifulsoupbeautifulsoup scrape textbeautiful soup scrape script tagscrape paragraphs beautifulsoupweb scraping to scrape text of a website using beautifulsouphow to used sam ocde multiple times for scrappig using beautiful soupbeautifulsoup web scrape textidentify the name of the most recently added data sets using beautifulsouphow to scrape a website which loads after some time bs4scrape text with beautifulsoupbs4 webscraping examplebeautiful soup text scrapescrape paragraph only in beautifulsoupbeautiful soup web scraping get real textbeautiful soup scrape textaeahow to scrape html with beautifulsoupextract paragraphs from web page beautifulsoupweb scraping second paragprahscrape all paragraphs only in beautifulsoupscrape a website using beautiful soup get all the text in a websitescraping text with beautifulsoupbeautiful soup scrape for tag with texthow to scrape the p tag by using beautifulsoupbeautifulsoup scraping paragraphs from html