Python: Get the top stories from Google news

Python Basic - 1: Exercise-8 with Solution

Write a Python program that retrieves the top stories from Google News.

Sample Solution:

Python Code :

import bs4
from bs4 import BeautifulSoup as soup
from urllib.request import urlopen

news_url="https://news.google.com/news/rss"
Client=urlopen(news_url)
xml_page=Client.read()
Client.close()

soup_page=soup(xml_page,"xml")
news_list=soup_page.findAll("item")
# Print news title, url and publish date
for news in news_list:
  print(news.title.text)
  print(news.link.text)
  print(news.pubDate.text)
  print("-"*60)

Sample Output:

With Trump in China, Taiwan worries about becoming a 'bargaining chip'
https://www.washingtonpost.com/world/with-trump-in-china-taiwan-worries-about-becoming-abargaining-chip/2017/11/09/ee3c0126-c4af-11e7-9922-4151f5ca6168_story.html
Thu, 9 Nov 2017 11:19:13 GMT
------------------------------------------------------------
Blue Dog Democrats taking hard line on GOP tax bill
http://thehill.com/policy/finance/359515-blue-dog-democrats-taking-hard-line-on-gop-tax-bill
Thu, 9 Nov 2017 11:01:58 GMT
------------------------------------------------------------
A Year Later, The Shock Of Trump's Win Hasn't Totally Worn Off In Either Party
https://www.npr.org/2017/11/09/562307566/a-year-later-the-shock-of-trumps-win-hasn-t-totally-worn-off-in-either-party
Thu, 9 Nov 2017 10:02:21 GMT
------------------------------------------------------------
In a Texas town overwhelmed with grief, Pence delivers a message of support and faith
http://www.latimes.com/nation/la-na-texas-shooting-pence-vigil-20171108-story.html
Thu, 9 Nov 2017 04:50:00 GMT
------------------------------------------------------------
US, AT&T at odds over CNN in Time Warner deal
http://www.reuters.com/article/us-time-warner-m-a/u-s-demands-cnn-or-directv-sale-to-approve-att-time-warner-deal-sources-idUSKBN1D81Z8
Thu, 9 Nov 2017 00:20:52 GMT
------------------------------------------------------------
Self-driving bus crashes two hours after launch in Las Vegas
http://www.zdnet.com/article/self-driving-bus-crashes-two-hours-after-launch-in-las-vegas/
Thu, 9 Nov 2017 00:18:00 GMT
------------------------------------------------------------
2017 CMA Awards Preach Unity, Crown Garth Brooks Entertainer of the Year
http://www.rollingstone.com/country/news/2017-cma-awards-preach-unity-crown-garth-brooks-entertainer-w511375
Thu, 9 Nov 2017 08:23:59 GMT
------------------------------------------------------------
Spacey Cut From Film; Scenes To Be Re-Shot With Replacement Actor
https://www.npr.org/sections/thetwo-way/2017/11/09/562995171/spacey-cut-from-film-scenes-to-be-re-shot-with-replacement-actor
Thu, 9 Nov 2017 09:57:00 GMT
------------------------------------------------------------
FEMA to transport Puerto Rico's hurricane survivors to US mainland
http://www.cnn.com/2017/11/09/us/fema-puerto-rico-transport/index.html
Thu, 9 Nov 2017 10:48:23 GMT
------------------------------------------------------------
Trump and Putin to meet on Friday in Vietnam
http://www.nydailynews.com/news/world/trump-putin-meet-friday-vietnam-article-1.3620846
Thu, 9 Nov 2017 08:18:23 GMT
------------------------------------------------------------
Syria war: Army retakes last IS urban stronghold
http://www.bbc.com/news/world-middle-east-41918913
Thu, 9 Nov 2017 11:26:15 GMT
------------------------------------------------------------
The Saudi Purge Isn't Just a Power Grab
https://www.bloomberg.com/news/articles/2017-11-09/the-saudi-purge-isn-t-just-a-power-grab
Thu, 9 Nov 2017 09:15:34 GMT
------------------------------------------------------------
Trump Tightens Cuba Embargo, Restricting Access to Hotels and Businesses
https://www.nytimes.com/2017/11/08/us/politics/trump-tightens-cuba-embargo-restricting-access-to-hotels-businesses.html
Wed, 8 Nov 2017 17:16:11 GMT
------------------------------------------------------------
Battered by Trump, Obamacare triumphs at the polls
https://www.politico.com/story/2017/11/08/obamacare-boost-at-the-polls-244696
Wed, 8 Nov 2017 18:17:39 GMT
------------------------------------------------------------
Terry Crews Confirms He Filed a Police Report After Making Sexual Assault Allegations
http://people.com/movies/terry-crews-confirms-he-filed-a-police-report-after-making-sexual-assault-allegations/
Thu, 9 Nov 2017 03:07:24 GMT
------------------------------------------------------------
Former party chief Donna Brazile stokes divisions among Democrats
http://www.latimes.com/nation/la-na-pol-donna-brazile-democrats-20171109-story.html
Thu, 9 Nov 2017 11:01:37 GMT
------------------------------------------------------------
Theresa May faces fresh reshuffle after Priti Patel resignation
http://www.bbc.com/news/uk-politics-41923670
Thu, 9 Nov 2017 07:41:24 GMT
------------------------------------------------------------
Barack Obama has to report to jury duty, too. (He didn't get picked.)
https://www.washingtonpost.com/news/politics/wp/2017/11/08/barack-obama-has-to-report-to-jury-duty-too-he-didnt-get-picked/
Wed, 8 Nov 2017 20:58:25 GMT
------------------------------------------------------------
Report: Goodell “furious” about push for incentive-base deal
http://profootballtalk.nbcsports.com/2017/11/08/report-goodell-furious-about-push-for-incentive-base-deal/
Thu, 9 Nov 2017 03:41:00 GMT
------------------------------------------------------------
Danica Roem of Virginia to be first openly transgender person elected, seated in a US statehouse
https://www.washingtonpost.com/local/virginia-politics/danica-roem-will-be-vas-first-openly-transgender-elected-official-after-unseating-conservative-robert-g-marshall-in-house-race/2017/11/07/d534bdde-c0af-11e7-959c-fe2b598d8c00_story.html
Wed, 8 Nov 2017 19:37:57 GMT
------------------------------------------------------------

Flowchart:

Python Code Editor :

Have another way to solve this solution? Contribute your code (and comments) through Disqus.

Previous: Write a Python program to count the number of each character of a text file.
Next: Write a Python program to get a list of locally installed Python modules.