w3resource

Python: Get the top stories from Google news

Python Basic - 1: Exercise-8 with Solution

Write a Python program to get the top stories from Google news.

Sample Solution:

Python Code :

import bs4
from bs4 import BeautifulSoup as soup
from urllib.request import urlopen

news_url="https://news.google.com/news/rss"
Client=urlopen(news_url)
xml_page=Client.read()
Client.close()

soup_page=soup(xml_page,"xml")
news_list=soup_page.findAll("item")
# Print news title, url and publish date
for news in news_list:
  print(news.title.text)
  print(news.link.text)
  print(news.pubDate.text)
  print("-"*60)

Sample Output:

With Trump in China, Taiwan worries about becoming a 'bargaining chip'
https://www.washingtonpost.com/world/with-trump-in-china-taiwan-worries-about-becoming-abargaining-chip/2017/11/09/ee3c0126-c4af-11e7-9922-4151f5ca6168_story.html
Thu, 9 Nov 2017 11:19:13 GMT
------------------------------------------------------------
Blue Dog Democrats taking hard line on GOP tax bill
http://thehill.com/policy/finance/359515-blue-dog-democrats-taking-hard-line-on-gop-tax-bill
Thu, 9 Nov 2017 11:01:58 GMT
------------------------------------------------------------
A Year Later, The Shock Of Trump's Win Hasn't Totally Worn Off In Either Party
https://www.npr.org/2017/11/09/562307566/a-year-later-the-shock-of-trumps-win-hasn-t-totally-worn-off-in-either-party
Thu, 9 Nov 2017 10:02:21 GMT
------------------------------------------------------------
In a Texas town overwhelmed with grief, Pence delivers a message of support and faith
http://www.latimes.com/nation/la-na-texas-shooting-pence-vigil-20171108-story.html
Thu, 9 Nov 2017 04:50:00 GMT
------------------------------------------------------------
US, AT&T at odds over CNN in Time Warner deal
http://www.reuters.com/article/us-time-warner-m-a/u-s-demands-cnn-or-directv-sale-to-approve-att-time-warner-deal-sources-idUSKBN1D81Z8
Thu, 9 Nov 2017 00:20:52 GMT
------------------------------------------------------------
Self-driving bus crashes two hours after launch in Las Vegas
http://www.zdnet.com/article/self-driving-bus-crashes-two-hours-after-launch-in-las-vegas/
Thu, 9 Nov 2017 00:18:00 GMT
------------------------------------------------------------
2017 CMA Awards Preach Unity, Crown Garth Brooks Entertainer of the Year
http://www.rollingstone.com/country/news/2017-cma-awards-preach-unity-crown-garth-brooks-entertainer-w511375
Thu, 9 Nov 2017 08:23:59 GMT
------------------------------------------------------------
Spacey Cut From Film; Scenes To Be Re-Shot With Replacement Actor
https://www.npr.org/sections/thetwo-way/2017/11/09/562995171/spacey-cut-from-film-scenes-to-be-re-shot-with-replacement-actor
Thu, 9 Nov 2017 09:57:00 GMT
------------------------------------------------------------
FEMA to transport Puerto Rico's hurricane survivors to US mainland
http://www.cnn.com/2017/11/09/us/fema-puerto-rico-transport/index.html
Thu, 9 Nov 2017 10:48:23 GMT
------------------------------------------------------------
Trump and Putin to meet on Friday in Vietnam
http://www.nydailynews.com/news/world/trump-putin-meet-friday-vietnam-article-1.3620846
Thu, 9 Nov 2017 08:18:23 GMT
------------------------------------------------------------
Syria war: Army retakes last IS urban stronghold
http://www.bbc.com/news/world-middle-east-41918913
Thu, 9 Nov 2017 11:26:15 GMT
------------------------------------------------------------
The Saudi Purge Isn't Just a Power Grab
https://www.bloomberg.com/news/articles/2017-11-09/the-saudi-purge-isn-t-just-a-power-grab
Thu, 9 Nov 2017 09:15:34 GMT
------------------------------------------------------------
Trump Tightens Cuba Embargo, Restricting Access to Hotels and Businesses
https://www.nytimes.com/2017/11/08/us/politics/trump-tightens-cuba-embargo-restricting-access-to-hotels-businesses.html
Wed, 8 Nov 2017 17:16:11 GMT
------------------------------------------------------------
Battered by Trump, Obamacare triumphs at the polls
https://www.politico.com/story/2017/11/08/obamacare-boost-at-the-polls-244696
Wed, 8 Nov 2017 18:17:39 GMT
------------------------------------------------------------
Terry Crews Confirms He Filed a Police Report After Making Sexual Assault Allegations
http://people.com/movies/terry-crews-confirms-he-filed-a-police-report-after-making-sexual-assault-allegations/
Thu, 9 Nov 2017 03:07:24 GMT
------------------------------------------------------------
Former party chief Donna Brazile stokes divisions among Democrats
http://www.latimes.com/nation/la-na-pol-donna-brazile-democrats-20171109-story.html
Thu, 9 Nov 2017 11:01:37 GMT
------------------------------------------------------------
Theresa May faces fresh reshuffle after Priti Patel resignation
http://www.bbc.com/news/uk-politics-41923670
Thu, 9 Nov 2017 07:41:24 GMT
------------------------------------------------------------
Barack Obama has to report to jury duty, too. (He didn't get picked.)
https://www.washingtonpost.com/news/politics/wp/2017/11/08/barack-obama-has-to-report-to-jury-duty-too-he-didnt-get-picked/
Wed, 8 Nov 2017 20:58:25 GMT
------------------------------------------------------------
Report: Goodell “furious” about push for incentive-base deal
http://profootballtalk.nbcsports.com/2017/11/08/report-goodell-furious-about-push-for-incentive-base-deal/
Thu, 9 Nov 2017 03:41:00 GMT
------------------------------------------------------------
Danica Roem of Virginia to be first openly transgender person elected, seated in a US statehouse
https://www.washingtonpost.com/local/virginia-politics/danica-roem-will-be-vas-first-openly-transgender-elected-official-after-unseating-conservative-robert-g-marshall-in-house-race/2017/11/07/d534bdde-c0af-11e7-959c-fe2b598d8c00_story.html
Wed, 8 Nov 2017 19:37:57 GMT
------------------------------------------------------------

Flowchart:

Flowchart: Python - Get the top stories from Google news

Python Code Editor :

 

Have another way to solve this solution? Contribute your code (and comments) through Disqus.

Previous: Write a Python program to count the number of each character of a text file.
Next: Write a Python program to get a list of locally installed Python modules.

What is the difficulty level of this exercise?

Test your Programming skills with w3resource's quiz.



Share this Tutorial / Exercise on : Facebook and Twitter

Python: Tips of the Day

Memory Management:

getrefcount will show how many times an object is used in the memory. It's a fantastic tool that can be used for memory management in any program and it's very convenient too.

Getrefcount will calculate the object usage at a low level ByteCode so it can tend to be higher than expected. For instance when you print a value that value is actually processed multiple times in the background inside the print function itself and getrefcount also counts the instance when the value is called with getrefcount method itself. So, it's safe to say that the count will actually always be at least 1 time higher than expected.

Here is a code to show how many times alphanumeric characters are referenced in a random code:

import sys
x_val = 20
x_val += 1

y_val = "Heritage"

x = sys.getrefcount(x_val)
y = sys.getrefcount(y_val)

print(x, y, sep="\n")

Output:

10
4