Python: Get the top stories from Google news
Python Basic - 1: Exercise-8 with Solution
Write a Python program to get the top stories from Google news.
Sample Solution:
Python Code :
import bs4
from bs4 import BeautifulSoup as soup
from urllib.request import urlopen
news_url="https://news.google.com/news/rss"
Client=urlopen(news_url)
xml_page=Client.read()
Client.close()
soup_page=soup(xml_page,"xml")
news_list=soup_page.findAll("item")
# Print news title, url and publish date
for news in news_list:
print(news.title.text)
print(news.link.text)
print(news.pubDate.text)
print("-"*60)
Sample Output:
With Trump in China, Taiwan worries about becoming a 'bargaining chip' https://www.washingtonpost.com/world/with-trump-in-china-taiwan-worries-about-becoming-abargaining-chip/2017/11/09/ee3c0126-c4af-11e7-9922-4151f5ca6168_story.html Thu, 9 Nov 2017 11:19:13 GMT ------------------------------------------------------------ Blue Dog Democrats taking hard line on GOP tax bill http://thehill.com/policy/finance/359515-blue-dog-democrats-taking-hard-line-on-gop-tax-bill Thu, 9 Nov 2017 11:01:58 GMT ------------------------------------------------------------ A Year Later, The Shock Of Trump's Win Hasn't Totally Worn Off In Either Party https://www.npr.org/2017/11/09/562307566/a-year-later-the-shock-of-trumps-win-hasn-t-totally-worn-off-in-either-party Thu, 9 Nov 2017 10:02:21 GMT ------------------------------------------------------------ In a Texas town overwhelmed with grief, Pence delivers a message of support and faith http://www.latimes.com/nation/la-na-texas-shooting-pence-vigil-20171108-story.html Thu, 9 Nov 2017 04:50:00 GMT ------------------------------------------------------------ US, AT&T at odds over CNN in Time Warner deal http://www.reuters.com/article/us-time-warner-m-a/u-s-demands-cnn-or-directv-sale-to-approve-att-time-warner-deal-sources-idUSKBN1D81Z8 Thu, 9 Nov 2017 00:20:52 GMT ------------------------------------------------------------ Self-driving bus crashes two hours after launch in Las Vegas http://www.zdnet.com/article/self-driving-bus-crashes-two-hours-after-launch-in-las-vegas/ Thu, 9 Nov 2017 00:18:00 GMT ------------------------------------------------------------ 2017 CMA Awards Preach Unity, Crown Garth Brooks Entertainer of the Year http://www.rollingstone.com/country/news/2017-cma-awards-preach-unity-crown-garth-brooks-entertainer-w511375 Thu, 9 Nov 2017 08:23:59 GMT ------------------------------------------------------------ Spacey Cut From Film; Scenes To Be Re-Shot With Replacement Actor https://www.npr.org/sections/thetwo-way/2017/11/09/562995171/spacey-cut-from-film-scenes-to-be-re-shot-with-replacement-actor Thu, 9 Nov 2017 09:57:00 GMT ------------------------------------------------------------ FEMA to transport Puerto Rico's hurricane survivors to US mainland http://www.cnn.com/2017/11/09/us/fema-puerto-rico-transport/index.html Thu, 9 Nov 2017 10:48:23 GMT ------------------------------------------------------------ Trump and Putin to meet on Friday in Vietnam http://www.nydailynews.com/news/world/trump-putin-meet-friday-vietnam-article-1.3620846 Thu, 9 Nov 2017 08:18:23 GMT ------------------------------------------------------------ Syria war: Army retakes last IS urban stronghold http://www.bbc.com/news/world-middle-east-41918913 Thu, 9 Nov 2017 11:26:15 GMT ------------------------------------------------------------ The Saudi Purge Isn't Just a Power Grab https://www.bloomberg.com/news/articles/2017-11-09/the-saudi-purge-isn-t-just-a-power-grab Thu, 9 Nov 2017 09:15:34 GMT ------------------------------------------------------------ Trump Tightens Cuba Embargo, Restricting Access to Hotels and Businesses https://www.nytimes.com/2017/11/08/us/politics/trump-tightens-cuba-embargo-restricting-access-to-hotels-businesses.html Wed, 8 Nov 2017 17:16:11 GMT ------------------------------------------------------------ Battered by Trump, Obamacare triumphs at the polls https://www.politico.com/story/2017/11/08/obamacare-boost-at-the-polls-244696 Wed, 8 Nov 2017 18:17:39 GMT ------------------------------------------------------------ Terry Crews Confirms He Filed a Police Report After Making Sexual Assault Allegations http://people.com/movies/terry-crews-confirms-he-filed-a-police-report-after-making-sexual-assault-allegations/ Thu, 9 Nov 2017 03:07:24 GMT ------------------------------------------------------------ Former party chief Donna Brazile stokes divisions among Democrats http://www.latimes.com/nation/la-na-pol-donna-brazile-democrats-20171109-story.html Thu, 9 Nov 2017 11:01:37 GMT ------------------------------------------------------------ Theresa May faces fresh reshuffle after Priti Patel resignation http://www.bbc.com/news/uk-politics-41923670 Thu, 9 Nov 2017 07:41:24 GMT ------------------------------------------------------------ Barack Obama has to report to jury duty, too. (He didn't get picked.) https://www.washingtonpost.com/news/politics/wp/2017/11/08/barack-obama-has-to-report-to-jury-duty-too-he-didnt-get-picked/ Wed, 8 Nov 2017 20:58:25 GMT ------------------------------------------------------------ Report: Goodell “furious” about push for incentive-base deal http://profootballtalk.nbcsports.com/2017/11/08/report-goodell-furious-about-push-for-incentive-base-deal/ Thu, 9 Nov 2017 03:41:00 GMT ------------------------------------------------------------ Danica Roem of Virginia to be first openly transgender person elected, seated in a US statehouse https://www.washingtonpost.com/local/virginia-politics/danica-roem-will-be-vas-first-openly-transgender-elected-official-after-unseating-conservative-robert-g-marshall-in-house-race/2017/11/07/d534bdde-c0af-11e7-959c-fe2b598d8c00_story.html Wed, 8 Nov 2017 19:37:57 GMT ------------------------------------------------------------
Flowchart:

Python Code Editor :
Have another way to solve this solution? Contribute your code (and comments) through Disqus.
Previous: Write a Python program to count the number of each character of a text file.
Next: Write a Python program to get a list of locally installed Python modules.
What is the difficulty level of this exercise?
Test your Programming skills with w3resource's quiz.
Python: Tips of the Day
Difference between staticmethod and classmethod:
Maybe a bit of example code will help: Notice the difference in the call signatures of foo, class_foo and static_foo:
class A(object): def foo(self, x): print "executing foo(%s, %s)" % (self, x) @classmethod def class_foo(cls, x): print "executing class_foo(%s, %s)" % (cls, x) @staticmethod def static_foo(x): print "executing static_foo(%s)" % x a = A()
Below is the usual way an object instance calls a method. The object instance, a, is implicitly passed as the first argument.
a.foo(1) # executing foo(<__main__.A object at 0xb7dbef0c>,1)
With classmethods The class of the object instance is implicitly passed as the first argument instead of self.
a.class_foo(1) # executing class_foo(<class '__main__.A'>,1)
You can also call class_foo using the class. In fact, if you define something to be a classmethod, it is probably because you intend to call it from the class rather than from a class instance. A.foo(1) would have raised a TypeError, but A.class_foo(1) works just fine:
A.class_foo(1) # executing class_foo(<class '__main__.A'>,1)
One use people have found for class methods is to create inheritable alternative constructors.
With staticmethods neither self (the object instance) nor cls (the class) is implicitly passed as the first argument. They behave like plain functions except that you can call them from an instance or the class:
a.static_foo(1) # executing static_foo(1) A.static_foo('hi') # executing static_foo(hi)
Staticmethods are used to group functions which have some logical connection with a class to the class.
foo is just a function, but when you call a.foo you don't just get the function, you get a "partially applied" version of the function with the object instance a bound as the first argument to the function. foo expects 2 arguments, while a.foo only expects 1 argument.
a is bound to foo. That is what is meant by the term "bound" below:
print(a.foo) # <bound method A.foo of <__main__.A object at 0xb7d52f0c>>
With a.class_foo, a is not bound to class_foo, rather the class A is bound to class_foo.
print(a.class_foo) # <bound method type.class_foo of <class '__main__.A'>>
Here, with a staticmethod, even though it is a method, a.static_foo just returns a good 'ole function with no arguments bound. static_foo expects 1 argument, and a.static_foo expects 1 argument too.
print(a.static_foo) # <function static_foo at 0xb7d479cc>
And of course the same thing happens when you call static_foo with the class A instead.
print(A.static_foo) # <function static_foo at 0xb7d479cc>
Ref: https://bit.ly/2XFGOg6
- New Content published on w3resource:
- HTML-CSS Practical: Exercises, Practice, Solution
- Java Regular Expression: Exercises, Practice, Solution
- Scala Programming Exercises, Practice, Solution
- Python Itertools exercises
- Python Numpy exercises
- Python GeoPy Package exercises
- Python Pandas exercises
- Python nltk exercises
- Python BeautifulSoup exercises
- Form Template
- Composer - PHP Package Manager
- PHPUnit - PHP Testing
- Laravel - PHP Framework
- Angular - JavaScript Framework
- Vue - JavaScript Framework
- Jest - JavaScript Testing Framework