python - Simple scrapy XML spider syntax error -


i trying make simple spider using scrapy grab data xml file. came with:

from scrapy.contrib.spiders import xmlfeedspider  class myspider(xmlfeedspider):      name = 'testproject'      allowed_domains = ['www.w3schools.com']      start_urls = ['http://www.w3schools.com/xml/note.xml']      itertag = 'note'      def parse_node(self, response, node):          = node.select('to/text()').extract()          = node.select('from/text()').extract()          heading  = node.select('heading/text()').extract()          body  = node.select('body/text()').extract()      def parse_node(self, response, node):          log.msg('hi, <%s> node!: %s' % (self.itertag, ''.join(node.extract())))          item = item()          item['to'] = node.select('to').extract()          item['from'] = node.select('from').extract()          item['heading'] = node.select('heading').extract()          item['body'] = node.select('body').extract()          return item

this data set: http://www.w3schools.com/xml/note.xml

when try , run it, unfortunately doesn't work. think it's related how mapping tags. error:

  file "/usr/local/bin/scrapy", line 11, in <module>                                                         sys.exit(execute())                                                                                    file "/usr/local/lib/python2.7/dist-packages/scrapy/cmdline.py", line 143, in execute                      _run_print_help(parser, _run_command, cmd, args, opts)                                                 file "/usr/local/lib/python2.7/dist-packages/scrapy/cmdline.py", line 89, in _run_print_help               func(*a, **kw)                                                                                         file "/usr/local/lib/python2.7/dist-packages/scrapy/cmdline.py", line 150, in _run_command                 cmd.run(args, opts)                                                                                    file "/usr/local/lib/python2.7/dist-packages/scrapy/commands/crawl.py", line 57, in run                    crawler = self.crawler_process.create_crawler()                                                        file "/usr/local/lib/python2.7/dist-packages/scrapy/crawler.py", line 87, in create_crawler                self.crawlers[name] = crawler(self.settings)                                                           file "/usr/local/lib/python2.7/dist-packages/scrapy/crawler.py", line 25, in __init__                      self.spiders = spman_cls.from_crawler(self)                                                            file "/usr/local/lib/python2.7/dist-packages/scrapy/spidermanager.py", line 35, in from_crawler            sm = cls.from_settings(crawler.settings)                                                               file "/usr/local/lib/python2.7/dist-packages/scrapy/spidermanager.py", line 31, in from_settings           return cls(settings.getlist('spider_modules'))                                                         file "/usr/local/lib/python2.7/dist-packages/scrapy/spidermanager.py", line 22, in __init__                module in walk_modules(name):                                                                      file "/usr/local/lib/python2.7/dist-packages/scrapy/utils/misc.py", line 68, in walk_modules               submod = import_module(fullpath)                                                                       file "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module                                 __import__(name)                                                                                       file "/var/www/spider/crawler/spiders/jobsite.py", line 11                                                 = node.select('from/text()').extract()                                                                   ^                                                                                               syntaxerror: invalid syntax

any appreciated.

change word from different, in python keyword.


Comments

Post a Comment

Popular posts from this blog

shopping cart - Page redirect not working PHP -

im trying redirect user when click "empty cart". redirect working "add cart" not "empty cart". ideas great. in main .php file set current url seen $current_url = base64_encode("http://$_server[http_host]$_server[request_uri]"); then below cartaction.php file handles actions such "add cart" , "empty cart" <?php session_start(); include_once 'config.php'; //add item in shopping cart if(isset($_post["add"])) { $product_id = $_post["product_id"]; //product id $return_url = base64_decode($_post["return_url"]); //return url $qty = $_post["qty"]; $product = $mysqli->query("select product_name, unit_price, unit_quantity products product_id = '$product_id'"); $obj = $product->fetch_object(); if(!isset($_session['products'])) { $_session['products'] = array(); } if(array_key_exists($product_id...
Read more

php - How to modify a menu to show sub-menus -

i have custom php menu made person, displays categories menu. however, need display subcategories well. tried adding hierarchical parameter didn't work. hoping assistance! here code: <ul> <?php /* categories wp e-commerce products */ $wpec_product_categories = get_terms( 'wpsc_product_category', 'hide_empty=0&parent=0&exclude=298'); $myarray = array(); foreach($wpec_product_categories $wpec_categories){ $myarray[$wpec_categories->term_id]['name'] = $wpec_categories->name; $myarray[$wpec_categories->term_id]['slug'] = $wpec_categories->slug; $myarray[$wpec_categories->term_id]['term_id'] = $wpec_categories->term_id; } foreach($myarray $wpec_categories1){ $wpec_term_name = $wpec_categories1['name']; $wpec_term_slug = $wpec_categories1['slug']; $wpec_term_id = $wpec_categories1['term_id']; echo '<li> <a href="'.get_page_link(19)....
Read more

python - Installing PyDev in eclipse is failed -

unable read repository @ http://pydev.sf.net/updates/content.xml. sun.security.validator.validatorexception: pkix path building failed: sun.security.provider.certpath.suncertpathbuilderexception: unable find valid certification path requested target i installing pydev in eclipse using python, doesn't install successfully. gives above error. happened? how solve error? i had error when trying install on laptop behind corporate firewall. couldn't tell setup of firewall, not sure of root cause. i got passed error installing pydev eclipse when out behind firewall. another way got around have eclipse on non-firewalled machine, install pydev eclipse, , copy whole eclipse directory non-firewalled machine firewalled machine. there better way, , way fix properly, didn't have time work out firewall doing. this on windows 7 machine (yeah know) not work *nix versions installed through package manager yum or apt.
Read more