node.js - Node can't scrape certain pages -
i don't know if coldfusion pages or can't scrape these .cfm
pages
in command line in directory request
run:
node> var request = require('request'); node> var url = 'http://linguistlist.org/callconf/browse-conf-action.cfm?confid=173395'; node> request(url, function (err, res, body) { if (err) { console.log(err) } else { console.log('body:', body) }; });
i've tried other .cfm sites work, , getting blank results don't know be
note: i've tried doing barebones require('http').get(url,…)
route same blank result
i got ! (finally)
this web server need know how answer you. try (it work me)
var request = require('request'); var options = { url: 'http://linguistlist.org/callconf/browse-conf-action.cfm?confid=173395', headers: { 'accept-encoding':'none' } }; request(options, function (err, res, body) { if (err) { console.log(err) } else { console.log('body:', body) }; });
Comments
Post a Comment