parsing - PHP script working locally but not when placed on webserver -

-

the following codes scrapes list of links given webpage , place them script scrapes text given links , places data csv document. code runs on localhost (wampserver 5.5 php) fails horribly when placed on domain.

you can check out functionality of script @ http://miskai.tk/anofm/csv.php . also, file html , curl both enabled onto server.

<?php header('content-type: application/excel'); header('content-disposition: attachment; filename="mehedinti.csv"'); include_once 'simple_html_dom.php';  include_once 'csv.php'; $urls = scrape_main_page();  function scraping($url) {     // create html dom      $html = file_get_html($url);      // article block     if ($html && is_object($html) && isset($html->nodes)) {          foreach ($html->find('/html/body/table') $article) {             // title              $item['titlu'] = trim($article->find('/tbody/tr[1]/td/div', 0)->plaintext);              // body             $item['tr2'] = trim($article->find('/tbody/tr[2]/td[2]', 0)->plaintext);             $item['tr3'] = trim($article->find('/tbody/tr[3]/td[2]', 0)->plaintext);             $item['tr4'] = trim($article->find('/tbody/tr[4]/td[2]', 0)->plaintext);             $item['tr5'] = trim($article->find('/tbody/tr[5]/td[2]', 0)->plaintext);             $item['tr6'] = trim($article->find('/tbody/tr[6]/td[2]', 0)->plaintext);             $item['tr7'] = trim($article->find('/tbody/tr[7]/td[2]', 0)->plaintext);             $item['tr8'] = trim($article->find('/tbody/tr[8]/td[2]', 0)->plaintext);             $item['tr9'] = trim($article->find('/tbody/tr[9]/td[2]', 0)->plaintext);             $item['tr10'] = trim($article->find('/tbody/tr[10]/td[2]', 0)->plaintext);             $item['tr11'] = trim($article->find('/tbody/tr[11]/td[2]', 0)->plaintext);             $item['tr12'] = trim($article->find('/tbody/tr[12]/td/div/]', 0)->plaintext);             $ret[] = $item;         }          // clean memory         $html->clear();         unset($html);          return $ret;} }    $output = fopen("php://output", "w");  foreach ($urls $url) {      $ret = scraping($url);      foreach($ret $v){         fputcsv($output, $v);}  }  fclose($output); exit();

second file

<?php  function get_contents($url) {     // use file_get_contents using curl makes more future-proof (setting timeout example)     $ch = curl_init($url);      curl_setopt_array($ch, array(curlopt_returntransfer => true,));      $content = curl_exec($ch);     curl_close($ch);      return $content; }  function scrape_main_page() {     set_time_limit(300);     libxml_use_internal_errors(true); // prevent domdocument spraying errors onto page , hide errors internally ;)     $html = get_contents("http://lmvz.anofm.ro:8080/lmv/index2.jsp?judet=26");      $dom = new domdocument();     $dom->loadhtml($html);     die(var_dump($html));     $xpath = new domxpath($dom);     $results = $xpath->query("//table[@width=\"645\"]/tr");      $all = array();     //var_dump($results);     for($i = 1; $i < $results->length; $i++) {         $tr = $results->item($i);          $id = $tr->childnodes->item(0)->textcontent;         $requesturl = "http://lmvz.anofm.ro:8080/lmv/detalii.jsp?uniquejvid=" . urlencode($id) .             "&judet=26";         $details = scrape_detail_page($requesturl);          $newobj = new stdclass();         $newobj = $id;         $all[] = $newobj;     }      foreach($all $xtr) {         $urls[] = "http://lmvz.anofm.ro:8080/lmv/detalii.jsp?uniquejvid=" . $xtr .             "&judet=26";     }     return $urls; }   scrape_main_page();

yeah, problem here php.ini configuration. make sure server supports curl , fopen. if not start own linux server.


Comments

Post a Comment

Popular posts from this blog

python - No exponential form of the z-axis in matplotlib-3D-plots -

-
Image
i have similar problem described in how prevent numbers being changed exponential form in python matplotlib figure : i don't want (in special case) weird scientific formatting of axis. problem different have problem @ z -axis. 2-d plots can use ax.get_yaxis().get_major_formatter().set_useoffset(false) . , there no function ax.get_zaxis() what use format z -axis same way? edit: example: from mpl_toolkits.mplot3d import axes3d import numpy np import sys import matplotlib import matplotlib.pyplot pyplot def func(xi, ti): res = 10e3 + np.cos(ti) * np.sin(xi) return res if __name__ == '__main__': timespacing = 20 timestart = 0 timeend = 1 time = np.linspace(timestart, timeend, timespacing) widthspacing = 50 widthstart = 0 widthend = 3 width = np.linspace(widthstart, widthend, widthspacing) reslist = [] matplotlib.rcparams['legend.fontsize'] = 10 fig = pyplot.figure() ax = fig.gca(projection = '3d...
Read more

php - Best Light server (Linux + Web server + Database) for Raspberry Pi -

-
i install web server database on raspberry pi (little computer). computer has 1gb ram. i want know best combination: linux distribution , web server , dbms run local server multiple users minimal latency, use php on server. , best settings performance , not have bugs (memory usage, disable plugin, disable service, etc)? i thought light debian , lighttpd server , sqlite database. solution? i think lighttpd + sqlite great choice. linux distro, debian @ centos or tiny core linux , although i'm not sure of compatibility pi. obviously, can't go wrong raspbian if want use in production , more stable performance, few more pi's , set them in cluster .
Read more

c# - "Newtonsoft.Json.JsonSerializationException unable to find constructor to use for types" error when deserializing class -

-
i developing app in xamarin android. have splash screen serialize class , pass mainactivity using intent . when try deserialize in mainactivity error message : "serializationexception unable find constructor use types" serialization : void loaddata() { currency currency = new currency(this); intent = new intent(this, typeof(mainactivity)); intent.putextra("currency", newtonsoft.json.jsonconvert.serializeobject(currency)); startactivity(intent); } deserialization : cur = newtonsoft.json.jsonconvert.deserializeobject<currency> (intent.getstringextra("currency")); // error here class constructor : public currency(context context) { thiscontext = context; } i began experiencing problem after added parameter context context constructor. has caused this? how can solve it? possible serialize/deserialize class has parameters? you need have empty constructor in currency class in order deserialize it. ...
Read more