Jump to content

rubing

Members
  • Posts

    366
  • Joined

  • Last visited

    Never

Posts posted by rubing

  1. I always wondered about the legality issue of scraping...thanks crayon!

     

    I don't like the idea of screen scraping b/c it seems you have to be constantly monitoring a site for changes to its layout.  So, that you can rewrite your regex's whenever the site changes.  It seems like if you're gonna end up giving the site more traffic they would want to cooperate with you.

     

    Just out of your curiousity what would you do if your IP was banned?  I guess you could use a proxy, but it seems a lot of those are unreliable. 

  2. it looks like those sites already have search engines on them.  If a site doesn't have an api, you would have to figure out some way to spider it and extract the info you want.  I'm not sure of the legality of this though.  You may want to just contact the site and see if they're interested in collaborating with you....maybe you can come to some kind of mutually beneficial arrangement

  3. I don't understand...maybe b/c i'm not familiar with word press.  These are blog posts you are making.  And you are trying to insert info_ID, category, and info_text into your DB???

     

    //you need to define a connection to your DB first
    
    $sql="INSERT INTO Info (info_ID, category, info_text) VALUES ("#", "category", "text")
    $conn->query($sql);
    
    

  4. On the php side you just need to say

     

    print_r($POST);

     

     

    and then we can try using a form like the OT and then maybe curl as well. of course this may not answer our question, but would be fairly easy.

     

    After that we may need to use a tool like Live HTTP headers in order to see what the browser is outputting.  Anyways, I have to go to the gym and then eat, so will be back later to see your result...  Good luck!

     

  5. hmmm....that's not really what i was trying to get at.  The OT wanted to know why his POST variable was coming up NULL.  So, he asked us (very lazy) whether php considers an empty string to be null.  We proved otherwise, by simply trying it out.  So, now I am wondering does the browser post an empty string as NULL?  Or does php unset the empty POST variable? 

     

    It's a very esoteric question, which really has no value.  Other than to help me procrastinate from writing my thesis. 

     

     

×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.