This is a split board - You can return to the Split List for other boards.

I need to collect information off a website, but have no idea how to do it.

  • Topic Archived

You have been randomly selected to participate in the Beta Test of our new message list page. We've rolled out this test in order to get additional feedback and error reports from a wider subset of users. We'll only display this notice once, but permanent links to disable the Beta, provide feedback, and get more information will be located at the bottom of each message list.

To disable this test for now, click here. For more information, please read our announcement about this redesign.

  1. Boards
  2. PC
  3. I need to collect information off a website, but have no idea how to do it.
2 years ago#1
Basically I need to write a script or something to automatically collect certain information in tables on a certain website. I'm familliar with HTML, some PHP and played around with SQL but don't really know how to go about doing this stuff. Any help would be appreciated.
---
Steam ID: PirateSamir, PSN: watertankk
http://i158.photobucket.com/albums/t92/muttley1211/bug.gif
2 years ago#2
I think I answered my own question, I just don't know if this is the best method out there.

JQuery seems promising, but I'd love to use something I already know :/

Also I'm assuming I can load tables straight into MySQL with JQuery.
---
Steam ID: PirateSamir, PSN: watertankk
http://i158.photobucket.com/albums/t92/muttley1211/bug.gif
2 years ago#3
To anyone interested. I think I'm going to end up using JWebUnit due to my current situation.
---
Steam ID: PirateSamir, PSN: watertankk
http://i158.photobucket.com/albums/t92/muttley1211/bug.gif
2 years ago#4
I'm actually interested in how you're doing this. I have to create a table I can update dynamically with data to display the top 10 dispensaries in my area on the website.

What kind of table are you doing, and is it dynamically updating etc?
---
Steam ID: Mind_Explosion
I thought I chose very easy, not brand new to the game. - CheesyPhil
2 years ago#5
HydroCannabinol posted...
I'm actually interested in how you're doing this. I have to create a table I can update dynamically with data to display the top 10 dispensaries in my area on the website.

What kind of table are you doing, and is it dynamically updating etc?


No this is going to be static. I just need to collect a bunch of information of a website's tables and then add that info to my own tables. The info doesn't change so it will only have to be done once. Planning to use JWebUnit, has some nice APIs.
---
Steam ID: PirateSamir, PSN: watertankk
http://i158.photobucket.com/albums/t92/muttley1211/bug.gif
2 years ago#6
Being a sysadmin my mind immediately went to Curl/awk/sed :) JWebUnit is a much better approach haha.
2 years ago#7
Ask the NSA or FBI for help. They have extraordinary customer service.
---
MOoooOOoooOOoooOOOooOOO
  1. Boards
  2. PC
  3. I need to collect information off a website, but have no idea how to do it.

Report Message

Terms of Use Violations:

Etiquette Issues:

Notes (optional; required for "Other"):
Add user to Ignore List after reporting

Topic Sticky

You are not allowed to request a sticky.

Message List Beta Test is now on. To disable the Beta, just click here, or you can read more about it, report an error, or provide general feedback.
  • Topic Archived