Jump to content


Photo

How to get XML with PHP from armory


  • Please log in to reply
122 replies to this topic

#1 zork

zork

    Don Flamenco

  • Members
  • 477 posts

Posted 05 July 2007 - 02:03 PM

*Update*

Since my old tutorial files are lost I made some new ones.

You can check them out here:
php_ajax_armory_tutorial - rothui - Google Code

Three files are needed.
- A basic PHP file that does the structure and includes links that will call your AJAX function
guild_data.php - rothui - Google Code

- Some JavaScript functions to retrieve stuff
armory.js - rothui - Google Code

- Another PHP file that is called by the AJAX function and retrieves the information for you
get_char_data_xml.php - rothui - Google Code

As some posts on page 3 already have mentioned we are now using a class that contains the retrieved information.

If your webserver does not support CURL you can try this function to get the XML string instead. If it does support CURL you should make use of it.
  function get_xml_data_from_url($url,$lang)
{
$url_array = parse_url($url);
$fp = fsockopen($url_array['host'], 80, $errno, $errstr, 5);
$send = "GET " . $url_array[path] . "?" . $url_array[query] ." HTTP/1.0\r\n";
$send .= "Host: " . $url_array[host] . " \r\n";
$send .= "User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)\r\n";
$send .= "Accept-Language: " . $lang . "\r\n";
$send .= "Connection: Close\r\n\r\n";
fwrite($fp, $send);
while ($fp && !feof($fp))
{
$headerbuffer = fgets($fp, 1024);
if (urlencode($headerbuffer) == "%0D%0A")
{
break;
}
}
$xml_data = '';
while (!feof($fp))
{
$xml_data .= fgets($fp, 1024);
}
fclose($fp);
return $xml_data;
}


Remember: If you do not support the Request with a browser information the response will be HTML and not XML always. So if you want an XML response add some kind of user agent information. But sometimes HTML is wanted, tooltips for example.

Oh btw...Don't spam the armory server with requests or you will find yourself banned temporarily shortly after.
| Simple is beautiful.
| Blog | Roth UI | Roth UI FAQ | GoogleCode | Zork | Guild | zorker.de

"I wonder what the non-pathetic people are doing tonight?" - Rajesh Koothrappali (The Big Bang Theory)


#2 Goggles

Goggles

    King Hippo

  • Members
  • 571 posts

Posted 05 July 2007 - 02:14 PM

Thanks for this. I had originally intended to do some playing with data from the Armory but PHP (and web development in general) is not something I have much experience with so I never got sufficiently motivated to do it. I think this will give me the impetus to have another go as it means I don't need to spend ages working out how to get the data and concentrate on the manipulation of it.
Not actually a member of Refusion on Burning Blade.

#3 zork

zork

    Don Flamenco

  • Members
  • 477 posts

Posted 05 July 2007 - 02:38 PM

Just to give you some quick example what can be done:

http://dm.next-gen.o...0980&lang=fr-fr
http://dm.next-gen.o...0980&lang=de-de
http://dm.next-gen.o...0980&lang=en-en

Source:
http://dm.next-gen.o...ooltip_xml.html

So you could have tooltips for every item id you want in multiple languages with just one little script that you could call with AJAX in real time.

If you want to lookup for items per "name", no problem. I want every item with "onslaught" in it. (beware of browser language!)
http://armory.worldo...Query=Onslaught

Ok now with the php script:
http://dm.next-gen.o...-en&q=onslaught
http://dm.next-gen.o...-de&q=onslaught
http://dm.next-gen.o...-fr&q=onslaught

Just have the query string you are searching for behind the "q=".

Source:
http://dm.next-gen.o..._query_xml.html

Thats it.
| Simple is beautiful.
| Blog | Roth UI | Roth UI FAQ | GoogleCode | Zork | Guild | zorker.de

"I wonder what the non-pathetic people are doing tonight?" - Rajesh Koothrappali (The Big Bang Theory)


#4 sp00n

sp00n

    Bald Bull

  • Members
  • 1836 posts

Posted 05 July 2007 - 04:56 PM

I admit I haven't done any XML parsing yet, but did you take a look at http://www.php.net/m.../en/ref.xml.php?

You should be able to read XML files without having to convert them.


BTW, those links don't work for me:
http://dm.next-gen.o...-en&q=onslaught

Stopped Playing


#5 Pomperipossa

Pomperipossa

    Von Kaiser

  • Members
  • 28 posts

Posted 05 July 2007 - 06:24 PM

BTW, those links don't work for me:
http://dm.next-gen.o...-en&q=onslaught


Like in you can't connect or you just get a blank page? If it's the latter you need to look at the source of the page: View->Source code or something like that.

#6 Asmik

Asmik

    Mr. Sandman

  • Members
  • 6781 posts

Posted 05 July 2007 - 07:32 PM

I'm getting the following error, but it's probably because I don't know what I'm doing.

Posted Image

#7 Renew

Renew

    Team Healbot

  • Members
  • 528 posts

Posted 05 July 2007 - 08:26 PM

http://phparmory.sourceforge.net/ or http://sourceforge.n...ects/phparmory/ is a parse I found around the net that puts everything into php arrays. It's pretty neat and easy to add in your own code (if you know a bit of PHP). I added in some code to get Arena Teams for use on my guilds under dev new layout and it works nice.
Confidence is not Arrogance.

#8 D1g1talS0ul

D1g1talS0ul

    Glass Joe

  • Members
  • 1 posts

Posted 05 July 2007 - 09:35 PM

I use cURL to pull down the xml and simplexml to parse it for my guilds roster page. Requires PHP5, which most webhosts haven't switched to (including our host). I run the script below on my desktop that has PHP5, it parses the info I need and puts it into a mysql database at our host. Then on our hosts server with PHP4, roster.php parses the data from the mysql database.


#!/usr/bin/php
<?php

class roster_gen {

const BROWSER="Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.2) Gecko/20070319 Firefox/2.0.0.3";

public $query;
public $server;
public $guild;
public $guildie;
public $page;

public function __construct ( $query, $server, $guild, $guildie, $page ) {
$this->query = $query;
$this->server = $server;
$this->guild = $guild;
$this->guildie = $guildie;
$this->page = $page;
} // end of __construct()

public function pull_xml() {

if( $this->query === 'roster' ){
$url = 'http://armory.worldofwarcraft.com/guild-info.xml?r=' . $this->server . '&n=' . $this->guild . '&p=' . $this->page;

}elseif( $this->query === 'character' ){
$url = 'http://armory.worldofwarcraft.com/character-sheet.xml?r=' . $this->server . '&n=' . $this->guildie;

}

$ch = curl_init();
curl_setopt ($ch, CURLOPT_URL, $url);
curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt ($ch, CURLOPT_CONNECTTIMEOUT, 15);
curl_setopt ($ch, CURLOPT_USERAGENT, roster_gen::BROWSER);

$url_string = curl_exec($ch);
return simplexml_load_string($url_string);

curl_close($ch);
} // end of pull_xml()

} // end class

// query, realm, guild, guildie, page
// query can be roster or character
$roster = new roster_gen (roster, cenarius, insurrection, NULL, 1);

$xml_roster = $roster->pull_xml();
$battlegroup = $xml_roster->guildInfo->guild['battleGroup'];
$num_guildies = $xml_roster->guildInfo->guild->members['memberCount'];

$roster->query=character;
$name = 'someguildie'; //change to character you'd like to lookup
$roster->guildie=$name;
$xml_char = $roster->pull_xml();

$tree1 = $xml_char->characterInfo->characterTab->talentSpec['treeOne'];
$tree2 = $xml_char->characterInfo->characterTab->talentSpec['treeTwo'];
$tree3 = $xml_char->characterInfo->characterTab->talentSpec['treeThree'];

$lastLOGIN = $xml_char->characterInfo->character['lastModified'];

$title = $xml_char->characterInfo->character['title'];

echo "Guild:$roster->guild Realm:$roster->server Battlegroup:$battlegroup\n";
echo "Name:$name($title), Talents:$tree1/$tree2/$tree3 Last Login: $lastLOGIN\n";
?>


If you do a var_dump($xml_char) or var_dump($xml_roster) you'll see all the options you can pull from the armory.

Hope this is helpful.

#9 Ragnor

Ragnor

    King Hippo

  • Members
  • 606 posts

Posted 06 July 2007 - 01:44 AM

I was mucking around testing with Firefox, IE7 and Safari for Windows today and I happened to notice Safari is awesome for using the armory (mostly). Firefox and IE7 will choke/lock up on the large xmlhttprequests and not respond until they have finished loading/processing the page. Safari however will let you carry on no problems, opening new tabs etc while the armory is loading in the background tab.

It's a pain Safari doesn't render text white in input boxes though :(
The universe is run by the complex interweaving of three elements. Energy, matter, and enlightened self-interest.

www.retpaladin.com

#10 sp00n

sp00n

    Bald Bull

  • Members
  • 1836 posts

Posted 06 July 2007 - 08:09 AM

Like in you can't connect or you just get a blank page? If it's the latter you need to look at the source of the page: View->Source code or something like that.


Huh, yeah.
Weird, normally Firefox displays the XML data and doesn't just put out a blank page.

Stopped Playing


#11 zork

zork

    Don Flamenco

  • Members
  • 477 posts

Posted 06 July 2007 - 08:44 AM

I'm getting the following error, but it's probably because i don't know what I'm doing.

Posted Image


The XML data is not for viewing in your browser :), its for your php scripts.
So it doesn't matter that you do not see nothing.

Just look into the source to see the XML.

The Armory XML is very very fast, what makes the application so slow is all the AJAX crap. It just eats the browser alive >_<.

@renew
Thanks for the link I will take a closer look at this one. I am now at the point where I have to transfer the XML data into PHP arrays.
| Simple is beautiful.
| Blog | Roth UI | Roth UI FAQ | GoogleCode | Zork | Guild | zorker.de

"I wonder what the non-pathetic people are doing tonight?" - Rajesh Koothrappali (The Big Bang Theory)


#12 Melnor

Melnor

    Piston Honda

  • Members
  • 139 posts

Posted 06 July 2007 - 02:34 PM

Thanks for the insight zork. I'll begin the c# asp.net port shortly. There's probably already one out there but I'm bored.

#13 christide

christide

    Von Kaiser

  • Members
  • 87 posts

Posted 06 July 2007 - 06:01 PM

Thanks for the insight zork. I'll begin the c# asp.net port shortly. There's probably already one out there but I'm bored.


static HttpWebRequest RequestBuilder(string requestUri, string currentPage, string referer, string address)
	{
		Cookie cookieOne = new Cookie("currentPage", currentPage);
		Cookie cookieTwo = new Cookie("cookies", "true");
		Cookie cookieThree = new Cookie("cookieMenu", "all");

		cookieOne.Domain = address;
		cookieTwo.Domain = address;
		cookieThree.Domain = address;

		CookieContainer thisContainer = new CookieContainer();

		thisContainer.Add(cookieThree);
		thisContainer.Add(cookieTwo);
		thisContainer.Add(cookieOne);

		HttpWebRequest request = (HttpWebRequest)WebRequest.Create(requestUri);

		request.Accept = "*/*";
		request.Headers.Add(HttpRequestHeader.AcceptLanguage, "en-us");
		request.Headers.Add("US-CPU", "x86");
		request.UserAgent = "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.0.04506; .NET CLR 1.1.4322)";
		request.Referer = referer;
		request.CookieContainer = thisContainer;

		return request;
	}

The ugly hacked up function I wrote a while back to form a request object with the required parameters to get the xml back.

I would call it like:

HttpWebRequest request = RequestBuilder("http://" + address + "/guild-info.xml?r=" + serverName + "&p=1&n=" + guildName + "&lang=", @"guild-info.xml%3Fr%3D" + serverName + "%26n%3D" + guildName + "%26p%3D1", @"http://" + address + "/#guild-info.xml?r=" + serverName + "&n=" + guildName + "&p=1", address);

Used for http://www.thepalsfo...tp/ArmoryParse/. If you're offended by the word faggot, that link will most likely be extremely offensive.


EDIT: I attached the source to my armory parse. It's pretty ugly and completely devoid of comments since it's something I hacked up in an afternoon and never really bothered with again. Hopefully someone can get some value out of the source however.

Attached Files



#14 zork

zork

    Don Flamenco

  • Members
  • 477 posts

Posted 10 July 2007 - 10:26 AM

I just want to give you an update on this to show what amazing stuff can be done.

I built our own item search based on the Armory XML, take a look :)

Posted Image

All data is generated in real time, no database is used.

p.s. I couldn't use the phparmory XML parser, sadly it had a bug with XML attributes. But i found another one that worked properly and nearly the same.
| Simple is beautiful.
| Blog | Roth UI | Roth UI FAQ | GoogleCode | Zork | Guild | zorker.de

"I wonder what the non-pathetic people are doing tonight?" - Rajesh Koothrappali (The Big Bang Theory)


#15 Coeus

Coeus

    Von Kaiser

  • Members
  • 33 posts

Posted 10 July 2007 - 04:56 PM

p.s. I couldn't use the phparmory XML parser, sadly it had a bug with XML attributes. But i found another one that worked properly and nearly the same.


What did you end up using? I was starting to use phpArmory, but if it's bugged, I should either look at fixing it or just change to something else.

#16 Kallisti

Kallisti

    Von Kaiser

  • Members
  • 44 posts

Posted 10 July 2007 - 06:14 PM

I can just recommend antiarcs armory scripts as basis.

http://wow.tachyonsix.com/armory/
http://svn.digitalse...com/svn/armory/

Especially:
http://svn.digitalse...ory/_armory.php

You can remove some code (which is only used for some special functions of his scripts) and edit it to fit your needs, but I found it to be perfect to build some websites quickly.

I'm using some lines of it in the script which generates our memberlist (http://pernoctem.de/members.php) twice a day automatically via cron jobs.

#17 zork

zork

    Don Flamenco

  • Members
  • 477 posts

Posted 11 July 2007 - 09:58 AM

@Coeus
phpArmory bugged for me so I switched to another parser.

@Kallisti
I don't know if the scripts from antiarc require php5.0 which some web-server don't have. (simplexml is 5.0 only)
| Simple is beautiful.
| Blog | Roth UI | Roth UI FAQ | GoogleCode | Zork | Guild | zorker.de

"I wonder what the non-pathetic people are doing tonight?" - Rajesh Koothrappali (The Big Bang Theory)


#18 Hung_war3

Hung_war3

    Glass Joe

  • Members
  • 1 posts

Posted 24 September 2007 - 08:42 AM

I use cURL to pull down the xml and simplexml to parse it for my guilds roster page. Requires PHP5, which most webhosts haven't switched to (including our host). I run the script below on my desktop that has PHP5, it parses the info I need and puts it into a mysql database at our host. Then on our hosts server with PHP4, roster.php parses the data from the mysql database.


#!/usr/bin/php
<?php

class roster_gen {

const BROWSER="Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.2) Gecko/20070319 Firefox/2.0.0.3";

public $query;
public $server;
public $guild;
public $guildie;
public $page;

public function __construct ( $query, $server, $guild, $guildie, $page ) {
$this->query = $query;
$this->server = $server;
$this->guild = $guild;
$this->guildie = $guildie;
$this->page = $page;
} // end of __construct()

public function pull_xml() {

if( $this->query === 'roster' ){
$url = 'http://armory.worldofwarcraft.com/guild-info.xml?r=' . $this->server . '&n=' . $this->guild . '&p=' . $this->page;

}elseif( $this->query === 'character' ){
$url = 'http://armory.worldofwarcraft.com/character-sheet.xml?r=' . $this->server . '&n=' . $this->guildie;

}

$ch = curl_init();
curl_setopt ($ch, CURLOPT_URL, $url);
curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt ($ch, CURLOPT_CONNECTTIMEOUT, 15);
curl_setopt ($ch, CURLOPT_USERAGENT, roster_gen::BROWSER);

$url_string = curl_exec($ch);
return simplexml_load_string($url_string);

curl_close($ch);
} // end of pull_xml()

} // end class

// query, realm, guild, guildie, page
// query can be roster or character
$roster = new roster_gen (roster, cenarius, insurrection, NULL, 1);

$xml_roster = $roster->pull_xml();
$battlegroup = $xml_roster->guildInfo->guild['battleGroup'];
$num_guildies = $xml_roster->guildInfo->guild->members['memberCount'];

$roster->query=character;
$name = 'someguildie'; //change to character you'd like to lookup
$roster->guildie=$name;
$xml_char = $roster->pull_xml();

$tree1 = $xml_char->characterInfo->characterTab->talentSpec['treeOne'];
$tree2 = $xml_char->characterInfo->characterTab->talentSpec['treeTwo'];
$tree3 = $xml_char->characterInfo->characterTab->talentSpec['treeThree'];

$lastLOGIN = $xml_char->characterInfo->character['lastModified'];

$title = $xml_char->characterInfo->character['title'];

echo "Guild:$roster->guild Realm:$roster->server Battlegroup:$battlegroup\n";
echo "Name:$name($title), Talents:$tree1/$tree2/$tree3 Last Login: $lastLOGIN\n";
?>


If you do a var_dump($xml_char) or var_dump($xml_roster) you'll see all the options you can pull from the armory.

Hope this is helpful.


I have got this error when use this form :

Fatal error: Call to undefined function curl_init() in C:\wamp\www\phpArmory\character.php on line 31

Can you help me ? I think this function is not valid right ?

#19 Ronnie

Ronnie

    Glass Joe

  • Members
  • 8 posts

Posted 24 September 2007 - 10:13 AM

Can you help me ? I think this function is not valid right ?

You will need libcurl for this and you will also need to compile PHP with the --with-curl=X directive, where X is the location of libcurl's libraries and includes.

If you can't or do not want to use cURL you have to fsockopen() and construct the GET request yourself. Zork posted an example of how to do this: http://dm.next-gen.o...example_fr.html

#20 bonkers

bonkers

    Glass Joe

  • Members
  • 2 posts

Posted 22 July 2008 - 09:31 PM

I'm using Google AppEngine for my Armory-crawling site. If anyone else is using it, AppEngine's URL fetching ability doesn't let one set the User-agent so only the HTML responses are available. If anyone knows a workaround I'd love to hear it.

Here's my tool, Gear Wishlist that generates a list of potential gear upgrades. It doesn't support power-user tweaking, but it a simple way to eyeball what's out there.




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users