Archived

This topic is now archived and is closed to further replies.

zork

How to get XML with PHP from armory

123 posts in this topic

*Update*

Since my old tutorial files are lost I made some new ones.

You can check them out here:

php_ajax_armory_tutorial - rothui - Google Code

Three files are needed.

- A basic PHP file that does the structure and includes links that will call your AJAX function

guild_data.php - rothui - Google Code

- Some JavaScript functions to retrieve stuff

armory.js - rothui - Google Code

- Another PHP file that is called by the AJAX function and retrieves the information for you

get_char_data_xml.php - rothui - Google Code

As some posts on page 3 already have mentioned we are now using a class that contains the retrieved information.

If your webserver does not support CURL you can try this function to get the XML string instead. If it does support CURL you should make use of it.

  function get_xml_data_from_url($url,$lang)
{
$url_array = parse_url($url);
$fp = fsockopen($url_array['host'], 80, $errno, $errstr, 5);
$send = "GET " . $url_array[path] . "?" . $url_array[query] ." HTTP/1.0\r\n";
$send .= "Host: " . $url_array[host] . " \r\n";
$send .= "User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)\r\n";
$send .= "Accept-Language: " . $lang . "\r\n";
$send .= "Connection: Close\r\n\r\n";
fwrite($fp, $send);
while ($fp && !feof($fp))
{
$headerbuffer = fgets($fp, 1024);
if (urlencode($headerbuffer) == "%0D%0A")
{
break;
}
}
$xml_data = '';
while (!feof($fp))
{
$xml_data .= fgets($fp, 1024);
}
fclose($fp);
return $xml_data;
}[/PHP]

Remember: If you do not support the Request with a browser information the response will be HTML and not XML always. So if you want an XML response add some kind of user agent information. But sometimes HTML is wanted, tooltips for example.

Oh btw...Don't spam the armory server with requests or you will find yourself banned temporarily shortly after.

Share this post


Link to post
Share on other sites

Thanks for this. I had originally intended to do some playing with data from the Armory but PHP (and web development in general) is not something I have much experience with so I never got sufficiently motivated to do it. I think this will give me the impetus to have another go as it means I don't need to spend ages working out how to get the data and concentrate on the manipulation of it.

Share this post


Link to post
Share on other sites

Just to give you some quick example what can be done:

http://dm.next-gen.org/files/item_tooltip_xml.php?itemid=30980〈=fr-fr

http://dm.next-gen.org/files/item_tooltip_xml.php?itemid=30980〈=de-de

http://dm.next-gen.org/files/item_tooltip_xml.php?itemid=30980〈=en-en

Source:

http://dm.next-gen.org/files/item_tooltip_xml.html

So you could have tooltips for every item id you want in multiple languages with just one little script that you could call with AJAX in real time.

If you want to lookup for items per "name", no problem. I want every item with "onslaught" in it. (beware of browser language!)

http://armory.worldofwarcraft.com/search.xml?searchType=items&searchQuery=Onslaught

Ok now with the php script:

http://dm.next-gen.org/files/item_query_xml.php?lang=en-en&q=onslaught

http://dm.next-gen.org/files/item_query_xml.php?lang=de-de&q=onslaught

http://dm.next-gen.org/files/item_query_xml.php?lang=fr-fr&q=onslaught

Just have the query string you are searching for behind the "q=".

Source:

http://dm.next-gen.org/files/item_query_xml.html

Thats it.

Share this post


Link to post
Share on other sites

I'm getting the following error, but it's probably because I don't know what I'm doing.

untitledkc2.jpg

Share this post


Link to post
Share on other sites

I use cURL to pull down the xml and simplexml to parse it for my guilds roster page. Requires PHP5, which most webhosts haven't switched to (including our host). I run the script below on my desktop that has PHP5, it parses the info I need and puts it into a mysql database at our host. Then on our hosts server with PHP4, roster.php parses the data from the mysql database.


#!/usr/bin/php
<?php

class roster_gen {

const BROWSER="Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.2) Gecko/20070319 Firefox/2.0.0.3";

public $query;
public $server;
public $guild;
public $guildie;
public $page;

public function __construct ( $query, $server, $guild, $guildie, $page ) {
$this->query = $query;
$this->server = $server;
$this->guild = $guild;
$this->guildie = $guildie;
$this->page = $page;
} // end of __construct()

public function pull_xml() {

if( $this->query === 'roster' ){
$url = 'http://armory.worldofwarcraft.com/guild-info.xml?r=' . $this->server . '&n=' . $this->guild . '&p=' . $this->page;

}elseif( $this->query === 'character' ){
$url = 'http://armory.worldofwarcraft.com/character-sheet.xml?r=' . $this->server . '&n=' . $this->guildie;

}

$ch = curl_init();
curl_setopt ($ch, CURLOPT_URL, $url);
curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt ($ch, CURLOPT_CONNECTTIMEOUT, 15);
curl_setopt ($ch, CURLOPT_USERAGENT, roster_gen::BROWSER);

$url_string = curl_exec($ch);
return simplexml_load_string($url_string);

curl_close($ch);
} // end of pull_xml()

} // end class

// query, realm, guild, guildie, page
// query can be roster or character
$roster = new roster_gen (roster, cenarius, insurrection, NULL, 1);

$xml_roster = $roster->pull_xml();
$battlegroup = $xml_roster->guildInfo->guild['battleGroup'];
$num_guildies = $xml_roster->guildInfo->guild->members['memberCount'];

$roster->query=character;
$name = 'someguildie'; //change to character you'd like to lookup
$roster->guildie=$name;
$xml_char = $roster->pull_xml();

$tree1 = $xml_char->characterInfo->characterTab->talentSpec['treeOne'];
$tree2 = $xml_char->characterInfo->characterTab->talentSpec['treeTwo'];
$tree3 = $xml_char->characterInfo->characterTab->talentSpec['treeThree'];

$lastLOGIN = $xml_char->characterInfo->character['lastModified'];

$title = $xml_char->characterInfo->character['title'];

echo "Guild:$roster->guild Realm:$roster->server Battlegroup:$battlegroup\n";
echo "Name:$name($title), Talents:$tree1/$tree2/$tree3 Last Login: $lastLOGIN\n";
?>
[/PHP]

If you do a var_dump($xml_char) or var_dump($xml_roster) you'll see all the options you can pull from the armory.

Hope this is helpful.

Share this post


Link to post
Share on other sites

I was mucking around testing with Firefox, IE7 and Safari for Windows today and I happened to notice Safari is awesome for using the armory (mostly). Firefox and IE7 will choke/lock up on the large xmlhttprequests and not respond until they have finished loading/processing the page. Safari however will let you carry on no problems, opening new tabs etc while the armory is loading in the background tab.

It's a pain Safari doesn't render text white in input boxes though :(

Share this post


Link to post
Share on other sites
Like in you can't connect or you just get a blank page? If it's the latter you need to look at the source of the page: View->Source code or something like that.

Huh, yeah.

Weird, normally Firefox displays the XML data and doesn't just put out a blank page.

Share this post


Link to post
Share on other sites
I'm getting the following error, but it's probably because i don't know what I'm doing.

untitledkc2.jpg

The XML data is not for viewing in your browser :), its for your php scripts.

So it doesn't matter that you do not see nothing.

Just look into the source to see the XML.

The Armory XML is very very fast, what makes the application so slow is all the AJAX crap. It just eats the browser alive >_<.

@renew

Thanks for the link I will take a closer look at this one. I am now at the point where I have to transfer the XML data into PHP arrays.

Share this post


Link to post
Share on other sites

Thanks for the insight zork. I'll begin the c# asp.net port shortly. There's probably already one out there but I'm bored.

Share this post


Link to post
Share on other sites
Thanks for the insight zork. I'll begin the c# asp.net port shortly. There's probably already one out there but I'm bored.

static HttpWebRequest RequestBuilder(string requestUri, string currentPage, string referer, string address)

	{

		Cookie cookieOne = new Cookie("currentPage", currentPage);

		Cookie cookieTwo = new Cookie("cookies", "true");

		Cookie cookieThree = new Cookie("cookieMenu", "all");


		cookieOne.Domain = address;

		cookieTwo.Domain = address;

		cookieThree.Domain = address;


		CookieContainer thisContainer = new CookieContainer();


		thisContainer.Add(cookieThree);

		thisContainer.Add(cookieTwo);

		thisContainer.Add(cookieOne);


		HttpWebRequest request = (HttpWebRequest)WebRequest.Create(requestUri);


		request.Accept = "*/*";

		request.Headers.Add(HttpRequestHeader.AcceptLanguage, "en-us");

		request.Headers.Add("US-CPU", "x86");

		request.UserAgent = "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; SLCC1; .NET CLR 2.0.50727; .NET CLR 3.0.04506; .NET CLR 1.1.4322)";

		request.Referer = referer;

		request.CookieContainer = thisContainer;


		return request;

	}
The ugly hacked up function I wrote a while back to form a request object with the required parameters to get the xml back. I would call it like:
HttpWebRequest request = RequestBuilder("http://" + address + "/guild-info.xml?r=" + serverName + "&p=1&n=" + guildName + "〈=", @"guild-info.xml%3Fr%3D" + serverName + "%26n%3D" + guildName + "%26p%3D1", @"http://" + address + "/#guild-info.xml?r=" + serverName + "&n=" + guildName + "&p=1", address);

Used for http://www.thepalsforlife.com/ftp/ArmoryParse/. If you're offended by the word faggot, that link will most likely be extremely offensive.

EDIT: I attached the source to my armory parse. It's pretty ugly and completely devoid of comments since it's something I hacked up in an afternoon and never really bothered with again. Hopefully someone can get some value out of the source however.

armoryparse.zip

Share this post


Link to post
Share on other sites

I just want to give you an update on this to show what amazing stuff can be done.

I built our own item search based on the Armory XML, take a look :)

armory.gif

All data is generated in real time, no database is used.

p.s. I couldn't use the phparmory XML parser, sadly it had a bug with XML attributes. But i found another one that worked properly and nearly the same.

Share this post


Link to post
Share on other sites
p.s. I couldn't use the phparmory XML parser, sadly it had a bug with XML attributes. But i found another one that worked properly and nearly the same.

What did you end up using? I was starting to use phpArmory, but if it's bugged, I should either look at fixing it or just change to something else.

Share this post


Link to post
Share on other sites

I can just recommend antiarcs armory scripts as basis.

http://wow.tachyonsix.com/armory/

http://svn.digitalsentience.com/svn/armory/

Especially:

http://svn.digitalsentience.com/svn/armory/_armory.php

You can remove some code (which is only used for some special functions of his scripts) and edit it to fit your needs, but I found it to be perfect to build some websites quickly.

I'm using some lines of it in the script which generates our memberlist (http://pernoctem.de/members.php) twice a day automatically via cron jobs.

Share this post


Link to post
Share on other sites

@Coeus

phpArmory bugged for me so I switched to another parser.

@Kallisti

I don't know if the scripts from antiarc require php5.0 which some web-server don't have. (simplexml is 5.0 only)

Share this post


Link to post
Share on other sites
I use cURL to pull down the xml and simplexml to parse it for my guilds roster page. Requires PHP5, which most webhosts haven't switched to (including our host). I run the script below on my desktop that has PHP5, it parses the info I need and puts it into a mysql database at our host. Then on our hosts server with PHP4, roster.php parses the data from the mysql database.


#!/usr/bin/php
<?php

class roster_gen {

const BROWSER="Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.2) Gecko/20070319 Firefox/2.0.0.3";

public $query;
public $server;
public $guild;
public $guildie;
public $page;

public function __construct ( $query, $server, $guild, $guildie, $page ) {
$this->query = $query;
$this->server = $server;
$this->guild = $guild;
$this->guildie = $guildie;
$this->page = $page;
} // end of __construct()

public function pull_xml() {

if( $this->query === 'roster' ){
$url = 'http://armory.worldofwarcraft.com/guild-info.xml?r=' . $this->server . '&n=' . $this->guild . '&p=' . $this->page;

}elseif( $this->query === 'character' ){
$url = 'http://armory.worldofwarcraft.com/character-sheet.xml?r=' . $this->server . '&n=' . $this->guildie;

}

$ch = curl_init();
curl_setopt ($ch, CURLOPT_URL, $url);
curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt ($ch, CURLOPT_CONNECTTIMEOUT, 15);
curl_setopt ($ch, CURLOPT_USERAGENT, roster_gen::BROWSER);

$url_string = curl_exec($ch);
return simplexml_load_string($url_string);

curl_close($ch);
} // end of pull_xml()

} // end class

// query, realm, guild, guildie, page
// query can be roster or character
$roster = new roster_gen (roster, cenarius, insurrection, NULL, 1);

$xml_roster = $roster->pull_xml();
$battlegroup = $xml_roster->guildInfo->guild['battleGroup'];
$num_guildies = $xml_roster->guildInfo->guild->members['memberCount'];

$roster->query=character;
$name = 'someguildie'; //change to character you'd like to lookup
$roster->guildie=$name;
$xml_char = $roster->pull_xml();

$tree1 = $xml_char->characterInfo->characterTab->talentSpec['treeOne'];
$tree2 = $xml_char->characterInfo->characterTab->talentSpec['treeTwo'];
$tree3 = $xml_char->characterInfo->characterTab->talentSpec['treeThree'];

$lastLOGIN = $xml_char->characterInfo->character['lastModified'];

$title = $xml_char->characterInfo->character['title'];

echo "Guild:$roster->guild Realm:$roster->server Battlegroup:$battlegroup\n";
echo "Name:$name($title), Talents:$tree1/$tree2/$tree3 Last Login: $lastLOGIN\n";
?>
[/PHP]

If you do a var_dump($xml_char) or var_dump($xml_roster) you'll see all the options you can pull from the armory.

Hope this is helpful.

I have got this error when use this form :

Fatal error: Call to undefined function curl_init() in C:\wamp\www\phpArmory\character.php on line 31

Can you help me ? I think this function is not valid right ?

Share this post


Link to post
Share on other sites
Can you help me ? I think this function is not valid right ?

You will need libcurl for this and you will also need to compile PHP with the --with-curl=X directive, where X is the location of libcurl's libraries and includes.

If you can't or do not want to use cURL you have to fsockopen() and construct the GET request yourself. Zork posted an example of how to do this: http://dm.next-gen.org/files/search_xml_example_fr.html

Share this post


Link to post
Share on other sites

I'm using Google AppEngine for my Armory-crawling site. If anyone else is using it, AppEngine's URL fetching ability doesn't let one set the User-agent so only the HTML responses are available. If anyone knows a workaround I'd love to hear it.

Here's my tool, Gear Wishlist that generates a list of potential gear upgrades. It doesn't support power-user tweaking, but it a simple way to eyeball what's out there.

Share this post


Link to post
Share on other sites
I'm using Google AppEngine for my Armory-crawling site. If anyone else is using it, AppEngine's URL fetching ability doesn't let one set the User-agent so only the HTML responses are available. If anyone knows a workaround I'd love to hear it.

Here's my tool, Gear Wishlist that generates a list of potential gear upgrades. It doesn't support power-user tweaking, but it a simple way to eyeball what's out there.

This isn't really a great thread for it, but it would be cool to get source code for it when you have something working.

Also, right now "Silver Hand" doesn't seem to work at all (says "Error: Server Error"), but "Silver+Hand" pops up asking me if I want Feral DPS or Tanking, and a couple times it has shown my current gear beyond the popup asking for which feral spec I am. After clicking a spec it then continues to "Error: Server Error"

Share this post


Link to post
Share on other sites
This isn't really a great thread for it, but it would be cool to get source code for it when you have something working.

Also, right now "Silver Hand" doesn't seem to work at all (says "Error: Server Error"), but "Silver+Hand" pops up asking me if I want Feral DPS or Tanking, and a couple times it has shown my current gear beyond the popup asking for which feral spec I am. After clicking a spec it then continues to "Error: Server Error"

Interesting, I hadn't tested with realm names containing spaces. I'll look into it, thanks for the heads-up!

(The server logs show a lot of errors trying to fetch character sheets from the armory.)

EDIT: I made a trivial change to replace spaces with '+' for the armory url generation and it seems to be working for you now.

Share this post


Link to post
Share on other sites

After i realized that I'm to dump to recompile PHP with cURL, i come up with this to get the Armory XMLs


$ctx = stream_context_create(Array("http" => Array("user_agent" => "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1")));
$charXml = (@file_get_contents(ARMORY_URL.urlencode($name),0,$ctx));
[/PHP]

Works great until now on Ultionis Sanguinis for Member-Pages and Item-Tooltips... if you don't use IE, but thats a style problem.

Share this post


Link to post
Share on other sites

I did something very similar, but in Java. Now I get "Server is busy. Please try again later." for all my requests. Seems like I got my IP banned.

Just a friendly warning to remember to put a delay between your requests. Don't want to see others getting banned.

Share this post


Link to post
Share on other sites

You have to throttle your requests. If you exceed 45 requests in like a minute (or one per 1.5 seconds over a sustained period) you'll start pulling 503's. If you keep hammering after you're pulling 503's then it'll ban you for a day or so. It only lasts for a day or so, but it's your warning.

Share this post


Link to post
Share on other sites

  • Recently Browsing   0 members

    No registered users viewing this page.