Pages: [1] :: one page |
|
Author |
Thread Statistics | Show CCP posts - 0 post(s) |
Clementina
The Scope
|
Posted - 2011.01.09 01:28:00 -
[1]
Hello Everybody,
I would like to pull down the picture of every character in Eve Online.
I have already figured out how to do this the stupid way, which is to request a character name for every number between 1 and 9999999999, then request pictures for the numbers which actually have names. But is there a slightly smarter way to get this done?
|
Nikolai Kondratiev
Sphere Design Inc.
|
Posted - 2011.01.09 02:00:00 -
[2]
Scrap battleclinic & eve-kill for characters ID, should give you a good amount of characters without spamming eve servers for "nothing". Should give you most chars that ever engaged another ship.
Same with Eve Forums to get all the troll alts that obviously don't undock or even log in.
Then character info gets added into cache, so you could hang around in Jita/Amarr/Rens/... and click on everyone's portrait to get a few thousands more of trade alts/carebears
Then no idea how you can go any further without using the "brute force" way. _ Ore Table | PI Profits |
Johnathan Roark
Caldari The Graduates Morsus Mihi
|
Posted - 2011.01.09 04:57:00 -
[3]
your likely to get a ban for the api after trying that. Why would you need every picture?
POS-Tracker 3.0 Hosting |
Clementina
The Scope
|
Posted - 2011.01.09 05:34:00 -
[4]
Originally by: Johnathan Roark you're likely to get a ban for the api after trying that. Why would you need every picture?
That's what I'm afraid of. As for why I would want the pictures? With the new Incarna characters, the old pictures will be going away, someone asked for something Here. I'm pretty sure I can exfiltrate the pictures, so I can hand it to someone who would actually be interested in hosting them in a website of some kind.
|
Clementina
The Scope
|
Posted - 2011.01.09 10:05:00 -
[5]
Okay, I've written the bot, it works the naive way of requesting about 10 billion numbers. I can push the button at any time (And let it chug away for probably 2 days), but I almost don't want to use it now. I've looked at battleclinic, but I can't figure out how to get information out of it. Is there anything known about characterID's that will reduce the space to maybe a few million, Is there a check digit? or a high minimum number?
I'm going to sleep on this. Goodnight everybody.
|
Catari Taga
Centre Of Attention Middle of Nowhere
|
Posted - 2011.01.09 10:32:00 -
[6]
Originally by: Clementina I have already figured out how to do this the stupid way, which is to request a character name for every number between 1 and 9999999999, then request pictures for the numbers which actually have names. But is there a slightly smarter way to get this done?
Yes, just request the pictures directly instead of hammering the API. Less stress on CCP's servers (no database lookup, just the web server giving you a 404), less likelyhood of you getting IP banned. --
|
Clementina
The Scope
|
Posted - 2011.01.09 22:28:00 -
[7]
Originally by: Catari Taga
Originally by: Clementina I have already figured out how to do this the stupid way, which is to request a character name for every number between 1 and 9999999999, then request pictures for the numbers which actually have names. But is there a slightly smarter way to get this done?
Yes, just request the pictures directly instead of hammering the API. Less stress on CCP's servers (no database lookup, just the web server giving you a 404), less likelyhood of you getting IP banned.
When you request a picture for a characterID that doesn't actually match a character, the image server gives a picture that looks like This Picture (It returns a picture, just a blank looking one), Using the api's ID to Name service will give you an xml document that looks like This xml document (It returns an the same xml document that it would if the id was valid, but it have an empty string for the name attribute.
Are you saying to loop through the image site to get valid images, then for the valid images, loop through the Name to ID API to get their actual names?
|
Arous Drephius
|
Posted - 2011.01.09 22:38:00 -
[8]
I expect the folks at EVSCO already have character pictures for pretty much any character that's ever been on a killmail, along with their characterID/name. You could try asking them for the data.
You could ask BC as well.
|
Catari Taga
Centre Of Attention Middle of Nowhere
|
Posted - 2011.01.09 22:44:00 -
[9]
Originally by: Clementina Are you saying to loop through the image site to get valid images, then for the valid images, loop through the Name to ID API to get their actual names?
I didn't realize you wanted names as well. You only really need names to sc**** EVE Gate for employment info to build corp member databases, but up to you I guess. --
|
Clementina
The Scope
|
Posted - 2011.01.11 03:45:00 -
[10]
On the General Discussion thread, CCP Purple Tentacle has said that he was working on preserving the pictures. Since I'm lazy and don't want to be banned from the API, I'm not going to do any actual work. I did write enough code to write a Thingy in python that you can use to pull a list of character pictures. It need a python interpreter to run, and you can do what you want with this code (And if someone posts a .exe version I would appreciate it greatly) Provided that you give me credit and use it for Eve Online related purposes.
|
|
Clementina
The Scope
|
Posted - 2011.01.13 08:06:00 -
[11]
I've done some more work on my CharacterPictureSaver. The Python code is still available here. But now there is also a .exe version which you can download, unzip, and then run from the command line.
If you have any questions or concerns, I read this thread, The original thread and also Evemail.
|
|
|
|
Pages: [1] :: one page |
First page | Previous page | Next page | Last page |