[The StellarForge Analysis] An inside look at a procedurally generated galaxy

marx · May 2, 2017

Oh hey, I just noticed that you use data from EGO as well. Does that mean that if I'd like to contribute to your project, I can just upload my stuff there (which I do anyway) and it would still be useful for you?

Vitamin Arrr said:
Nice! I envy you PC guys' cool route tracking softwares. Sigh. Maybe someday we'll get it on XBOX.

The chances of that are unfortunately low, since Microsoft doesn't want people tinkering with files on their consoles. I wonder if the XBox version of ED even stores journal files. Oh, and even then, you'd still have to transfer your logs to a computer to process them, as Microsoft also doesn't want you to run third-party apps on your console. (Same is bound to apply to Sony / PS4 when that version comes out.)

CMDR EfilOne · May 2, 2017

marx said:
Oh hey, I just noticed that you use data from EGO as well. Does that mean that if I'd like to contribute to your project, I can just upload my stuff there (which I do anyway) and it would still be useful for you?

Yes ....sorta hahah. Wolzan gave me a snapshot of the database around april/may of last year, so it's quite old, but I believe if he was able to do so back in the days, he may be able to get a more recent one, as well ! Best thing would be a REST API to be honest, like EDSM so that GET queries could be sent, heheh ! For now EGO supports table copypasta in the clipboard though so if I were to grab all the new data I'd probably do it per-body and grab the tables page per page, the end goal of the SFA project is to try to understand the stellarforge as much as possible through data collection and analysis, and now that EGO supports journal imports I think I'll really start to dive into it

Darth Krayt · May 3, 2017

marx said:
as Microsoft also doesn't want you to run third-party apps on your console. (Same is bound to apply to Sony / PS4 when that version comes out.)

What about UWP store apps? In theory it should be able to make an Xbox app. The question as you say is whether the Xbox even outputs journal files and if it does, would another app have permissions to read the journals.

marx · May 3, 2017

Darth Krayt said:
What about UWP store apps? In theory it should be able to make an Xbox app. The question as you say is whether the Xbox even outputs journal files and if it does, would another app have permissions to read the journals.

Oh yeah, that could work. Unfortunately, one has to register with Microsoft to certify UWP store apps, and that isn't free of course. Also, if I'm reading this right, for an app to be able to automatically access a user's files (and not just have the user pick them each manually), you need to register as a company, for even more money.
Also, if I was reading earlier posts right, ED on XBox doesn't store journal files yet, but FD are looking into implementing that. That was a while ago though, so it's either low priority, or has already been implemented - can't check it myself, heh.

Commander Wolzan · May 5, 2017

CMDR EfilOne said:
Yes ....sorta hahah. Wolzan gave me a snapshot of the database around april/may of last year, so it's quite old, but I believe if he was able to do so back in the days, he may be able to get a more recent one, as well ! Best thing would be a REST API to be honest, like EDSM so that GET queries could be sent, heheh ! For now EGO supports table copypasta in the clipboard though so if I were to grab all the new data I'd probably do it per-body and grab the tables page per page, the end goal of the SFA project is to try to understand the stellarforge as much as possible through data collection and analysis, and now that EGO supports journal imports I think I'll really start to dive into it

Hey - long time no speak.

Let me know if you need another data dump - the site has grown a lot just recently with the new ship log reader and we are at nearly 50,000 objects now.

For v2.0, I'm currently working on two main things:

1. Comms Link application - small background app which runs in the background, detects every time you complete a scan and submits it straight to the site making use of the new ship log reader functionality. I just got it working tonight so getting into testing and cleaning it up.

2. API update. EGO does currently have a REST API but its a bit crap tbh so i'm redoing it to tie in with this update so that other apps could use the same functionality to submit data to EGO if they wanted.
As part of this API update i'm relooking at the api calls which can be used to retrieve data from the site. For now though calls like this still work

http://www.elitegalaxyonline.com/api/ego_system/get_details_full/?system_name=Sol

or

http://www.elitegalaxyonline.com/api/ego_data/get_details/?object_name=Jupiter

Any suggestions on the kind of data this reworked api should be allowed to retrieve would be welcome.

iain666 · May 5, 2017

If your updated API has a POST method that takes the JSON straight from the journals plus an api key and without mapping property names to input_x then I can look at adding EGO updating as an option in ED Discovery. (I mean, I could if it still needs property name mapping, I'm just less likely to

)

AnthorNet · May 5, 2017

CMDR EfilOne said:
Yes ....sorta hahah. Wolzan gave me a snapshot of the database around april/may of last year, so it's quite old, but I believe if he was able to do so back in the days, he may be able to get a more recent one, as well ! Best thing would be a REST API to be honest, like EDSM so that GET queries could be sent, heheh ! For now EGO supports table copypasta in the clipboard though so if I were to grab all the new data I'd probably do it per-body and grab the tables page per page, the end goal of the SFA project is to try to understand the stellarforge as much as possible through data collection and analysis, and now that EGO supports journal imports I think I'll really start to dive into it

Do you need specific data ?

Qohen Leth · Aug 7, 2017

So... taken off yet?

CMDR EfilOne · Aug 7, 2017

Yeap ! I've been out since the past 5 months, just left Amundsen's Star, heading toward the Sepositus Beacon as we speak. CSVs are getting big, "omnomming" a lot of data

Commander Wolzan said:
Hey - long time no speak.

Let me know if you need another data dump - the site has grown a lot just recently with the new ship log reader and we are at nearly 50,000 objects now.

[snip]

Long time no speak indeed ! I am myself quite late as you can see ... I'll probably get back to you once the expedition has collected a decent amount of data, in the order of 100k planets, at least, leaving me some time to settle on the database structure, and find a proper automated script to convert your dumps toward what I aim for.
As always, thank you for all the help ! o7

----------------

Edit : Edited the OP with a new map, to reflect the path across the South-East chunk of the Outer Arm Vacuus.