ED Astrometrics: Maps and Visualizations

Orvidius · May 28, 2019

I added a spreadsheet with "database statistics", which is really just things like numbers and totals for bodies per type/class, systems, rings, etc.

https://edastro.com/mapcharts/files/database-stats.csv

It's short enough that I can include a copy of today's output here:

NULL	104
A (Blue-White super giant) Star	7811
A (Blue-White) Star	1297219
B (Blue-White super giant) Star	124
B (Blue-White) Star	391038
Black Hole	126178
C Star	168
CJ Star	750
CN Star	5981
F (White super giant) Star	1720
F (White) Star	2656733
G (White-Yellow super giant) Star	1248
G (White-Yellow) Star	2079926
Herbig Ae/Be Star	30493
K (Yellow-Orange giant) Star	16470
K (Yellow-Orange) Star	5717003
L (Brown dwarf) Star	2456043
M (Red dwarf) Star	10144444
M (Red giant) Star	46813
M (Red super giant) Star	1183
MS-type Star	9034
Neutron Star	1246563
O (Blue-White) Star	46925
S-type Star	9419
StellarRemnantNebula	1
Supermassive Black Hole	1
T (Brown dwarf) Star	1156603
T Tauri Star	667419
White Dwarf (D) Star	1099
White Dwarf (DA) Star	32871
White Dwarf (DAB) Star	14175
White Dwarf (DAV) Star	3627
White Dwarf (DAZ) Star	493
White Dwarf (DB) Star	5836
White Dwarf (DBV) Star	1183
White Dwarf (DBZ) Star	118
White Dwarf (DC) Star	49873
White Dwarf (DCV) Star	4306
White Dwarf (DQ) Star	20
Wolf-Rayet C Star	3444
Wolf-Rayet N Star	2446
Wolf-Rayet NC Star	2549
Wolf-Rayet O Star	7671
Wolf-Rayet Star	81
Y (Brown dwarf) Star	658049

Stars as planets	527059
Stars with belts	7046171
Stars with rings	398552
Total Stars	28905255

Ammonia world	198014
Class I gas giant	3165296
Class II gas giant	737794
Class III gas giant	1665106
Class IV gas giant	281316
Class V gas giant	38833
Earth-like world	165910
Gas giant with ammonia-based life	392349
Gas giant with water-based life	734265
Helium gas giant	12
Helium-rich gas giant	22312
High metal content world	17860568
Icy body	26297744
Metal-rich body	1163948
Rocky body	10529027
Rocky Ice world	2251267
Water giant	53725
Water world	1724281

Planets as planets	19808663
Planets as moons	15144467
Planets with rings	5907606
Total Planets	67281767

Systems with Stars	18770101
Systems with Planets	8011231
Total Systems	40152699

WhoCares · May 28, 2019

Very interesting - how comes this list has such different numbers compared to the lists of celestial bodies in the EDSM FAQ, e.g. stars?
I thought the two G super-giants I found on my current trip were some super-rare "yellow elephants" (one of them earning me a "Reported by" in the Codex, the other beating the record for the heavies star on EDSM at 3.2500 vs 3.2188, though not yet listed there), as the latter gives the current count at 60 (47 about one or two weeks ago, so this list still receives updates!)

Orvidius · May 28, 2019

My numbers will always be about 1 to 3 days behind, since it's not updating in real time. I'm tempted to add EDDN tracking so that I can get some real time data too, but it hasn't been important enough so far.

Maolagin · May 29, 2019

Orvidius said:
StellarRemnantNebula 1
Supermassive Black Hole 1

Sure, there's obviously only the one SMBH, but what is that unique "stellar remnant nebula"? Does one of the hand crafted nebulas has its own type in the journals?

Orvidius · May 29, 2019

That does make me wonder if EDSM was experimenting with adding "planetary" nebulae (which actually are stellar remnants, as depicted, since true planetary nebulae would have white dwarfs instead of black holes or neutron stars). There's only one in the data set, so it's most likely a test case.

Code:

mysql> select * from systems,stars where edsm_id=systemId and subType='StellarRemnantNebula' \G
*************************** 1. row ***************************
                           ID: 20761395
                      eddb_id: NULL
                      edsm_id: 20810654
                         id64: 2006955690564
                         name: Skombuia ZT-A e467
                    edsm_date: 2018-05-06 14:43:45
                    eddb_date: NULL
                      updated: 2019-05-10 12:00:52
                      coord_x: -3950.25
                      coord_y: 2048.84
                      coord_z: 28386.4
                      boxelID: 332490042704
                           id: 82297298
                   systemId64: 2006955690564
                     systemId: 20810654
                         name: Skombuia ZT-A e467 Nebula
                      subType: StellarRemnantNebula
                    isPrimary: NULL
                   isMainStar: 1
                  isScoopable: 0
                   updateTime: 2019-04-07 06:35:49
                      updated: 2019-04-08 12:08:07
                       offset: NULL
            distanceToArrival: 0
rotationalPeriodTidallyLocked: 0
             rotationalPeriod: 0
                    axialTilt: 0
                          age: 256
            absoluteMagnitude: 0
                   luminosity: VII
           surfaceTemperature: 0
                  solarMasses: 0
                  solarRadius: 0
           orbitalInclination: 0
               argOfPeriapsis: 0
                semiMajorAxis: 0
          orbitalEccentricity: 0
                orbitalPeriod: 0
                       bodyId: 7
                      parents: Null:0
                commanderName: NULL
                discoveryDate: NULL
1 row in set (45.62 sec)

WhoCares · May 29, 2019

Orvidius said:
My numbers will always be about 1 to 3 days behind, since it's not updating in real time. I'm tempted to add EDDN tracking so that I can get some real time data too, but it hasn't been important enough so far.

It just seems the two statistics differ so significantly. EDSM lists today 62 G super giants, you have 1248, EDSM lists 2919 F super giants, you 1720, while I had assumed that underneath both do use the same source of information.
Then again, when I search in EDSM for G super giants up to 5kly around Sol , I already get 111 results, or even 193 5kly around Colonia - clearly contradicting the results on EDSMs own statistics page...

Apsley · May 29, 2019

Just discovered the mapping tool, it's absolutely superb. Ta very much indeed!

marx · May 29, 2019

Orvidius said:
That does make me wonder if EDSM was experimenting with adding "planetary" nebulae (which actually are stellar remnants, as depicted, since true planetary nebulae would have white dwarfs instead of black holes or neutron stars). There's only one in the data set, so it's most likely a test case.

And Skombuia ZT-A e467 is a planetary nebula, so yep. Might be there as a test in case the journals would log the required information.

Orvidius · May 29, 2019

FYI, I just added a feature to the interactive map. There's a button in the lower-left that lets you select a journal file, and it will extract the last position for that commander and place a pin on the map. This doesn't upload the file, it scans in your browser to pull the coordinates.

WhoCares said:
It just seems the two statistics differ so significantly. EDSM lists today 62 G super giants, you have 1248, EDSM lists 2919 F super giants, you 1720, while I had assumed that underneath both do use the same source of information.
Then again, when I search in EDSM for G super giants up to 5kly around Sol , I already get 111 results, or even 193 5kly around Colonia - clearly contradicting the results on EDSMs own statistics page...

Huh, that is interesting. I don't know how often they update their own statistics. Some things on the EDSM site update at slower intervals. I haven't looked too deeply into that.

WhoCares · May 29, 2019

Orvidius said:
...
Huh, that is interesting. I don't know how often they update their own statistics. Some things on the EDSM site update at slower intervals. I haven't looked too deeply into that.

Well, from my post yesterday to my previous one today, the G super giants went up +2. Currently I believe more in your results, as I can already prove that theirs are wrong (see above with the search); still interesting… Maybe someone should tell them - I guess those pages are so well-hidden (I only found them by chance while looking for something else in the FAQ) that hardly ever anybody looks into them. And so far there was no comparison/cross/sanity checks until you posted your results, and bursting my little bubble of being special for finding two G super giants (2 in 62 is more special than 2 in 1248)

I thought that I might even have tagged something that even Allitnil might not yet have found (well, once I dock and sell the data by tomorrow or the next days), but with 1248 already found that chance is slim...

Orvidius · May 29, 2019

I'm hoping that those aren't due to duplicates. That would be a lot of duplicates! EDSM sometimes creates a new entry when a system or planet gets renamed, for instance, and somehow ignores the older entries. The nightly dumps don't include any meta-data that is stored in separate tables on their side. Also, I don't have a way to see if something has since been deleted on their side, after it was added on mine. I don't think these things happen very often, so I'm also inclined to believe that there may be some flaws with how it's tallied there.

On my statistics report, it's counting the raw number of rows or unique IDs in my database to generate the numbers.

WhoCares · May 29, 2019

When I do the same search I did above ordered by distance from Sol (=111) changed just for the sort order, selecting anything except distance from Sol/Colonia/CMDR position, I receive 1135 G super giants, 135 less than your result. I guess in that case the range filter gets ignored (because there is no reference), and we get the full list of selected bodies. That could then maybe(!) be explained by duplicates....

nouspiro · May 30, 2019

It would be interesting to see biological codex entries map.

Orvidius · May 30, 2019

nouspiro said:
It would be interesting to see biological codex entries map.

That would be cool. I don't have data for that though.

Orvidius · May 30, 2019

Orvidius said:
FYI, I just added a feature to the interactive map. There's a button in the lower-left that lets you select a journal file, and it will extract the last position for that commander and place a pin on the map. This doesn't upload the file, it scans in your browser to pull the coordinates.

Small tweak to this feature today. I removed a click. Now, when you select a file, it scans it immediately, instead of waiting for you to hit a "scan" button.

EDIT: Actually, I've removed two clicks. When you click the "player position" button in the map, it now also immediately opens the file-selection dialog. Basically, it auto-clicks the "browse" button for you.

marx · May 30, 2019

nouspiro said:
It would be interesting to see biological codex entries map.

Unfortunately, EDSM doesn't share their Codex data, it can only be searched for via their website. Technically, you could use the search results to build your own, but that would be quite a lot of work.

Edit: Whoops, posted the same time as Orvidius.

Orvidius · May 30, 2019

Also added Base-2 Logarithmic and Linear versions of the HR diagrams. The existing Base-10 version has been stretched to be slightly wider too.

nouspiro · May 30, 2019

What if we ask nicely for Codex data?

marx · May 30, 2019

Go ahead, never hurts to see that there's one more person interested in it.

Orvidius · May 31, 2019

Orvidius said:
Small tweak to this feature today. I removed a click. Now, when you select a file, it scans it immediately, instead of waiting for you to hit a "scan" button.

EDIT: Actually, I've removed two clicks. When you click the "player position" button in the map, it now also immediately opens the file-selection dialog. Basically, it auto-clicks the "browse" button for you.

Now also added a suggested folder location for the journals. Right now it requires closing the file selection window so you can click on it, but I guess that's a necessary trade-off. Either there's an extra click to open the window, or an extra click to close it.