Release Trade Computer Extension Mk.II

Hello everyone and welcome to the latest news of TCE development.

Since the migration of EDDN to a new host in early August, we've lost the main functionality of TCE-Relay to support TCE with price data from EDDB/EDDN.

Today, I like can announce, that the next release (1.6.5) will bring back the ability to update your database with actual prices.
Additionally, you will be able to update trade stations, shipyards, outfittings, star systems (visited or all) and factions (followed or selectables).

This all is done by TCE itself, no other tools is in-between. That's now possible, because TCE now has a file server attached, where all required EDDB API files got mirrored, everyday.
The creation of an initial database is TCE-Relay last usefullness, but I think, this part will fall also to TCE in the near future.

Furthermore, TCE has gained noticeable more performance for very large database, tested it with 40k trade stations at a trade range of 90 LY.
It is nice to have so much, BUT updating all prices of all stations from EDDB will take some time, hitting sometimes the 'out of memory' barrier, because of soaking all data in at once for less processing times.
That was fixed by cutting the cake into four clusters to reduce memory usage against processing times.
So all in all, it's working good, but has to be intensively tested in the upcoming beta phase.

That's all for today, at last a picture of the updated Extension tab of the launcher.

Testing, testing, 1, 2, 3. I'm ready. :D
 
[1] SECURITY STATE ISSUE
1JkmgQ9.png
I thought it was a TCE error but it appears to be an issue with the Journal, but I'm not sure, hence why I'm reporting it. Let me know and if it's a Journal issue I'll create a bug for it.
{ "timestamp":"2017-12-08T18:36:57Z", "event":"FSDJump", "StarSystem":"Senones", "StarPos":[5.156,-28.563,66.844], "SystemAllegiance":"Independent", "SystemEconomy":"$economy_Agri;", "SystemEconomy_Localised":"Agriculture", "SystemGovernment":"$government_Anarchy;", "SystemGovernment_Localised":"Anarchy", "SystemSecurity":"$GALAXY_MAP_INFO_state_lawless;", "SystemSecurity_Localised":"Lawless", "Population":1882321774, "JumpDist":4.989, "FuelUsed":0.212907, "FuelLevel":24.354832, "Factions":[ { "Name":"Workers of Senones Green Party", "FactionState":"Boom", "Government":"Democracy", "Influence":0.096806, "Allegiance":"Federation" }, { "Name":"Boloo Liberals", "FactionState":"None", "Government":"Democracy", "Influence":0.080838, "Allegiance":"Federation", "RecoveringStates":[ { "State":"Boom", "Trend":0 } ] }, { "Name":"Pilots Federation Local Branch", "FactionState":"None", "Government":"Democracy", "Influence":0.000000, "Allegiance":"PilotsFederation" }, { "Name":"Senones Crimson Transport Hldgs", "FactionState":"Boom", "Government":"Corporate", "Influence":0.233533, "Allegiance":"Federation", "PendingStates":[ { "State":"Outbreak", "Trend":1 } ] }, { "Name":"Senones Defence Party", "FactionState":"Boom", "Government":"Dictatorship", "Influence":0.041916, "Allegiance":"Independent" }, { "Name":"Senones Crimson Dynamic Holdings", "FactionState":"None", "Government":"Corporate", "Influence":0.118762, "Allegiance":"Independent" }, { "Name":"Justice Party of Senones", "FactionState":"Boom", "Government":"Dictatorship", "Influence":0.047904, "Allegiance":"Independent" }, { "Name":"Diamond Frogs", "FactionState":"Boom", "Government":"Anarchy", "Influence":0.380240, "Allegiance":"Independent", "PendingStates":[ { "State":"Expansion", "Trend":0 } ] } ], "SystemFaction":"Diamond Frogs", "FactionState":"Boom" }
Security State of this system "SENONES" is ANARCHY, Although I belive it's really LAWLESS, which is what I've edited the security to in the db.
 
Last edited:
Hello everyone and welcome to the latest news of TCE development.

...because TCE now has a file server attached, where all required EDDB API files got mirrored, everyday...

Hi Eventure! Interesting news!

Can you explain the 'file server' a bit more?

Do you mean there is a non-FD file server 'somewhere' that TCE pulls data from?

Or does TCE create a db locally on my computer by pulling data from FD api?

I am a bit skittish about getting data from a non-FD source, not so much because I don't trust the other data source holder, but because they can get hit by viri/malware and then when I connect, I get hit too. Of course, that can still happen to an FD source, but I consider it much less likely.

Also, as I understand it, the usage would be to manually pull the update via TCE BEFORE you start playing ED, say once a day or once a week or whatever. It's not done while you are playing the game (unless you tab out and make TCE do it I suppose). And it's not automatic, you get to decide when, or if, that pull is done. Yes?

Thanks!
 
Hi Eventure! Interesting news!

Can you explain the 'file server' a bit more?

Sure, the attached file server is hosted by myself, no other party is involved. It provides the files from the nightly dump of EDDB's database, like prices.csv, stations.jsonl, etc. for TCE only.

The launcher of TCE will be capable of downloading these compressed files (about 30 MB total) to the new EDDB folder of TCE, where they got used to update your TCE database at command. An auto-update is not available.
The files got only downloaded, if you press the respective button at the extension tab of the launcher. If you don't want to use this kind of data update, you can simply ignore the buttons and launch TCE as usual.
All files got downloaded only once a day when pressing an update button, because I have included a timestamp for the dump files at the server.

The data is now processed by TCE itself (TCE-Relay serving only as an initial database creator, as before, without price data), which is shown for the user while the process is running.
This should be done only once a day before launching TCE, because the EDDB files changing only once a day too.

All in all, it is like TCE-Relay before, but now hosted by myself, with additional content you can update.
But as always, it is your choice to use it, but you don't have to, it is only an option.
 
Last edited:
Sure, the attached file server is hosted by myself, no other party is involved. It provides the files from the nightly dump of EDDB's database, like prices.csv, stations.jsonl, etc. for TCE only.

The launcher of TCE will be capable of downloading these compressed files (about 30 MB total) to the new EDDB folder of TCE, where they got used to update your TCE database at command. An auto-update is not available.
The files got only downloaded, if you press the respective button at the extension tab of the launcher. If you don't want to use this kind of data update, you can simply ignore the buttons and launch TCE as usual.
All files got downloaded only once a day when pressing an update button, because I have included a timestamp for the dump files at the server.

The data is now processed by TCE itself (TCE-Relay serving only as an initial database creator, as before, without price data), which is shown for the user while the process is running.
This should be done only once a day before launching TCE, because the EDDB files changing only once a day too.

All in all, it is like TCE-Relay before, but now hosted by myself, with additional content you can update.
But as always, it is your choice to use it, but you don't have to, it is only an option.

So if you suddenly disappear or decide you don't want to run the server does this mean TCE dies?

Can the server not be hosted somewhere else so it is not so vulnerable should you decide to discontinue support?
 
So if you suddenly disappear or decide you don't want to run the server does this mean TCE dies?

Can the server not be hosted somewhere else so it is not so vulnerable should you decide to discontinue support?

There is no reason to be about concerned, that TCE suddenly dies in a flash, big bang, or puff of smoke. It's a ten-year project, like ED.
It was always designed to be an independent app. All supported tools are there to make your life easier in ED, so filling EDDB data into TCE will do the same.

TCE is nearly three years on air now, continusly developing into something nice to have. So I give you my word, there is no end in sight.
The file server has to be under my control, so I can make sure, there is no problem with the data, for security reasons,
the service is always up and additionally it's free, without charge.

The TCEventure will continue...
 
Bit of a strange one this.

TCE has been working fine all day and have just come back after a break for a smoke and drink and now when I start up TCE I get wrong commander selected. Have only got 1 commander set up. Also upon entering game I also get a message about incorrect game version and running beta journals.

spwLnWU.jpg


Have sent error report but unsure if that going to help.

Thanks for all the hard work.
 
Last edited:
Sure, the attached file server is hosted by myself, no other party is involved. ....
All in all, it is like TCE-Relay before, but now hosted by myself, with additional content you can update.
But as always, it is your choice to use it, but you don't have to, it is only an option.

Cool man, thanks for the explanation!
 
Bit of a strange one this.

TCE has been working fine all day and have just come back after a break for a smoke and drink and now when I start up TCE I get wrong commander selected. Have only got 1 commander set up. Also upon entering game I also get a message about incorrect game version and running beta journals.

https://i.imgur.com/spwLnWU.jpg

Have sent error report but unsure if that going to help.

Thanks for all the hard work.

Hmm..., that's strange indeed.
Have found an issue in your TCE_Personal.db, so I will send you the fixed files via mail anytime soon.
 
Hmm..., that's strange indeed.
Have found an issue in your TCE_Personal.db, so I will send you the fixed files via mail anytime soon.

WoW, thanks for the quick response and sending of files.

All seems good so far but have only started TCE and ED to check operation and then closed back down. Will try to test more again later today.

Thanks again.
 
Hi Eventure,
May I say I love what you have done with TCE since I have been away.

But I'm seeing a problem with some of the planet ports and outposts. What's happening is once I have added them to TCE and leaving the planet i'm noticing that in the summary the 'last visited' is 00:00:00 and those that read 00:00:00 claim they have no market when looking at them in the trade window from a different system. If I go back to the planet and land at the station it will then recognise that it does actually have a market and (so far) remain like it.

I'm running TCE 1.6.4.3 and EDMC 2.47.
 
Hi Eventure,
May I say I love what you have done with TCE since I have been away.

But I'm seeing a problem with some of the planet ports and outposts. What's happening is once I have added them to TCE and leaving the planet i'm noticing that in the summary the 'last visited' is 00:00:00 and those that read 00:00:00 claim they have no market when looking at them in the trade window from a different system. If I go back to the planet and land at the station it will then recognise that it does actually have a market and (so far) remain like it.

I'm running TCE 1.6.4.3 and EDMC 2.47.

Thanks for reporting, found the display issue.
To be sure, did you have added the port/outpost to your database with TCE-Relay, or with the Market Database panel?
 
Talking of economies, I've come across a station with 3:

https://i.imgur.com/eNfoNUB.jpg

It will be intresting to see if the Economies change when the station is no longer UA BOMBED, I suspect Service economy is a state change due to this, that's just a guess though.

I'm still tracking this and I've looked at other stations that are UA bombed all of them have Service as a 3rd Economy. I'm also tracking 2 stations that are under threat of being UA bombed to see if they gain this economy when all services have been shut down. I suspect they will and will update when I know more.

Galactic News: Starport Status Update

As suspected this station has now lost its 'SERVICE' economy as this was a temporary state that stations go into when they have been UA BOMBED.
 
Hello everyone and welcome to the latest news of TCE development.

Since the migration of EDDN to a new host in early August, we've lost the main functionality of TCE-Relay to support TCE with price data from EDDB/EDDN.

Today, I like can announce, that the next release (1.6.5) will bring back the ability to update your database with actual prices.
Additionally, you will be able to update trade stations, shipyards, outfittings, star systems (visited or all) and factions (followed or selectables).

This all is done by TCE itself, no other tools is in-between. That's now possible, because TCE now has a file server attached, where all required EDDB API files got mirrored, everyday.
The creation of an initial database is TCE-Relay last usefullness, but I think, this part will fall also to TCE in the near future.

Furthermore, TCE has gained noticeable more performance for very large databases, tested it with 40k trade stations at a trade range of 90 LY.
It is nice to have so much, BUT updating all prices of all stations from EDDB will take some time, hitting sometimes the 'out of memory' barrier, because of soaking all data in at once for less processing times.
That was fixed by cutting the cake into four clusters to reduce memory usage against processing times.
So all in all, it's working good, but has to be intensively tested in the upcoming beta phase.

That's all for today, at last a picture of the updated Extension tab of the launcher.



Well this is great news and I love the newest features you added to it especially the update tracked factions now I don't have to fly to all those systems Woo Hooo! Great Job Eventure getting it back online and adding those features I cannot wait to get that update and start using it. Next release will that be going from 1.6.4.3 straight to 1.6.5 did I miss a update easy to do LOL
 
OK Eventure so I getting my mind around the next full release and thinking about your last message to me
Hi there,

all keybinds are stored at the TCE.config file at the root folder. The file is transferred from an outdated full-version to the next by the tranfer process, done at the launcher.
The backup function is mainly designed to store all databases, but lately (since V1.6.3.4), the TCE.config is included into the process.
I always recommended to rename an outdated version (e.g. to TCE.old) and transfer the databases with the launcher. See below:
1. Rename your current TCE folder (e.g. D:\TCE.old).
2. Install the new full TCE Version (e.g. D:\TCE).
3. Run the TCE Launcher.
4. Select Database -> Transfer -> Choose old folder (D:\TCE.old).
5. After scanning, select Start Transfer.

If you follow these steps, nothing is lost, nothing has to be redo.

The faction data is stored at the TCE_Factions.db database. Because the selected factions to track are also stored at the TCE.config, it got lost too, as the keybinds.
So generally spoken, use the transfer function from the launcher to move your old database to a new version, instead of creating a backup and restoring i at the new version. That's the task of the trasnfer function at the launcher.

Hope that helps.

Here is a tip for you specifically:
The faction database structure wasn't changed since V1.5.8, so if you have selected again the factions, you want to track, at the Factions panels, close TCE thereafter, and then copy by hand the TCE_Factions.db from the old to the new version.
So your lost data should be available again.
Additionally, you could open the TCE.config file at the old version, copy the full 'Keybinds' block by hand and replace it at the TCE.config from the new version, to restore all selected keybinds at the new version.

I realized I kept doing it from a Backup, so I get what I was doing wrong. My questions or the next release then.
I want to build a new database 60 ly years around my home world using TCE Relay but I also would like to keep my faction history and based upon your specific tips in the spoiler is their a way of merging the old Factions DB with the newest factions DB so that I have old history with the newest history and then transfer that merged DB into the newly built DB I made with TCE Relay. Personally I just want a new Trade Database but leave my Factions and Cartography alone or import it. Also and what muck up my old database after trying and deleting a starport is there a way we could add in a simply TCE Relay for a specific station download. I do a lot of Outbreak and Famine relief efforts which shoot the prices way up on certain commodities so once I go there I will get these inflated prices stored in my DB sometimes which the auto destinations always pick as the best profit even after the prices go back to normal and I know the states are over. Currently I go to EDDB and just get the current normal price and manually enter it where in lies my problem and how I muck it up before (never trust me manually editing the DB LOL).
 
OK Eventure so I getting my mind around the next full release and thinking about your last message to me
Hi there,

all keybinds are stored at the TCE.config file at the root folder. The file is transferred from an outdated full-version to the next by the tranfer process, done at the launcher.
The backup function is mainly designed to store all databases, but lately (since V1.6.3.4), the TCE.config is included into the process.
I always recommended to rename an outdated version (e.g. to TCE.old) and transfer the databases with the launcher. See below:
1. Rename your current TCE folder (e.g. D:\TCE.old).
2. Install the new full TCE Version (e.g. D:\TCE).
3. Run the TCE Launcher.
4. Select Database -> Transfer -> Choose old folder (D:\TCE.old).
5. After scanning, select Start Transfer.

If you follow these steps, nothing is lost, nothing has to be redo.

The faction data is stored at the TCE_Factions.db database. Because the selected factions to track are also stored at the TCE.config, it got lost too, as the keybinds.
So generally spoken, use the transfer function from the launcher to move your old database to a new version, instead of creating a backup and restoring i at the new version. That's the task of the trasnfer function at the launcher.

Hope that helps.

Here is a tip for you specifically:
The faction database structure wasn't changed since V1.5.8, so if you have selected again the factions, you want to track, at the Factions panels, close TCE thereafter, and then copy by hand the TCE_Factions.db from the old to the new version.
So your lost data should be available again.
Additionally, you could open the TCE.config file at the old version, copy the full 'Keybinds' block by hand and replace it at the TCE.config from the new version, to restore all selected keybinds at the new version.

I realized I kept doing it from a Backup, so I get what I was doing wrong. My questions or the next release then.
I want to build a new database 60 ly years around my home world using TCE Relay but I also would like to keep my faction history and based upon your specific tips in the spoiler is their a way of merging the old Factions DB with the newest factions DB so that I have old history with the newest history and then transfer that merged DB into the newly built DB I made with TCE Relay. Personally I just want a new Trade Database but leave my Factions and Cartography alone or import it. Also and what muck up my old database after trying and deleting a starport is there a way we could add in a simply TCE Relay for a specific station download. I do a lot of Outbreak and Famine relief efforts which shoot the prices way up on certain commodities so once I go there I will get these inflated prices stored in my DB sometimes which the auto destinations always pick as the best profit even after the prices go back to normal and I know the states are over. Currently I go to EDDB and just get the current normal price and manually enter it where in lies my problem and how I muck it up before (never trust me manually editing the DB LOL).

TCE-Relay now only creates a pool of stations around your actual position in game, with little data about the stations.
So after creating a new station database with TCE-Relay, you should use the new EDDB-Relay to update all station with actual commodity prices, shipyard and outfitting data.
Your faction database isn't affected in this process, nor your cartography database, so you will be able to continue to use them without problem.

Updating specific markets are not available, TCE will update only that stations in database, which require an update, because of data changes, like commodity prices.
This has to be done only once a day, just before the first launch of TCE. So residing way off prices are usually replaced in this process.
 
Hi Eventure,

Just a quick question regarding TCE-Relay.

When I land at an existing station and tce-relay connects automatically is it updating just that station or all the stations in my database?

Thanks,
 
Hi Eventure,

Just a quick question regarding TCE-Relay.

When I land at an existing station and tce-relay connects automatically is it updating just that station or all the stations in my database?

Thanks,

It's not TCE-Relay that updates stations when you land, that is EDMC. And it only updates the station you have landed at.

The new TCE-Relay - You manually run it prior to stating TCE and select the number of days old date you want to update and this will then update ALL stations you have REGISTERED. It doesn't add station data to stations you haven't visited yet.
 
Last edited:
Back
Top Bottom