In-Development TradeDangerous: power-user trade optimizer

maddavo · Dec 8, 2015

TD errors are because of my bad data with non-utf8 characters. The non-utf8 characters are (were) coming from EDDN. A user of ED Market Connector with an extended character set cmdr name (but still utf8 I think) was sending price updates to EDDN, but the EDDN server was not processing the extended character set and rather sent non-utf8 characters. My derp defence was deleting a non-utf8 character OK before processing but unfortunately there were two characters in the name and my derp defence stupidly only handled one. Of course the derp defence is now getting rid of all non-utf8 rather than just one instance.

I reported it to the ED: Market Connector github initially, and then @Marginal worked out what was going on and @Authornet fixed up the issue on EDDN.

Anyhoo - the DNS server is back up now (which was another thing due to some solar panel guys who did the wrong thing while I was away), I've got rid of the non-utf8 characters in the prices files so TD shouldn't spit out any more errors now.

Cheers,
Maddavo

rivimey · Dec 9, 2015

Horray! Thanks for all the hard work folks... and for the rest!

Laurin · Dec 13, 2015

Earlier this year I posted a small shell interface I wrote for TradeDangerous called itrade. Unfortunately I lost my local files of this tool and the attachment has been (automatically?) deleted from the forum by now.
Does perhaps someone who downloaded it still have it and could upload it for me? That would be a great help.

CMDR Carbo · Dec 15, 2015

Seems like there are tons of new commodities in Horizons.

sceaga · Dec 15, 2015

Also appears that the EDAPI is now broken. I can't get it to connect at all anymore to pull prices.

CMDR Carbo · Dec 15, 2015

sceaga said:
Also appears that the EDAPI is now broken. I can't get it to connect at all anymore to pull prices.

Same. Just says login failed.
Deleting cookies doesn't help either.
Maybe they changed the API.

PS: Also their own mobile app (iPhone) doesn't work anymore for me.

sceaga · Dec 15, 2015

I hope it's a simple fix, the ED API is SOOOOO helpful!

maddavo · Dec 16, 2015

Hi All,

Re: EDAPI:
EDAPI isn't broken - it seems the FD servers always take the iOS app offline after a major update. This happened for the last few versions (1.4, 1.3 - maybe earlier too). So not only EDAPI but also ED: Market Connector and other companion-app based data acquisition programs. Time to refresh your memory on how to update prices manually - what?!?

In the past, the companion app has worked again after a few days - probably when they're confident things are working OK. (the companion app creates extra load on the FD servers)

Re: 1.5/2.0 release
I have updated the Item.csv for the new items I know about. If there are more that I've missed from the list below then please tell me:

Code:

Chemicals - Surface Stabilisers, Synthetic Reagents
Consumer Items - Evacuation Shelter
Industrial Materials - Ceramic Composites, Meta-Alloys
Legal Drugs - Bootleg Liquor
Machinery - Building Fabricators, Geological Equipment, Skimmer Components, Thermal Cooling Units
Metals - Bismuth, Lanthanum, Thallium, Thorium
Minerals - Cryolite, Goslarite, Moissanite, Pyrophyllite
Technology - Structural Regulators

I'm going to make a change to the Station.csv schema by adding a column at the end - "Planetary". This will be 'Y' if it is a planetary station or 'N' if not or '?' if unknown. I am pretty sure this will not break TD - but I'm going to do some testing now. I understand EDDB is also doing something similar and will update the sync for that when it happens. Hopefully AnthorNet will be able to do a dump the planetary stations - I don't fancy going back to having to check the stations for derps as they're created again. In fact, as I've been writing this on and off, I have now just done this anyway. It looks like it works

Someone needs to add a switch to the TD run command to filter on the 'planetary' field. Who's going to do that?

Then if WombatFromHell could add it in to TDHelper then 1.5 users lives will be alot easier.

Eggplant! · Dec 16, 2015

Yup, yup. Just to echo what Maddavo is saying.

None of the API tools are working right now. The API isn't authenticating anyone. But this isn't unusual, as similar breakage has happened in just about every update in recent memory. We'll wait a few days and see what happens.

sceaga · Dec 16, 2015

Please, Please Frontier, don't take away our API!

DRY411S · Dec 16, 2015

maddavo said:
Hi All,

<snip>

Then if WombatFromHell could add it in to TDHelper then 1.5 users lives will be alot easier.

TDHelper is no longer working for me since Horizons, in the snese that it cannot find the current system from the Logs (which may have changed location).

DRY411S · Dec 16, 2015

When I update market prices from maddavo, is there a switch to remove items that are in my database, but are not in the update?

maddavo · Dec 16, 2015

DRY411S said:
When I update market prices from maddavo, is there a switch to remove items that are in my database, but are not in the update?

No, there is no switch. But I think jremuscat posted an edit to the import command here a while ago for exactly that purpose.

Cyb · Dec 17, 2015

maddavo said:
Re: 1.5/2.0 release
I have updated the Item.csv for the new items I know about. If there are more that I've missed from the list below then please tell me:

From a post in General - New Mineral - Taaffeite

maddavo · Dec 17, 2015

I have come across a few more new items - just updated the item.csv again:

Chemicals - Nerve Agents
Minerals - Taaffeite
Salvage - Encrypted Data Storage
Technology - Muon Imager
Weapons - Landmines

Ezznuszen · Dec 18, 2015

DRY411S said:
TDHelper is no longer working for me since Horizons, in the snese that it cannot find the current system from the Logs (which may have changed location).

The path did change, with Horizons.

You can just load up the Default.xml file in your TDHelper folder and update it to point to the new directory (which will be in the Elite Dangerous products folder, wherever you had your previous one saved, but the folder name will have changed to elite-dangerous-64)

olesk · Dec 18, 2015

Forgive my ignorance here, but are the changes that you are making to item.csv also reflected in the Bitbucket repository of tradedangerous, and if so, which branch are you updating? (Sorry if this was stated in one of the 136 previous pages of this thread

)

maddavo · Dec 18, 2015

olesk said:
Forgive my ignorance here, but are the changes that you are making to item.csv also reflected in the Bitbucket repository of tradedangerous, and if so, which branch are you updating? (Sorry if this was stated in one of the 136 previous pages of this thread )

The item.csv is available at Maddavo's Market Share - http://www.davek.com.au/td/

I don't have a bitbucket branch of TD - well - not one that I'm updating anyway. kfsone usually incorporates the data updates whenever a new version is released.

DRY411S · Dec 18, 2015

Ezznuszen said:
The path did change, with Horizons.

You can just load up the Default.xml file in your TDHelper folder and update it to point to the new directory (which will be in the Elite Dangerous products folder, wherever you had your previous one saved, but the folder name will have changed to elite-dangerous-64)

Yep I worked that out. But let me also add that if you have any other xml files (I have one for each ship I own) then you need to edit those too, or delete them and start again.

It took me a while to figure this out. The last line in Default.xml is an alternative xml file, and until I edited that xml file too, I was getting nasty run time errors.

nepomuk · Dec 18, 2015

Sorry DRY411S, the last line in the Default.xml is:"<CopySystemToClipboard>false</CopySystemToClipboard>" and also in your ship.xml (sorry for my bad english :-() . If you change the path to the log-files (<NetLogPath> ...) , TDHelper find the correct system and station but the pilots-log is not updated. Can anyone correct this ?

Greetings nepomuk