Release EDDN - Elite Dangerous Data Network. Trading tools sharing info in an unified way.
- Thread starter wolverine2710
- Start date
- Status
For information, I'm currently implementing the filtering between gateway and relays, so we could have more of them and the relay, you're connected to, can receive only the schemas his gateway uses or the ones it wants.
As it is currently impossible to make the distinction, each relays receives all messages, whatever the schema is
wolverine2710
Tutorial & Guide Writer
AnthorNet has created an EDDN channel on QuakeNet.
Can be used for everything related to EDDN.
One possibility: To ease the possibility of direct support.
http://webchat.quakenet.org/?channels=EDDN
Can be used for everything related to EDDN.
One possibility: To ease the possibility of direct support.
http://webchat.quakenet.org/?channels=EDDN
Last edited:
wolverine2710
Tutorial & Guide Writer
| Anthornet who is working on the EDDN schema V2 (together with jamesremusat) asked for a list of commanders who created tools which are either a subscriber/listener of EDDN or publish data to EDDN. Its being shown in the spoiler tag. It comes straight from ED3PTT (website version of the third party tools. Though NOT all info is shown like if its open source or not and also not always the thread for the tool - not needed for Anthornet. Checking the profile for a commander will give you the information you need. Perhaps its useful for you all. I've gone through the whole EDDN thread last week and also added the latest EDDN related tool(s) released after that time. | |||
Elite Trade Analyzer
Trading tool.
This tool will analyze and find the best routes for trade data persuant to several parameters: Proximity to current location, distance between trade stations and current commodity prices and supplies
Authors Pandemic
Archive for EDDN messages.
Archive for EDDN messages.
Announcement here, with code sample of how to use it. More info about usage here. Note: You must first ask for an key before you can use it.
Authors Askarr
RegulatedNoise DJ-version
*All in one* (Trading) Tool
Many of you will already know RegulatedNoise
and the others can get to know it here
Originally, this open source tool was created by maxh2003 (link to original thread
)
but unfortunately it wasn't further developed after January '15.
As for my needs (see list) it was exactly the right tool, I decided to continue the development of RN (also since January '15)
Authors Duke
Elite History Server
Elite History Server.
For those looking for historical EDDN data, I have built a cache system and a new protocol to deal with the problem of sending commodities one at a time. This system is based on protocol buffer, which in testing reduced the bandwidth taken by the messages from about 240 bytes zlib compressed JSON to around 95 bytes uncompressed protocol buffers. In addition, this system supports batching. When you need data, you call the endpoint with the last Unix timestamp of data you receive and it will send you everything since then. The code for the server is located at https://github.com/huadianz/elite-eddn-history
and includes the protocol buffer schemas you need to receive the data. In addition, it also contains an example program that shows you how to unpack the protocol buffer binary stream.
The current server I am running is located at http://elite.servers.henryzh.com/api/v0/update/
<timestamp>
The API will send you up to the last 1000 missed updates with Unix timestamps in MS >= the timestamp in the system. If you need more you will need to query the server again.
As this project is open source I welcome any suggestions or if you have any code you want to commit, that would be great. As for already planned features:
Authors Pandemic
Database store for EDDN
Database store for EDDN. Suitable for Trade Dangerous.
In an attempt to bridge the gap between where EDDN is now, and systems like trade dangerous, I've implemented my first go at storing and publishing data from EDDN. If it gets enough interest, I'll add more features. Let's see what response this gets.
You can get a trade dangerous-ish dump of my database from - It's real-time (IE, calling this URL reads the data from the database, not a pregenerated file). The database is updating from EDDN in real time.
http://eddndb.orcas.net/cgi-bin/tdexport.prices
Let me know what you think.
Authors thardie
Maddavo's Market Share (MMS)
Merging tool for Trade Dangerous (TD)
Its a plugin for TD. Users can upload their TD .prices file (using TD) and get a merged .prices back. This will consist of all .prices submitted by others AND the prices received from EDDN. Also check out the other tools mentioned on his site like the online version of RedWizzards tool to calculate coordinates for new systems.
Authors maddavo
Eddb - Elite: Dangerous Database
Routeplanner, Trading tool and API (ROSS). ROSS is the public backend of EDDB. It allows the community to create and edit station and system information. It also provides nigtly dumps of the data.
today I'm launching my latest project: eddb - Elite: Dangerous Database
It's a site about systems, stations, commodities and trade routes in Elite: Dangerous.
Authors themroc
EDDN Feeder
A tool similar to EMDR map for EVE which has the following description: See the solar systems light up as market data arrives.
Comment: The tool is still in development. Works quite nicely. Not ready for release. That is the reason I didn't provide a website or the announcement.
Authors Askarr
Collection of code for creating an EDDN subscriber/listener. Code for multiple languages and frameworks.
Collection of code for creating an EDDN subscriber/listener. Code for multiple languages and frameworks. The ideal way of starting with EDDN if you want to create your own tool based which is using EDDN data.
I got this from the EDDN
thread. Its possible I missed one. If you want to develop a tool which is using EDDN data the below should get your started. Note: There are more tools out there using EDDN then code snippets listed below.
Note: There are authors in the thread who said they would be willing to help commanders with code and/or examples on request. So if the below doesn't cover what you need please post a request for it in the EDDN thread. You probably will be surprised....
Tool: (intelligent) EDDN subscriber in python.
Author: kfsone
Annoucement: here.
Tool: EDDN subscriber/listener written in C# (.Net)
Author: maxh2003
Announcement: here
Tool: EDDN subscriber/listener written Python (version 2.x or 3.x is unknown).
Author: K Kinnison
Announcement: here
Tool: (minimal) Node.js listener for EDDN
Author: Andargor
Announcement: here
Elite Dangerous Companion Emulator (EDCE)
Snippet from the github page:
Purpose:This is an interface that emulates an iPhone accessing the Elite Dangerous Companion web API, which is normally used by a mobile application developed by Frontier Developments. This experimental code has not been created in association with Frontier Developments and is unsupported by them.
The EDCE client queries your Commander data on the Elite Dangerous Companion site as you would on your iPhone, and retrieves the data to file in JSON format. It also publishes market data to EDDN. No private information is published.
Author: Andargor
Thread: <removed>
Source code: <removed>
Note: The thread is currently hidden pending a decision by Michael Brookes.
That is the reason I have <removed> the url for the thread.
I have also <removed> the url for the Andargor edce-client github repository.
Trading tool.
This tool will analyze and find the best routes for trade data persuant to several parameters: Proximity to current location, distance between trade stations and current commodity prices and supplies
Authors Pandemic
Archive for EDDN messages.
Archive for EDDN messages.
Announcement here, with code sample of how to use it. More info about usage here. Note: You must first ask for an key before you can use it.
Authors Askarr
RegulatedNoise DJ-version
*All in one* (Trading) Tool
Many of you will already know RegulatedNoise
and the others can get to know it here
Originally, this open source tool was created by maxh2003 (link to original thread
)
but unfortunately it wasn't further developed after January '15.
As for my needs (see list) it was exactly the right tool, I decided to continue the development of RN (also since January '15)
- Trading Tool
- Commanders Log
- view of systemdata
- systemdata based on EDDB
- built-in, quick OCR
- plausibilitycheck for scanned marketdata
- optional connection to EDDN (export and/or import)
- open source
Authors Duke
Elite History Server
Elite History Server.
For those looking for historical EDDN data, I have built a cache system and a new protocol to deal with the problem of sending commodities one at a time. This system is based on protocol buffer, which in testing reduced the bandwidth taken by the messages from about 240 bytes zlib compressed JSON to around 95 bytes uncompressed protocol buffers. In addition, this system supports batching. When you need data, you call the endpoint with the last Unix timestamp of data you receive and it will send you everything since then. The code for the server is located at https://github.com/huadianz/elite-eddn-history
and includes the protocol buffer schemas you need to receive the data. In addition, it also contains an example program that shows you how to unpack the protocol buffer binary stream.
The current server I am running is located at http://elite.servers.henryzh.com/api/v0/update/
<timestamp>
The API will send you up to the last 1000 missed updates with Unix timestamps in MS >= the timestamp in the system. If you need more you will need to query the server again.
As this project is open source I welcome any suggestions or if you have any code you want to commit, that would be great. As for already planned features:
- Update the network using batched commodity updates
- Current status server (query the status of a station in its most recent state)
- Timeseries server with influxdb
- Using commodity IDs instead of names, if we get those from Frontier at any point
Authors Pandemic
Database store for EDDN
Database store for EDDN. Suitable for Trade Dangerous.
In an attempt to bridge the gap between where EDDN is now, and systems like trade dangerous, I've implemented my first go at storing and publishing data from EDDN. If it gets enough interest, I'll add more features. Let's see what response this gets.
You can get a trade dangerous-ish dump of my database from - It's real-time (IE, calling this URL reads the data from the database, not a pregenerated file). The database is updating from EDDN in real time.
http://eddndb.orcas.net/cgi-bin/tdexport.prices
Let me know what you think.
Authors thardie
Maddavo's Market Share (MMS)
Merging tool for Trade Dangerous (TD)
Its a plugin for TD. Users can upload their TD .prices file (using TD) and get a merged .prices back. This will consist of all .prices submitted by others AND the prices received from EDDN. Also check out the other tools mentioned on his site like the online version of RedWizzards tool to calculate coordinates for new systems.
Authors maddavo
Eddb - Elite: Dangerous Database
Routeplanner, Trading tool and API (ROSS). ROSS is the public backend of EDDB. It allows the community to create and edit station and system information. It also provides nigtly dumps of the data.
today I'm launching my latest project: eddb - Elite: Dangerous Database
It's a site about systems, stations, commodities and trade routes in Elite: Dangerous.
- The system data is based on EDSC
. - The commodity data is being updated from EDDN.
- The data can be edited on the ROSS backend.
- From the very beginning it was very important to have a clean database - since the data from EDDN is mostly a result of OCR, the error rate is too high to ignore. eddb is taking care of this and checks the plausibility of every single dataset.
Authors themroc
EDDN Feeder
A tool similar to EMDR map for EVE which has the following description: See the solar systems light up as market data arrives.
Comment: The tool is still in development. Works quite nicely. Not ready for release. That is the reason I didn't provide a website or the announcement.
Authors Askarr
Collection of code for creating an EDDN subscriber/listener. Code for multiple languages and frameworks.
Collection of code for creating an EDDN subscriber/listener. Code for multiple languages and frameworks. The ideal way of starting with EDDN if you want to create your own tool based which is using EDDN data.
I got this from the EDDN
thread. Its possible I missed one. If you want to develop a tool which is using EDDN data the below should get your started. Note: There are more tools out there using EDDN then code snippets listed below.
Note: There are authors in the thread who said they would be willing to help commanders with code and/or examples on request. So if the below doesn't cover what you need please post a request for it in the EDDN thread. You probably will be surprised....
Tool: (intelligent) EDDN subscriber in python.
Author: kfsone
Annoucement: here.
Tool: EDDN subscriber/listener written in C# (.Net)
Author: maxh2003
Announcement: here
Tool: EDDN subscriber/listener written Python (version 2.x or 3.x is unknown).
Author: K Kinnison
Announcement: here
Tool: (minimal) Node.js listener for EDDN
Author: Andargor
Announcement: here
Elite Dangerous Companion Emulator (EDCE)
Snippet from the github page:
Purpose:This is an interface that emulates an iPhone accessing the Elite Dangerous Companion web API, which is normally used by a mobile application developed by Frontier Developments. This experimental code has not been created in association with Frontier Developments and is unsupported by them.
The EDCE client queries your Commander data on the Elite Dangerous Companion site as you would on your iPhone, and retrieves the data to file in JSON format. It also publishes market data to EDDN. No private information is published.
Author: Andargor
Thread: <removed>
Source code: <removed>
Note: The thread is currently hidden pending a decision by Michael Brookes.
That is the reason I have <removed> the url for the thread.
I have also <removed> the url for the Andargor edce-client github repository.
Edit: Noticed I forgot "EliteOCR" by Seebek which got the whole OCR-ing started.
Last edited:
ZMQ has built-in functionality for this sort of thing, but it would require using multi-part messages (so every client would need to change). EMDR has two classes of message coexisting quite happily; we already have four, albeit with fairly low usage of each.
You don't have to use multipart for filtering in fact, you can see an example here : http://learning-0mq-with-pyzmq.readthedocs.org/en/latest/pyzmq/patterns/pubsub.html
I've finished the implementation already and it's backward compatible (New relays can connect to gateway not sending topic).
It permits other relays to have any schemas that somes would not want, you can see it in my monitor branch.
Settings was added to accommodate those changes.
Last edited:
I know this is an old post, but I just went through this, and I think I figured out the easiest solution, so I thought I would share.
First, I installed python on windows using Miniconda which includes conda environments.
From the command prompt (NOT POWERSHELL!!!) I ran:
> conda create python=2.7 -n EDDN
> conda install pyzmq simplejson zlib gevent -n EDDN
> activate EDDN
> python client.py
It took a minute but eventually the command prompt was printing out the data
When done with python 2...
> deactivate
That's it... hope that helps
Hi guys!
I added an EDDN message log to ROSS: ross.eddb.io/eddn/log
I hope it helps to improve the debugging in some way
themroc
I added an EDDN message log to ROSS: ross.eddb.io/eddn/log
I hope it helps to improve the debugging in some way
themroc
Hi guys!
I added an EDDN message log to ROSS: ross.eddb.io/eddn/log
I hope it helps to improve the debugging in some way
themroc
Oh my, what big databases you've got!
Great feature. It will help to quickly react to errors like I did with 0.6.0.9. BTW you maybe want to blacklist EliteOCR 0.6.0.9 I'm alomst sure everything coming from it is wrong.Hi guys!
I added an EDDN message log to ROSS: ross.eddb.io/eddn/log
I hope it helps to improve the debugging in some way
themroc
Hi guys!
I added an EDDN message log to ROSS: ross.eddb.io/eddn/log
I hope it helps to improve the debugging in some way
themroc
Nice one !
We also have two status pages :
- http://eddn-gateway.elite-markets.net/
- http://eddn.ed-td.space/ (Might be more complete)
I'll add last 24h history to second status page next week if I have time, it will effectively help ! Thx themroc
I have that page too that logs EDDN activity, but only agreed messages are shown : http://ed-td.space/en/12/Database+History/showEDDN/1
It's useless compare to themroc page
Last edited:
what exact part of the message is wrong (apart from sell price being zero sometimes)?
Last edited:
Yes sorry. Only the sell price being zero.
This is frickin' wonderful. I was dreaming about such excellent statistics. I can really observe the usage of my tool. It is really shocking that some people still use EliteOCR 0.3.8.
Now I just need to hope that 0.6.0.10 is stable. The next version will be directed towards mac support and EDDN schema 2. I might even call it soon release 1.0.
Those statistics will really tell me if I should.
I thank you a lot.
thanks done
I'm glad you like it. Waiting for schema 2, it will really help for used resources !
- Status