[RELEASE] Slopey's BPC Market Tool! - New version!

ixobelle · Jan 3, 2015

SilverlightPony said:
Even offline mode still uploads to the server. BPC is rejecting the file because it thinks something is wrong with it that could lead to bad data in the server-side database...but exactly what's causing this, I'm not sure. Are the system and station names in the filename correct?

Looks fine:

Ngulungbara.Filippenko Dock.2015-01-03T13.15.54.bpc

Sample of contents:

Code:

userID;System;Station;Commodity;Sell;Buy;Demand;;Supply;;Date;
EO6e504cad;Ngulungbara;Filippenko Dock;Explosives;458;;69281;High;;;2015-01-03T19:45:49+00:00;
EO6e504cad;Ngulungbara;Filippenko Dock;Hydrogen Fuel;90;94;;;154622;High;2015-01-03T19:45:49+00:00;

SilverlightPony · Jan 3, 2015

ixobelle said:
Looks fine:

Ngulungbara.Filippenko Dock.2015-01-03T13.15.54.bpc

Sample of contents:

Code:

userID;System;Station;Commodity;Sell;Buy;Demand;;Supply;;Date; EO6e504cad;Ngulungbara;Filippenko Dock;Explosives;458;;69281;High;;;2015-01-03T19:45:49+00:00; EO6e504cad;Ngulungbara;Filippenko Dock;Hydrogen Fuel;90;94;;;154622;High;2015-01-03T19:45:49+00:00;

And this is the station you were actually docked at when trying to import the file, correct?

ixobelle · Jan 3, 2015

yeah, haven't left the station all morning trying to get this working.

ago · Jan 3, 2015

The XML is invalid. <Network> appears twice and is only closed once and the last VerboseLogging="1" is outside the <Network> tag. Since the config is invalid it's not saving proper log files at all.

Dielos said:

Code:

---- CUT HERE ----
    <Network
VerboseLogging="1"
      Port="0"
      upnpenabled="1"
      LogFile="netLog"
      DatestampLog="1"
      >
---- TO HERE ----

<Network Port="0"
upnpenabled="1"
LogFile="netLog"
DatestampLog="1"
VerboseLogging="1"
ReportSentLetters="1"
ReportReceivedLetters="1"
>

    </Network>
---- CUT HERE ----
VerboseLogging="1"
---- TO HERE ----
  <GameObjects />
</AppConfig>

Slopey · Jan 3, 2015

snip - replied to an old post.

- - - - - Additional Content Posted / Auto Merge - - - - -

Code said:
Clean install of 4.2.0.2 and noticed a missing system which was previously there. (Granthaimi)

Should I just add it as new data?

Keep up the good work!

Yes. You only get the last 48 hours of data if you clear your db (or you don't use the BPC for a few days), so you it won't appear if it was last updated 3 days ago - re-add prices for it.

Dielos · Jan 3, 2015

ago said:
The XML is invalid. <Network> appears twice and is only closed once and the last VerboseLogging="1" is outside the <Network> tag. Since the config is invalid it's not saving proper log files at all.

Thanks ago. I repaired that. It's still not working for some reason. Just in case, the config looks like this now:

Code:

<AppConfig>
    <Display>
        <ScreenWidth>1280</ScreenWidth> 
        <ScreenHeight>720</ScreenHeight> 
        <FullScreen>false</FullScreen> 
        <VSync>true</VSync>
        <PresentInterval>1</PresentInterval>
        <Adapter>0</Adapter>
        <Monitor>0</Monitor> 
        <DX11_RefreshRateNumerator>60</DX11_RefreshRateNumerator>
        <DX11_RefreshRateDenominator>1</DX11_RefreshRateDenominator>
        <LimitFrameRate>false</LimitFrameRate>
        <MaxFramesPerSecond>30</MaxFramesPerSecond>
        <!-- If you are looking for the SSAA setting this has moved in to Settings.xml in the save directory
          ** typically: C:\Users\{username}\AppData\Roaming\Frontier Developments\Elite Dangerous\Options\Graphics.
          ** If this file does not exist you can generate it by entering the graphics options screen in game
          ** and hitting apply. You can then add <SSAA>X</SSAA> when X is the SSAA amount (1 by default) -->
    </Display>
    
    <Threads
        RenderThreadStackSize="1048576"
        WorkerThreadStackSize="1048576"
        NumWorkerThreads="6"
        RenderJobQueueSize="10240"
        KernelJobQueueSize="10240"
        MinSpareCores="0"
        OptimiseForPerformance="1"
        UseThreadPriorities="0"
        PerformanceScaling="1"
    />
    
    <Files
        MaxLoadRetries="10"
    />

    <Network
      Port="0"
      upnpenabled="1"
      LogFile="netLog"
      DatestampLog="1"
      VerboseLogging="1"
      ReportSentLetters="1"
      ReportReceivedLetters="1"
      >

    </Network>
  <GameObjects />
</AppConfig>

Shismar · Jan 3, 2015

ago said:
The XML is invalid. <Network> appears twice and is only closed once and the last VerboseLogging="1" is outside the <Network> tag. Since the config is invalid it's not saving proper log files at all.

Yep. After the fixes above you can check the latest netlog.xxx.xx to see if the system information is logged. Such as

Code:

{02:16:23} System:4(Korro Kung) Body:40 Pos:(21608.2,-2720.81,-3481.01)

Yokai · Jan 3, 2015

I've finally nailed down a pattern that causes a frequent "hang" type of bug. Yes, this still happens in 4.2.0.2.

1. Go to Commodity tab and search for a specific commodity.
2. Sort the results by "Price".
3. Go to the BPC tab and manually enter a system name in the "TO" field, with everything else set to "ANY".
4. Search.
5. Repeat this process a few times, specifying a different system name (from the Commodity tab) in the "TO" field.
6. Now, on the BPC tab, click the "ANY" _button_ to zero out all the fields back to "ANY".

Hang. For like 20-30 seconds.

7. Go back to the Commodity tab and notice that the "Commodity" field has _also_ been reset to "ANY". As you know, a Commodity search for "ANY" takes a long time.

What seems to be causing the hang is that the ANY button on the BPC tab is also affecting the Commodity tab, resulting in a very long query that freezes everything until finished.

Surfinjo · Jan 4, 2015

Slopey said:
Restart it.

As someone who thinks this tool is to Elite what pineapple is to pitza, I'm sorry but I must report the same problem.

I have tried uninstalling, cleaning old files, restarting, re-downloading.

The parsing is still very slow.

Don't mean to put pressure on you Slopey mate, but could do with some advice.

SilverlightPony · Jan 4, 2015

Dielos said:

Thanks ago. I repaired that. It's still not working for some reason. Just in case, the config looks like this now:

Code:

<AppConfig>
    <Display>
        <ScreenWidth>1280</ScreenWidth> 
        <ScreenHeight>720</ScreenHeight> 
        <FullScreen>false</FullScreen> 
        <VSync>true</VSync>
        <PresentInterval>1</PresentInterval>
        <Adapter>0</Adapter>
        <Monitor>0</Monitor> 
        <DX11_RefreshRateNumerator>60</DX11_RefreshRateNumerator>
        <DX11_RefreshRateDenominator>1</DX11_RefreshRateDenominator>
        <LimitFrameRate>false</LimitFrameRate>
        <MaxFramesPerSecond>30</MaxFramesPerSecond>
        <!-- If you are looking for the SSAA setting this has moved in to Settings.xml in the save directory
          ** typically: C:\Users\{username}\AppData\Roaming\Frontier Developments\Elite Dangerous\Options\Graphics.
          ** If this file does not exist you can generate it by entering the graphics options screen in game
          ** and hitting apply. You can then add <SSAA>X</SSAA> when X is the SSAA amount (1 by default) -->
    </Display>
    
    <Threads
        RenderThreadStackSize="1048576"
        WorkerThreadStackSize="1048576"
        NumWorkerThreads="6"
        RenderJobQueueSize="10240"
        KernelJobQueueSize="10240"
        MinSpareCores="0"
        OptimiseForPerformance="1"
        UseThreadPriorities="0"
        PerformanceScaling="1"
    />
    
    <Files
        MaxLoadRetries="10"
    />

    <Network
      Port="0"
      upnpenabled="1"
      LogFile="netLog"
      DatestampLog="1"
      VerboseLogging="1"
      ReportSentLetters="1"
      ReportReceivedLetters="1"
      >

    </Network>
  <GameObjects />
</AppConfig>

Fly to another system, to make sure fresh location data is put in the log, then try doing a fresh market-capture, OCR, export, import. If you have the voice prompts enabled in the BPC options, you should hear it reporting the new systems as you jump; this means it's getting usable information from the log files.

Ted Striker · Jan 4, 2015

Am I missing the point of this tool? Are you supposed to visit every station and input the price of every commodity, then from there figure out a trade route? Sounds like it will take all day.

Slopey · Jan 4, 2015

Ted Striker said:
Am I missing the point of this tool? Are you supposed to visit every station and input the price of every commodity, then from there figure out a trade route? Sounds like it will take all day.

Correct! You've got it!

Dock, enter the prices, and because the crowd (it's crowdsourced - the clue is in the name) are doing the same elsewhere, you have an outside chance of knowing where to go next to make a profit.

- - - - - Additional Content Posted / Auto Merge - - - - -

Dielos said:

Thanks ago. I repaired that. It's still not working for some reason. Just in case, the config looks like this now:

Code:

<AppConfig>
    <Display>
        <ScreenWidth>1280</ScreenWidth> 
        <ScreenHeight>720</ScreenHeight> 
        <FullScreen>false</FullScreen> 
        <VSync>true</VSync>
        <PresentInterval>1</PresentInterval>
        <Adapter>0</Adapter>
        <Monitor>0</Monitor> 
        <DX11_RefreshRateNumerator>60</DX11_RefreshRateNumerator>
        <DX11_RefreshRateDenominator>1</DX11_RefreshRateDenominator>
        <LimitFrameRate>false</LimitFrameRate>
        <MaxFramesPerSecond>30</MaxFramesPerSecond>
        <!-- If you are looking for the SSAA setting this has moved in to Settings.xml in the save directory
          ** typically: C:\Users\{username}\AppData\Roaming\Frontier Developments\Elite Dangerous\Options\Graphics.
          ** If this file does not exist you can generate it by entering the graphics options screen in game
          ** and hitting apply. You can then add <SSAA>X</SSAA> when X is the SSAA amount (1 by default) -->
    </Display>
    
    <Threads
        RenderThreadStackSize="1048576"
        WorkerThreadStackSize="1048576"
        NumWorkerThreads="6"
        RenderJobQueueSize="10240"
        KernelJobQueueSize="10240"
        MinSpareCores="0"
        OptimiseForPerformance="1"
        UseThreadPriorities="0"
        PerformanceScaling="1"
    />
    
    <Files
        MaxLoadRetries="10"
    />

    <Network
      Port="0"
      upnpenabled="1"
      LogFile="netLog"
      DatestampLog="1"
      VerboseLogging="1"
      ReportSentLetters="1"
      ReportReceivedLetters="1"
      >

    </Network>
  <GameObjects />
</AppConfig>

Your network section is still wrong - remove that > under ReportRecievedLetters and the </ Network > bit and replace it with />

i.e. it should be:

Code:

<AppConfig>
    <Display>
        <ScreenWidth>1280</ScreenWidth> 
        <ScreenHeight>720</ScreenHeight> 
        <FullScreen>false</FullScreen> 
        <VSync>true</VSync>
        <PresentInterval>1</PresentInterval>
        <Adapter>0</Adapter>
        <Monitor>0</Monitor> 
        <DX11_RefreshRateNumerator>60</DX11_RefreshRateNumerator>
        <DX11_RefreshRateDenominator>1</DX11_RefreshRateDenominator>
        <LimitFrameRate>false</LimitFrameRate>
        <MaxFramesPerSecond>30</MaxFramesPerSecond>
        <!-- If you are looking for the SSAA setting this has moved in to Settings.xml in the save directory
          ** typically: C:\Users\{username}\AppData\Roaming\Frontier Developments\Elite Dangerous\Options\Graphics.
          ** If this file does not exist you can generate it by entering the graphics options screen in game
          ** and hitting apply. You can then add <SSAA>X</SSAA> when X is the SSAA amount (1 by default) -->
    </Display>
    
    <Threads
        RenderThreadStackSize="1048576"
        WorkerThreadStackSize="1048576"
        NumWorkerThreads="6"
        RenderJobQueueSize="10240"
        KernelJobQueueSize="10240"
        MinSpareCores="0"
        OptimiseForPerformance="1"
        UseThreadPriorities="0"
        PerformanceScaling="1"
    />
    
    <Files
        MaxLoadRetries="10"
    />

    <Network
      Port="0"
      upnpenabled="1"
      LogFile="netLog"
      DatestampLog="1"
      VerboseLogging="1"
      ReportSentLetters="1"
      ReportReceivedLetters="1"
      />

  <GameObjects />
</AppConfig>

Ted Striker · Jan 4, 2015

Slopey said:
Correct! You've got it! Dock, enter the prices, and because the crowd (it's crowdsourced - the clue is in the name) are doing the same elsewhere, you have an outside chance of knowing where to go next to make a profit.

I ask because there's 31 systems total listed, none anywhere near where I am (Lave). If it's crowdsourced where's the info that's already been entered?

Remiel · Jan 4, 2015

As of today, after the latest update, this tool just keeps crashing. It also asked me for my logs folder again - why isn't this persistent? Way too overcomplicated for this to be practical, don't know why it has 'random banter' instead of actual functionality. Not the first time I've had issues with it, either.

Slopey · Jan 4, 2015

Remiel said:
As of today, after the latest update, this tool just keeps crashing. It also asked me for my logs folder again - why isn't this persistent? Way too overcomplicated for this to be practical, don't know why it has 'random banter' instead of actual functionality. Not the first time I've had issues with it, either.

Perhaps you could furnish me with a proper bug report beyond "keeps crashing" so I can try and resolve it for you?

Logs folder is persistent, from this version onwards as the auto-update mechanism I'm using kept creating new settings files.

It's not over complicated, it's practical, and the banter is just a bit of fun - turn it off if you want.

If you don't like it - don't use it. Simple as that.

- - - - - Additional Content Posted / Auto Merge - - - - -

Ted Striker said:
I ask because there's 31 systems total listed, none anywhere near where I am (Lave). If it's crowdsourced where's the info that's already been entered?

31 is a bit low. Force an update again. You should get around 200 systems.

But if Lave doesn't appear, then that's because any data entered for it is over 48 hours old - so update it yourself (for your own good, and the good of the community).

Remiel · Jan 4, 2015

Slopey said:
Perhaps you could furnish me with a proper bug report beyond "keeps crashing" so I can try and resolve it for you?

Logs folder is persistent, from this version onwards as the auto-update mechanism I'm using kept creating new settings files.

It's not over complicated, it's practical, and the banter is just a bit of fun - turn it off if you want.

If you don't like it - don't use it. Simple as that.

- - - - - Additional Content Posted / Auto Merge - - - - -

31 is a bit low. Force an update again. You should get around 200 systems.

But if Lave doesn't appear, then that's because any data entered for it is over 48 hours old - so update it yourself (for your own good, and the good of the community).

Yah, about that... not a fan of auto-update either. As for bug reporting, I would put in the effort if I was looking for a fix. I'm not, I've been fixing it myself up until now, and that's why auto-update is a problem. Every time it updates without my say-so, it overwrites my own fixes. Sometimes, I don't want to update just for the sake of updating, that's why I'm still using Linux Mint 13 XFCE instead of the latest Unity interface, and why I don't update my graphics drivers until there's actually a patch that makes a difference for me. Auto-update is one of the biggest turn-offs for me, and this isn't just as simple as "don't like it, don't use it". You've got that big fat donate button up there that I ALMOST clicked once, and that button makes you open to criticism for a flawed tool. As soon as you start making money for something, it becomes a product worth reviewing. ie, is this worth spending money on? Glad I didn't donate though.

Making my own tool now, just for me. In the meantime, Elite Dangerous Central in cooperation with EDSC are very stable crowd-sourced tools and work better than yours ever has.

Slopey · Jan 4, 2015

Remiel said:
As soon as you start making money for something, it becomes a product worth reviewing. ie, is this worth spending money on? Glad I didn't donate though.

All donations for the BPC go to Motor Neuron Disease Scotland - the ice bucket lot, as that's a very close charity as far as my family are concerned.

Making my own tool now, just for me. In the meantime, Elite Dangerous Central in cooperation with EDSC are very stable crowd-sourced tools and work better than yours ever has.

Good - excellent - enjoy! There are some errors in the EDSC data apparently which I've been told about 2nd hand, so might be worth checking it btw, although I don't use it myself currently. But I have no objection to people using other tools

Ted Striker · Jan 4, 2015

Slopey said:
31 is a bit low. Force an update again. You should get around 200 systems.

But if Lave doesn't appear, then that's because any data entered for it is over 48 hours old - so update it yourself (for your own good, and the good of the community).

It's at 112 after updating just now. Still feels low.

Andravez · Jan 4, 2015

Slopey, are you the same Slopey created AirHauler for FSX ?

Marikc0 · Jan 4, 2015

Remiel said:
As of today, after the latest update, this tool just keeps crashing. It also asked me for my logs folder again - why isn't this persistent? Way too overcomplicated for this to be practical, don't know why it has 'random banter' instead of actual functionality. Not the first time I've had issues with it, either.

Par for the course with this application. I've had nothing but similar issues with it, even after updates. Non-persistent settings, instability, etc.