[RELEASE] Slopey's BPC Market Tool! - New version!

Korosu · Dec 26, 2014

Vithigar said:
How long is "normal" for the parsing stage? I just timed mine after I did a database reset and it took 11m30s. What on earth is being done that takes so long, and why is the data not delivered in a usable format in the first place?

Don't think mine goes that long but is on the order of 5-6 minutes. Which is still a long time.

@Slopey: Our current db is up to 3164 systems known (and growing), most of which I'll never visit. Have you considered methods to limit the data being parsed to a geographic area. For example, if I could set a "Home System" in the options and then specify I only care about things within 100 Ly of that system. The program would then ignore parsing anything outside that bubble. Not sure if this saves much time as you're adding a logic check to the process, but its an idea.

Trippplesix · Dec 26, 2014

Andy1966uk said:
Latest version gives the error, database locked... v 4.1.3.9

Latest version is 4.1.4.2. You need to upgrade.

Lucius · Dec 26, 2014

Lost Data

My system just recently updated to 4.1.4.3 and turned automatically from the local version to the full online database , is there any way I can get my own data back ?

I was getting swamped with the entire database before with huge searches for systems nowhere near me.

Please help .. ive lost A LOT of data

Slopey · Dec 26, 2014

Andy1966uk said:
Latest version gives the error, database locked... v 4.1.3.9

That's not the latest version. 4.1.4.3 is current.

- - - - - Additional Content Posted / Auto Merge - - - - -

Vithigar said:
How long is "normal" for the parsing stage? I just timed mine after I did a database reset and it took 11m30s. What on earth is being done that takes so long, and why is the data not delivered in a usable format in the first place?

Updating 200k rows. But if you don't like it, don't use it, or write your own one so you can deliver the data in a more usable format.

Once the initial parse is complete, it's incremental so quite fast.

- - - - - Additional Content Posted / Auto Merge - - - - -

Korosu said:
Don't think mine goes that long but is on the order of 5-6 minutes. Which is still a long time.

@Slopey: Our current db is up to 3164 systems known (and growing), most of which I'll never visit. Have you considered methods to limit the data being parsed to a geographic area. For example, if I could set a "Home System" in the options and then specify I only care about things within 100 Ly of that system. The program would then ignore parsing anything outside that bubble. Not sure if this saves much time as you're adding a logic check to the process, but its an idea.

Yes, but remember that there is only coordinate data for a fraction of the systems, so a within-distance update would remove any system not on FD's list - which is quite a few when you consider there's 400 billion, and only coord data for around 170,000.

- - - - - Additional Content Posted / Auto Merge - - - - -

Lucius said:
My system just recently updated to 4.1.4.3 and turned automatically from the local version to the full online database , is there any way I can get my own data back ?

I was getting swamped with the entire database before with huge searches for systems nowhere near me.

Please help .. ive lost A LOT of data

The auto-update setting should have been retained between updates. Which version were you coming from?

- - - - - Additional Content Posted / Auto Merge - - - - -

Korosu said:
Don't think mine goes that long but is on the order of 5-6 minutes. Which is still a long time.

It's currently not optimised, I'll be working on that in due course.

Troik · Dec 26, 2014

Lucius said:
Please help .. ive lost A LOT of data

Even when you have "auto-update" ticked off, your data still gets uploaded, so it's still all there, just something extra

But honestly, you can't really loose data, the way the market works with the NPC traders turned into overdrive, data that is older then a day is practically useless. So don't think of it like you have to capture every system in your local area once and then you're done, it's a constant process and a constant battle against entropy.

When I fly to a station that has data older then maybe 3-4 hours I usually update it, and after ED 1.03 I'm amazed how much the data now fluctuates in just a few hours.

Slopey · Dec 26, 2014

Trippplesix said:
Would it also be possible for caps to be turned into normalised text? Currently this creates two stations with the same name. One written in caps and the other normal.

Yeah - it's on my list of DB fixes - I'll get around to it shortly, been busy with the festive cheer meantime

Lucius · Dec 26, 2014

version

I came from the version directly before the most resent. Im guessing 4.1.4.2 ?

Lucius · Dec 26, 2014

Troik said:
it's a constant process and a constant battle against entropy.

Is trading intended to be that harsh I wonder ?

harag · Dec 26, 2014

Leesti now has THREE George Lucas stations:

georgelucas
Georges Lucus

and the official one:

George Lucus

Can we please when entering station names type them correctly, OR NOT AT ALL!. I keep resetting the values of the first two to ZERO, but someone keeps putting them back in! Either use it properly or not a

Slopey · Dec 26, 2014

I'll tidy those up harag.

EDIT - Done - clear your DB and force update.

Oystein · Dec 26, 2014

Where can I find the newest version?

The link in the first post is only version 4.1.3.9, the same as I get if I try to auto-update the tool.

Øystein

The Weasel · Dec 26, 2014

Hi Slopey

Why is my DB changed, this last version forced auto-update - Please set this as off by default - or ask installer - better yet as it is an app update - continue previous option - The latest just crashes with "parsing" - I only want my local DB.

How can I stop this update - please give the option - can I recover my personal data - some of my stations are days old - but it is what I have visited.

I do not want all 560 systems only my 15+.

Can I prevent auto-update?

Cheers &

Many thanks

kylania · Dec 26, 2014

You should be able to turn off auto-update (far right of main screen checkbox), clear your DB (button in Options) then start fresh with just your data (grid only update I think?).

Kante · Dec 26, 2014

Hello Slopey,

I have testet some queries and think that this might help you to increase the Performance of the Tool. It is all about getting data from a start location within a certain radius (LY) as fast as possible and display it.
For example retrieving data from System "Kremainn" within a Distance of 150LY lasts ~2 seconds (getting and displaying).
What is missing in my application is the calculation of the Profit which might be the most expensive Operation, but with all data in the hands it should be much faster. Another suggestion, using IDs for System and Commodity in the SC Table would be nice. I hope this helps you to increase Perfromance.

My complete C# project can be found here: https://dl.dropboxusercontent.com/u/88278703/Elite/Elite_C#Project.rar

The used Database is the one under default installtion path (can be changed in the Connter.cs class if needed):
databasePath = Environment.GetFolderPath(Environment.SpecialFolder.ProgramFilesX86) + "\\Slopeys ED BPC\\ED4.db";

Duradel · Dec 26, 2014

Gone out and found a couple of tutorial videos on the whole eliteocr and csv files deal, seems do-able however now my bpc stops responding every time I run it, I click close program and for a while I see 'cant find db' and something about it auot exitting lol, tried a new installation etc but no such luck, using version 4.1.4.3 which I believe is current, any suggestions from anyone on what to do or what I may be missing?

Zeva Atropos · Dec 26, 2014

SQLite error, please help!

Hello Slopey!
Once again: many Thanks for your work! I love this program!

After i upgraded it to the newest version 4.1.4.2, everytime i start a querry i get an SQLite error:

Informationen über das Aufrufen von JIT-Debuggen
anstelle dieses Dialogfelds finden Sie am Ende dieser Meldung.

************** Ausnahmetext **************
Devart.Data.SQLite.SQLiteException (0x00000001): SQLite error
near ",": syntax error
bei Devart.Data.SQLite.a7.a(Byte[] A_0, UInt32 A_1, Byte[]& A_2)
bei Devart.Data.SQLite.bt.a(Byte[] A_0)
bei Devart.Data.SQLite.af.i()
bei Devart.Data.SQLite.SQLiteDataReader.c()
bei Devart.Data.SQLite.SQLiteCommand.InternalExecute(CommandBehavior behavior, IDisposable statement, Int32 startRecord, Int32 maxRecords)
bei Devart.Common.DbCommandBase.InternalExecute(CommandBehavior behavior, IDisposable stmt, Int32 startRecord, Int32 maxRecords, Boolean nonQuery)
bei Devart.Common.DbCommandBase.ExecuteDbDataReader(CommandBehavior behavior, Boolean nonQuery)
bei Devart.Common.DbCommandBase.ExecuteDbDataReader(CommandBehavior behavior)
bei Devart.Data.SQLite.SQLiteCommand.ExecuteReader()
bei A.ce60847a8ca1358480ac48a994b33eaa6.c06a4825e7d455ba0b2f0b0cfa0e4409a()
bei A.ce60847a8ca1358480ac48a994b33eaa6.cadc7deb679d2492377dcc6f6d93a5e8b(Object cf31c6b95f279e766a628123301769734, EventArgs c685f2fe3e56b15489d3a72ae97ae0d12)
bei System.Windows.Forms.Control.OnClick(EventArgs e)
bei DevExpress.XtraEditors.BaseButton.OnClick(EventArgs e)
bei DevExpress.XtraEditors.BaseButton.OnMouseUp(MouseEventArgs e)
bei System.Windows.Forms.Control.WmMouseUp(Message& m, MouseButtons button, Int32 clicks)
bei System.Windows.Forms.Control.WndProc(Message& m)
bei DevExpress.Utils.Controls.ControlBase.WndProc(Message& m)
bei DevExpress.XtraEditors.BaseControl.WndProc(Message& msg)
bei System.Windows.Forms.Control.ControlNativeWindow.OnMessage(Message& m)
bei System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m)
bei System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)

any Idea what may be wrong?

Thanks very much for your great work!!!

The Weasel · Dec 26, 2014

kylania said:
You should be able to turn off auto-update (far right of main screen checkbox), clear your DB (button in Options) then start fresh with just your data (grid only update I think?).

Hi Kylania - yes I hope I can do this - I had a number of sectors/stations I had built up - the latest version, unlike the last 3 or so did not remember the auto-update off setting, you cannot deselect it if active as it is downloading the data before it completes loading.

Slopey - Is there any way to remove the update data and only keep my previous data - Kylania mentioned grid only - will clear DB remove all my data as well as the downloaded data when the v4.1.4.3 updated - and how do I prevent it from updating if I have to wipe all my data and start again?

Edit - I see I can manually delete data from "system data" but this is "line by line" - can you add multi-select boxes in a similar way to station select on BPC tab - if you cannot remove the data from a remote update added to a desired local DB following an upgrade? [1250+ entries to delete]

Slopey - which csv format is needed - Export goes to .xlsx, but import must be in .csv - you need to set sector/station to import - but I keep getting invalid format - all I did was show station data and export - then try to import back after changing add entry sector/station. Is it working OK in this release v4.1.4.3?

Hitt0r · Dec 26, 2014

any ideas how to fix this ?

-=[ICE=- · Dec 26, 2014

Hi Y'all Merry Christmas and all that jazz..

Im trying to reinstall Slopey's and all I am getting is "Cannot find DB Exiting Now" Earlier version were working.

Dunkhan · Dec 26, 2014

Hi,

Crash Log

Code:

************** Texte de l'exception **************
Devart.Data.SQLite.SQLiteException (0x00000001): SQLite error
near ",": syntax error
   à Devart.Data.SQLite.a7.a(Byte[] A_0, UInt32 A_1, Byte[]& A_2)
   à Devart.Data.SQLite.bt.a(Byte[] A_0)
   à Devart.Data.SQLite.af.i()
   à Devart.Data.SQLite.SQLiteDataReader.c()
   à Devart.Data.SQLite.SQLiteCommand.InternalExecute(CommandBehavior behavior, IDisposable statement, Int32 startRecord, Int32 maxRecords)
   à Devart.Common.DbCommandBase.InternalExecute(CommandBehavior behavior, IDisposable stmt, Int32 startRecord, Int32 maxRecords, Boolean nonQuery)
   à Devart.Common.DbCommandBase.ExecuteDbDataReader(CommandBehavior behavior, Boolean nonQuery)
   à Devart.Common.DbCommandBase.ExecuteDbDataReader(CommandBehavior behavior)
   à Devart.Data.SQLite.SQLiteCommand.ExecuteReader()
   à A.ce60847a8ca1358480ac48a994b33eaa6.c06a4825e7d455ba0b2f0b0cfa0e4409a()
   à A.ce60847a8ca1358480ac48a994b33eaa6.cadc7deb679d2492377dcc6f6d93a5e8b(Object cf31c6b95f279e766a628123301769734, EventArgs c685f2fe3e56b15489d3a72ae97ae0d12)
   à System.Windows.Forms.Control.OnClick(EventArgs e)
   à DevExpress.XtraEditors.BaseButton.OnClick(EventArgs e)
   à DevExpress.XtraEditors.BaseButton.OnMouseUp(MouseEventArgs e)
   à System.Windows.Forms.Control.WmMouseUp(Message& m, MouseButtons button, Int32 clicks)
   à System.Windows.Forms.Control.WndProc(Message& m)
   à DevExpress.Utils.Controls.ControlBase.WndProc(Message& m)
   à DevExpress.XtraEditors.BaseControl.WndProc(Message& msg)
   à System.Windows.Forms.Control.ControlNativeWindow.OnMessage(Message& m)
   à System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m)
   à System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)


************** Assemblys chargés **************
mscorlib
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18444 built by: FX451RTMGDR
    CodeBase : file:///C:/Windows/Microsoft.NET/Framework/v4.0.30319/mscorlib.dll
----------------------------------------
ED_BPC
    Version de l'assembly : 4.1.4.3
    Version Win32 : 4.1.4.3
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/ED_BPC.exe
----------------------------------------
System.Windows.Forms
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Windows.Forms/v4.0_4.0.0.0__b77a5c561934e089/System.Windows.Forms.dll
----------------------------------------
System.Drawing
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Drawing/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Drawing.dll
----------------------------------------
System
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.34238 built by: FX452RTMGDR
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System/v4.0_4.0.0.0__b77a5c561934e089/System.dll
----------------------------------------
DevExpress.BonusSkins.v13.2
    Version de l'assembly : 13.2.9.0
    Version Win32 : 13.2.9.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/DevExpress.BonusSkins.v13.2.DLL
----------------------------------------
DevExpress.Utils.v13.2
    Version de l'assembly : 13.2.9.0
    Version Win32 : 13.2.9.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/DevExpress.Utils.v13.2.DLL
----------------------------------------
DevExpress.XtraBars.v13.2
    Version de l'assembly : 13.2.9.0
    Version Win32 : 13.2.9.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/DevExpress.XtraBars.v13.2.DLL
----------------------------------------
DevExpress.XtraEditors.v13.2
    Version de l'assembly : 13.2.9.0
    Version Win32 : 13.2.9.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/DevExpress.XtraEditors.v13.2.DLL
----------------------------------------
DevExpress.Data.v13.2
    Version de l'assembly : 13.2.9.0
    Version Win32 : 13.2.9.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/DevExpress.Data.v13.2.DLL
----------------------------------------
System.Speech
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Speech/v4.0_4.0.0.0__31bf3856ad364e35/System.Speech.dll
----------------------------------------
System.Data
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_32/System.Data/v4.0_4.0.0.0__b77a5c561934e089/System.Data.dll
----------------------------------------
System.Core
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Core/v4.0_4.0.0.0__b77a5c561934e089/System.Core.dll
----------------------------------------
System.Xml
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.34234 built by: FX452RTMGDR
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Xml/v4.0_4.0.0.0__b77a5c561934e089/System.Xml.dll
----------------------------------------
System.Algorithms
    Version de l'assembly : 1.0.0.0
    Version Win32 : 1.0.0.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/System.Algorithms.DLL
----------------------------------------
Microsoft.VisualBasic
    Version de l'assembly : 10.0.0.0
    Version Win32 : 11.0.50938.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/Microsoft.VisualBasic/v4.0_10.0.0.0__b03f5f7f11d50a3a/Microsoft.VisualBasic.dll
----------------------------------------
System.Configuration
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Configuration/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Configuration.dll
----------------------------------------
mscorlib.resources
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/mscorlib.resources/v4.0_4.0.0.0_fr_b77a5c561934e089/mscorlib.resources.dll
----------------------------------------
DevExpress.XtraGrid.v13.2
    Version de l'assembly : 13.2.9.0
    Version Win32 : 13.2.9.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/DevExpress.XtraGrid.v13.2.DLL
----------------------------------------
DevExpress.XtraCharts.v13.2
    Version de l'assembly : 13.2.9.0
    Version Win32 : 13.2.9.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/DevExpress.XtraCharts.v13.2.DLL
----------------------------------------
DevExpress.Charts.v13.2.Core
    Version de l'assembly : 13.2.9.0
    Version Win32 : 13.2.9.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/DevExpress.Charts.v13.2.Core.DLL
----------------------------------------
DevExpress.XtraCharts.v13.2.UI
    Version de l'assembly : 13.2.9.0
    Version Win32 : 13.2.9.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/DevExpress.XtraCharts.v13.2.UI.DLL
----------------------------------------
DevExpress.Printing.v13.2.Core
    Version de l'assembly : 13.2.9.0
    Version Win32 : 13.2.9.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/DevExpress.Printing.v13.2.Core.DLL
----------------------------------------
AutomaticUpdater
    Version de l'assembly : 2.6.18.4
    Version Win32 : 2.6.18.4
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/AutomaticUpdater.DLL
----------------------------------------
DevExpress.XtraCharts.v13.2.Wizard
    Version de l'assembly : 13.2.9.0
    Version Win32 : 13.2.9.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/DevExpress.XtraCharts.v13.2.Wizard.DLL
----------------------------------------
System.Data.Linq
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Data.Linq/v4.0_4.0.0.0__b77a5c561934e089/System.Data.Linq.dll
----------------------------------------
Devart.Data.SQLite
    Version de l'assembly : 5.2.264.0
    Version Win32 : 5.2.264.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/Devart.Data.SQLite.DLL
----------------------------------------
System.Transactions
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_32/System.Transactions/v4.0_4.0.0.0__b77a5c561934e089/System.Transactions.dll
----------------------------------------
Devart.Data
    Version de l'assembly : 5.0.1056.0
    Version Win32 : 5.0.1056.0
    CodeBase : file:///C:/Program%20Files%20(x86)/Slopeys%20ED%20BPC/Devart.Data.DLL
----------------------------------------
System.Numerics
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Numerics/v4.0_4.0.0.0__b77a5c561934e089/System.Numerics.dll
----------------------------------------
WindowsBase
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/WindowsBase/v4.0_4.0.0.0__31bf3856ad364e35/WindowsBase.dll
----------------------------------------
Anonymously Hosted DynamicMethods Assembly
    Version de l'assembly : 0.0.0.0
    Version Win32 : 4.0.30319.18444 built by: FX451RTMGDR
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_32/mscorlib/v4.0_4.0.0.0__b77a5c561934e089/mscorlib.dll
----------------------------------------
System.EnterpriseServices
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_32/System.EnterpriseServices/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.EnterpriseServices.dll
----------------------------------------
System.Core.resources
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Core.resources/v4.0_4.0.0.0_fr_b77a5c561934e089/System.Core.resources.dll
----------------------------------------
System.Windows.Forms.resources
    Version de l'assembly : 4.0.0.0
    Version Win32 : 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase : file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Windows.Forms.resources/v4.0_4.0.0.0_fr_b77a5c561934e089/System.Windows.Forms.resources.dll
----------------------------------------