Page 1 of 8 1236 ... LastLast
Results 1 to 15 of 1890

Thread: EliteOCR – Optical Character Recognition for The Commodities Market

Hybrid View

Previous Post Previous Post   Next Post Next Post
  1. #1

    EliteOCR 0.7 – Optical Character Recognition for The Commodities Market

    Version 0.7 (2015-06-18)



    EliteOCR is a Python script that runs optical character recognition on screenshots
    of Elite: Dangerous commodities market. It is also available as a standalone application.

    You should make screenshots in game by pressing F10, not ALT+F10.

    Make sure to do good screenshots. The higher the resolution the better is the accuracy. I recommend at least 1050p.

    Tip:
    Owners of Nvidia video cards can use DSR technology to increase the resolution for screenshots and revert it back to normal without leaving the game.
    Owners of newer AMD video cards can use Virtual Super Resolution (VSR) technology to increase the resolution for screenshots and revert it back to normal without leaving the game.


    Example of a bad screenshot:
    http://imgur.com/MZTmTON

    Example of a good screenshot:
    http://imgur.com/n2UPagt


    EliteOCR is NOT 100% accurate! Please check your results before exporting the data to other services to prevent mistakes and confusion. It is always necessary.

    Increasing FOV in game reduces the size of the significant part of the screenshot! Therefore you will easily get below the limitation. In the GUI it will add a delay to the "Add" button. In the command line it will just refuse to work.

    Use standard FOV (approx. 56)! You are welcome to ignore my advice but don't expect any support if you get OCR problems.

    Increasing FOV in game reduces the size of the significant part of the screenshot! Therefore you will easily get below the limitation. In the GUI it will add a delay to the "Add" button. In the command line it will just refuse to work.

    Use standard FOV (approx. 56)! You are welcome to ignore my advice but don't expect any support if you get OCR problems.


    If EliteOCR cannot find system name even if everything is setup correctly, try running it after you start the game or run it as Administrator (right click -> Run as administartor)


    Download standalone and source:
    http://sourceforge.net/projects/eliteocr/


    Newest version 0.7 Windows:
    http://sourceforge.net/projects/elit...7.zip/download
    Alternative:
    https://mega.co.nz/#!2oZSACSK!UGL3xC...tLDYLlf2MU327U

    Newest version 0.7 Mac:
    http://sourceforge.net/projects/elit...7.zip/download

    Source on github:

    https://github.com/seeebek/EliteOCR


    Should you get following error:
    The application has failed to start because its side-by-side configuration is incorrect. Please
    see the application event log or use the command-line sxtrace.exe tool for more detail.
    please read this post:
    http://answers.microsoft.com/en-us/w...8-465e18e3f3ef

    ---------- Change log ----------------
    0.7
    - official Mac support (thanks to Marginal and demonbane on github)
    - EDDN export uses schema v2 now
    - additional error checks
    - added few new commodities
    - other small fixes

    0.6.0.10
    - fixed a typo which broke EDDN export

    0.6.0.9
    - added more confidence testing for numbers
    - fixed EDDN export, fail gracefully when trying to export incompatible values (e.g. text where only numbers allowed)

    0.6.0.8
    - fixed few more bugs with invalid images

    0.6.0.7
    - fixed rare bug in color calibration

    0.6.0.6
    - improved learning wizard (should be far more stable now)

    0.6.0.4 and 0.6.0.5
    -stability fixes

    0.6.0.3
    - option in settings to make preview gray (like before 0.6)
    - improved learning wizard
    - color calibration more stable and reliable
    - small stability fixes

    0.6.0.2
    - fix for the FOV bug (numbers were ignored if the FOV was different than 55-57)
    - fix for browse button for screenshot path in settings
    0.6.0.1
    - bug fixes for reported bugs

    0.6
    - This release has major changes and there will be some bugs
    - Adios Tesseract! New OCR enginge powered by OpenCV MLP! Blazing fast.
    - Setup wizard to help everybody with this annoying AppConf.xml and Verbose logging
    - Custom HUD support, just make some screenshots and run color calibration (the HUD color should not be too dark)
    - Learning wizard. You can teach the OCR with your own images to perform better
    - Blazing fast EDDN export
    - More theme customization options and color palette from last color calibration (make your EliteOCR look like your HUD in game)
    - Result table scrolls automatically to the last entry
    - Designated E-mail for support
    - and many other small changes


    0.5.4.1
    - added painite to TD export
    - corrected skipping commodities when demand AND supply non existent (0 is ignored now)
    - EliteOCR remembers if it was maximized when closed
    - small fix for station names from log files

    0.5.4
    - painite added
    - skipping of commodities when demand and supply non existent
    - station name from logs when verbose logging enabled (no OCR errors)
    - EliteOCR asks to add VerboseLogging="1" to AppConfig.xml on start

    0.5.3
    - decreased memory usage while processing images (less out of memory errors)
    - cleaner error log
    - "OCR in progress" dialog closes now together with the main window
    - cleaned a problem when executing EliteOCRcmd.exe from different location than the app directory
    - fix in commodities list (FD improved their very bad translation of imperial slaves to french)
    - commodities editor should be more stable now while saving
    - clear error message when using unsupported HUD color
    - fixed bug where check for update crashed when sourceforge could not be reached

    0.5.2.3
    -I mixed up supplyLevel and demandLevel in EDDN export. It's corrected now. Please update if you export to EDDN.

    0.5.2.2
    -Fix for a minor bug when exporting to EDDN (won't crash anymore when part of the data won't be sent)
    -Added supplyLevel and demandLevel to EDDN export
    -Added command line argument to translate the output

    0.5.2.1
    - Tabbing through the fields is now in right order
    - Finally solved the midnight bug (no system name when playing over midnight)
    - You can customize the colors of the dark theme now

    0.5.2
    - If you have a Hi DPI screen, you can now increase the input field sizes in the options!
    - fixes for the dark UI Theme
    - Font doesn't change after running OCR
    - Cleaned UI
    - Additional checks when reading low res screenshots (if EliteOCR thinks that a number is missing it will reduce the confidence of the item, so you don't miss it)
    - EliteOCR now always check for updates (removed the option because many people didn't even know it existed)
    - other small stuff

    0.5.1
    - Dark UI theme
    - Increased accuracy (especially numbers in station names, zero will still be recognized as O)
    - Changed the font to Consolas, so the zero is slashed (something like Ψ)

    0.5
    - increased accuracy on 1050 screenshots and higher (will improve even more in the future)
    - no more console window -> errors go to errorlog.txt
    - basic command line interface (CLI) (run "/bin/EliteOCRcmd.exe -h" for more info)
    - more hotkeys (read Help for details)
    - added one custom HUD color support (read Help), more will come in the future

    0.4.1.2
    -Bug fix for the crash when exporting to CSV and system name is missing

    0.4.1.1
    - "Add all" adds only bmp files now
    - Help updated
    - Little bit of idiot-proofing
    - Shortcuts added to buttons (ALT+A for "Add and next", ALT+S for "Skip" and ALT+C for "Continue")

    0.4.1
    - Interface translated to French
    - BPC Export fix
    - Correction in french commodities list
    - small fixes

    0.4
    - Support for German and French languages!
    - Better auto recognition and autocalibration
    - Check for updates and download them (no autoupdate)
    - Less restrictions on Export
    - Small accuracy improvements
    - Possibility to load all images from the screenshot folder with one click
    - Delete processed images
    - Option to use the old save file dialog
    - Some stuff moved to threads so the main app is not blocking
    - many little things I already forgot ;-)

    0.3.8
    - 0.3.8.1 - fix for OCR all
    - log file parsing for system name fixed (probably)
    - slight increase in accuracy
    - proper help (find it in Help>Help)
    - progres bars for long operations
    - export to EDDN
    - new file format for BPC export (will be added soon to BPC)
    - "remove all" button for the file list
    - fixed the problem where windows was ignoring export file path
    - changed timestamps from GMT to UTC
    - other small fixes

    0.3.6
    - 0.3.6.3 - reduces confidences to remove confusions (like between Gallium and Gallite)
    - 0.3.6.2 - small fix for special characters in paths (greetings to our friends using "ι", "α" and so on ;-) )
    - 0.3.6.1 - less mistakes with D and O in station names
    - Warnings in case people want to export CSV without system name. BPC and some other tools require system name!
    - Learned commodity names from commodities.json can be now edited in Settings > Commodity Editor
    - Preview image can be zoomed in case you need to correct data after adding it to table
    - other small fixes


    0.3.5
    - autocalibration
    - support for special characters in filepaths (there might still be some problems)
    - input field for system name (still supports Logs if they contain system name and path is setup properly)
    - calculation of Levenshtein distances to remove mistakes in commodity names (dictionary is in /bin/commodities.json and extends automatically with new commodities)
    - numbers now recognized by engine written by zxctypo (incredible accuracy)
    - console window is always open for bug tracking (sorry if it is inconvenient for some of you)
    - Trade Dangerous export plugin written by gazelle (still very experimental)
    - other small fixes which I forgot by now


    0.3.3
    - export to Excel, OpenDocument Spreadsheet and CSV
    - "horizontal export"
    - fix of memory error, when too many files in the list
    - bigger font in input fields
    - (very) basic plugin support with BPC Feeder by Lasse B. as first example
    - and others which I forgot ;-)

    0.3.2
    - crops long images to prevent memory errors
    - adds system name from logs

    0.3.1.2
    - minimum and maximum widget sizes changed, should work better on higher DPI now (not tested)
    - added a "busy" dialog while performing OCR


    Tools and databases compatible with CSV exported by EliteOCR:
    Slopey's BPC
    https://forums.frontier.co.uk/showthread.php?t=76081

    Trade Dangerous (plugin included, written by gazelle)
    https://forums.frontier.co.uk/showthread.php?t=34986

    Elite Dangerous Central
    http://www.elitedangerouscentral.com/

    EliteOCRReader
    https://forums.frontier.co.uk/showthread.php?t=70567

    Space trucking companion
    https://forums.frontier.co.uk/showthread.php?t=102389

    Cmdr's Log
    https://forums.frontier.co.uk/showthread.php?t=96350

    Trade Computer Extension
    https://forums.frontier.co.uk/showthread.php?t=103401

    Enjoy!

  2. #2
    @seeebek Thanks, looking forward to working together :-)

  3. #3
    Excellent tool! Great job guys

  4. #4
    Have you looked at integration with Trade Dangerous? https://forums.frontier.co.uk/showthread.php?t=34986 They're both in Python, it would seem to be a match made in heaven.

  5. #5
    Originally Posted by RedAnchorite View Post (Source)
    Have you looked at integration with Trade Dangerous? https://forums.frontier.co.uk/showthread.php?t=34986 They're both in Python, it would seem to be a match made in heaven.
    Well it would appear so. Unfortunately Trade Dangerous requires Python 3.4.1 and I have to use python 2.7 because of openCV. I could try to compile the newest source but it would cost me too much time.
    Anyway in the future: maybe.

  6. #6
    Go python! Nice script man. Very useful. So does this automatically monitor the screenshot folder and then auto OCR scan new files and then cross reference the player log to attribute the right commodities to the right station?

  7. #7
    Originally Posted by seeebek View Post (Source)
    Well it would appear so. Unfortunately Trade Dangerous requires Python 3.4.1 and I have to use python 2.7 because of openCV. I could try to compile the newest source but it would cost me too much time.
    Anyway in the future: maybe.
    Is it possible to run both versions of python on the same machine?

  8. #8
    Nice work guys, shouldn't be too far a step to allow web upload of images and auto processing into a backend DB....

  9. #9
    Wow I just tried it now on quite a low resolution image and it was amazingly accurate. There were only 3 errors in reading the 14 lines in the screenshot - and it nailed the station name too. Excellent work!

    Now how to make this compatible with Slopey's data input....

  10. #10
    @donpost
    Lasse B. is working on a script which would input the data to BPC. But the best approach would be to tell Slopey to have a look at this tool and add an import function.
    I only contacted Thrudd for now since he was always very open and helpful.

  11. #11
    Originally Posted by seeebek View Post (Source)
    EliteOCR is a Python script that runs optical character recognition on screenshots of Elite: Dangerous commodities market. It is also available as a standalone application.
    Wow. This is fantastic, congratulations!

    Also make sure to do good screenshots. The higher the resolution the better is the accuracy. I recommend at least 1080p.
    It always amuses me when people put that "p" at the end of "1080". All computer screen resolutions are "p".

  12. #12
    Excellent, commander!!! The OCR is working quite well, I couldn't make tesseract work like this. I tried, but I'm too stupid. When it gets to collecting the CSV in a database, I'm with you.

  13. #13
    Originally Posted by seeebek View Post (Source)
    Short answer: if you always do your screenshots with the same resolution, you only need to do it once but properly.

    Long answer is: you need to calibrate once per aspect ratio of the screenshot. if you keep resolution of for example 1920x1080 and then switch to 1920x1200, you will have to redo it.
    If you do screenshot with 1920x1080 and increase resolution to 2717x1527 the aspect ratio stays the same, so recalibration is not really necessary.

    - - - - - Additional Content Posted / Auto Merge - - - - -


    Well it wasn't this tool but Slopeys BPC. He had a bug in his installer. Read this:
    https://forums.frontier.co.uk/showth...=53037&page=89
    Ok.thanks. read the thread and see that some others have had the same problem. Never had an issue with pbc before so assumed it was ok. My apologies to the creator of the programme. .

  14. #14
    Hi.where do I find the log file it needs for station names? I've looked through the Frontier_dangerous folder but cannot find it.

    Thx

  15. #15
    Hmmm. Thought I had tried there. Does the game need to be running for the log file to be there?

Page 1 of 8 1236 ... LastLast