Files
gocryptotrader/exchanges/mock
Scott 5ea5245afb Improvement: Subsystem separation (#664)
* Initial codes for a trade tracker

* Moving everything in a broken fashion

* Removes tradetracker. Removes some errors for subsystems

* Cleans up some subsystems, renames stuttering types. Removes some global Bot usage

* More basic subsystem renaming and file moving

* Removes engine dependency from events,ntpserver,ordermanager,comms manager

* Exports eventManager, fixes rpcserver. puts rpcserver back for now

* Removes redundant error message, further removes engine dependencies

* experimental end of day interface usage

* adds ability to build the application

* Withdraw and event manager handling

* cleans up apiserver and communications manager

* Cleans up some start/setup processes. Though should separate

* More consistency with Setup Start Stop IsRunning funcs

* Final consistency pass before testing phase

* Fixes engine tests. Fixes stop nil issue

* api server tests

* Communications manager testing

* Connection manager tests and nilsubsystem error

* End of day currencypairsyncer tests

* Adds databaseconnection/databaseconnection_test.go

* Adds withdrawal manager tests

* Deposit address testing. Moved orderbook sync first as its more important

* Adds test for event manager

* More full eventmanager testing

* Adds testfile. Enables skipped test.

* ntp manager tests

* Adds ordermanager tests, Extracts a whole new subsystem from engine and fanangles import cycles

* Adds websocket routine manager tests

* Basic portfolio manager testing

* Fixes issue with currency pair sync startup

* Fixes issue with event manager startup

* Starts the order manager before backtester starts

* Fixes fee tests. Expands testing. Doesnt fix races

* Fixes most test races

* Resolves data races

* Fixes subsystem test issues

* currency pair syncer coverage tests

* Refactors portfolio. Fixes tests. Withdraw validation

Portfolio didn't need to exist with a portfolio manager. Now the porfolio manager
is in charge how the portfolio is handled and all portfolio functions are attached
to the base instead of just exported at the package level

Withdrawal validation occurred at the exchange level when it can just be run at the
withdrawal manager level. All withdrawal requests go through that endpoint

* lint -fix

* golang lint fixes

* lints and comments everything

* Updates GCT logo, adds documentation for some subsystems

* More documentation and more logo updates

* Fixes backtesting and apiserver errors encountered

* Fixes errors and typos from reviewing

* More minor fixes

* Changes %h verb to %w

* reverbs to %s

* Humbly begins reverting to more flat engine package

The main reasoning for this is that the subsystem split doesn't make sense
in a golang environment. The subsystems are only meant to be used with engine
and so by placing them in a non-engine area, it does not work and is
inconsistent with the rest of the application's package layout.

This will begin salvaging the changes made by reverting to a flat
engine package, but maintaining the consistent designs introduced.
Further, I will look to remove any TestMains and decrease the scope
of testing to be more local and decrease the issues that have been
caused from our style of testing.

* Manages to re-flatten things. Everything is within its own file

* mini fixes

* Fixes tests and data races and lints

* Updates docs tool for engine to create filename readmes

* os -> ioutil

* remove err

* Appveyor version increase test

* Removes tCleanup as its unsupported on appveyor

* Adds stuff that I thought was in previous merge master commit

* Removes cancel from test

* Fixes really fun test-exclusive data race

* minor nit fixes

* niterinos

* docs gen

* rm;rf test

* Remove typoline. expands startstop helper. Splits apiserver

* Removes accidental folder

* Uses update instead of replace for order upsert

* addresses nits. Renames files. Regenerates documentation.

* lint and removal of comments

* Add new test for default scenario

* Fixes typo

* regen docs
2021-05-31 10:17:12 +10:00
..
2019-08-23 21:59:01 +10:00

GoCryptoTrader package Mock

Build Status Software License GoDoc Coverage Status Go Report Card

This mock package is part of the GoCryptoTrader codebase.

This is still in active development

You can track ideas, planned features and what's in progress on this Trello board: https://trello.com/b/ZAhMhpOy/gocryptotrader.

Join our slack to discuss all things related to GoCryptoTrader! GoCryptoTrader Slack

Mock Testing Suite

Current Features for mock

  • REST recording service
  • REST mock response server

How to enable

  • Any exchange with mock testing will be enabled by default. This is done using build tags which are highlighted in the examples below via //+build mock_test_off. To disable and run live endpoint testing parse -tags=mock_test_off as a go test param.

Mock test setup

  • Create two additional test files for the exchange. Examples are below:

file one - your_current_exchange_name_live_test.go

//+build mock_test_off

// This will build if build tag mock_test_off is parsed and will do live testing
// using all tests in (exchange)_test.go
package your_current_exchange_name

import (
	"os"
	"testing"
	"log"

	"github.com/thrasher-corp/gocryptotrader/config"
	"github.com/thrasher-corp/gocryptotrader/exchanges/sharedtestvalues"
)

var mockTests = false

func TestMain(m *testing.M) {
	cfg := config.GetConfig()
	cfg.LoadConfig("../../testdata/configtest.json")
	your_current_exchange_nameConfig, err := cfg.GetExchangeConfig("your_current_exchange_name")
	if err != nil {
		log.Fatal("your_current_exchange_name Setup() init error", err)
	}
	your_current_exchange_nameConfig.API.AuthenticatedSupport = true
	your_current_exchange_nameConfig.API.Credentials.Key = apiKey
	your_current_exchange_nameConfig.API.Credentials.Secret = apiSecret
	s.SetDefaults()
	s.Setup(&your_current_exchange_nameConfig)
	log.Printf(sharedtestvalues.LiveTesting, s.Name, s.API.Endpoints.URL)
	os.Exit(m.Run())
}

file two - your_current_exchange_name_mock_test.go

//+build !mock_test_off

// This will build if build tag mock_test_off is not parsed and will try to mock
// all tests in _test.go
package your_current_exchange_name

import (
	"os"
	"testing"
	"log"

	"github.com/thrasher-corp/gocryptotrader/config"
	"github.com/thrasher-corp/gocryptotrader/exchanges/mock"
	"github.com/thrasher-corp/gocryptotrader/exchanges/sharedtestvalues"
)

const mockfile = "../../testdata/http_mock/your_current_exchange_name/your_current_exchange_name.json"

var mockTests = true

func TestMain(m *testing.M) {
	cfg := config.GetConfig()
	cfg.LoadConfig("../../testdata/configtest.json")
	your_current_exchange_nameConfig, err := cfg.GetExchangeConfig("your_current_exchange_name")
	if err != nil {
		log.Fatal("your_current_exchange_name Setup() init error", err)
	}
	your_current_exchange_nameConfig.API.AuthenticatedSupport = true
	your_current_exchange_nameConfig.API.Credentials.Key = apiKey
	your_current_exchange_nameConfig.API.Credentials.Secret = apiSecret
	s.SetDefaults()
	s.Setup(&your_current_exchange_nameConfig)

	serverDetails, newClient, err := mock.NewVCRServer(mockfile)
	if err != nil {
		log.Fatalf("Mock server error %s", err)
	}

	s.HTTPClient = newClient
	s.API.Endpoints.URL = serverDetails

	log.Printf(sharedtestvalues.MockTesting, s.Name, s.API.Endpoints.URL)
	os.Exit(m.Run())
}

Mock test storage

  • Under testdata/http_mock create a folder matching the name of your exchange. Then create a JSON file matching the name of your exchange with the following formatting:
{
	"routes": {
	}
}

Recording a test result

  • Once the files your_current_exchange_name_mock_test.go and your_current_exchange_name_live_test.go along with the JSON file testdata/http_mock/our_current_exchange_name/our_current_exchange_name.json are created, go through each individual test function and add
var s SomeExchange

func TestDummyTest(t *testing.T) {
	s.Verbose = true // This will show you some fancy debug output
	s.HTTPRecording = true // This will record the request and response payloads
	s.API.Endpoints.URL = apiURL // This will overwrite the current mock url at localhost
	s.API.Endpoints.URLSecondary = secondAPIURL // This is only if your API has multiple endpoints
	s.HTTPClient = http.DefaultClient // This will ensure that a real HTTPClient is used to record
	err := s.SomeExchangeEndpointFunction()
	// check error
}
  • This will store the request and results under the freshly created testdata/http_mock/your_current_exchange/your_current_exchange.json

Validating

  • To check if the recording was successful, comment out recording and apiurl changes, then re-run test.
var s SomeExchange

func TestDummyTest(t *testing.T) {
	s.Verbose = true // This will show you some fancy debug output
	// s.HTTPRecording = true // This will record the request and response payloads
	// s.API.Endpoints.URL = apiURL // This will overwrite the current mock url at localhost
	// s.API.Endpoints.URLSecondary = secondAPIURL // This is only if your API has multiple endpoints
	// s.HTTPClient = http.DefaultClient // This will ensure that a real HTTPClient is used to record
	err := s.SomeExchangeEndpointFunction()
	// check error
}
  • The payload should be the same.

Considerations

  • Some functions require timestamps. Mock tests must match the same request structure, so time.Now() will cause problems for mock testing.
    • To address this, use the boolean variable mockTests to create a consistent date. An example is below.
	startTime := time.Now().Add(-time.Hour * 1)
	endTime := time.Now()
	if mockTests {
		startTime = time.Date(2020, 9, 1, 0, 0, 0, 0, time.UTC)
		endTime = time.Date(2020, 9, 2, 0, 0, 0, 0, time.UTC)
	}
  • Authenticated endpoints will typically require valid API keys and a signature to run successfully. Authenticated endpoints should be skipped. See an example below
	if mockTests {
		t.Skip("skipping authenticated function for mock testing")
	}

Please click GoDocs chevron above to view current GoDoc information for this package

Contribution

Please feel free to submit any pull requests or suggest any desired features to be added.

When submitting a PR, please abide by our coding guidelines:

  • Code must adhere to the official Go formatting guidelines (i.e. uses gofmt).
  • Code must be documented adhering to the official Go commentary guidelines.
  • Code must adhere to our coding style.
  • Pull requests need to be based on and opened against the master branch.

Donations

If this framework helped you in any way, or you would like to support the developers working on it, please donate Bitcoin to:

bc1qk0jareu4jytc0cfrhr5wgshsq8282awpavfahc