Files
gocryptotrader/exchanges/bybit/bybit_ws_futures.go
Jaydeep Rajpurohit 247da918a8 exchanges: Add ByBit support (#887)
* few fixes and add ratelimiter

* adds test

* revert configtest.json changes

* configtest updated

* WIP: adds public endpoint support

* WIP: adds public endpoint support

* adds public endpoint support

* WIP: adds auth. endpoint support

* adds test for auth. endpoint

* fixes

* adds auth. endpoint support

* WIP: ws support

* WIP

* WIP

* WIP

* WIP

* WIP

* WIP

* WIP

* Testing

* Complete WS spot testing

* adds support for ws events

* minor change

* WIP: adds REST support for CoinMarginedFutures

* Fixes

* WIP: adds REST support for CoinMarginedFutures

* Fixes

* improvement in SPOT REST

* Typo fix

* WIP: add REST support for CMF Account API

* minor fixes

* WIP: add support for CMF conditional orders and few minor fixes

* complete support for CMF conditional orders

* adds support for public CMF endpoint

* adds support for CMF position API

* Complete REST CMF support

* WIP

* Testing REST CMF support

* Testing REST CMF support

* Testing REST CMF support completed

* WIP: add support for UMF

* completed non-auth UMF

* WIP: add support for REST Auth. UMF

* WIP: add support for REST Auth. UMF and some improvements

* WIP

* WIP

* WIP

* completed REST UMF

* renaming

* adds REST support for futures

* add testcases for UMF and some optimizations

* add testcases for futures

* Testing UMF, futures and its changes

* Fixes

* Fixes after testing

* WIP

* WIP

* WIP

* completed ws USDT futures support

* WIP: ws support for futures

* fixes in WS futures

* fixes in WS support

* roll back changes made for WS CMF, USDT and Futures

* fixes

* WIP

* WIP

* fixes

* Steps for new PR

* WIP

* WIP

* WIP

* WIP

* complete PR setup

* fixes for successfully running tests

* update in symbol for futures pair in test file

* WIP

* Fixes in test file and other minor fix

* fix testdata/configtest.json

* reset CONTRIBUTORS file

* review changes

* remove unwanted file

* remove redundant code

* improvisation

* adds comment for exported functions

* remove unwanted TODO and commented code

* fix

* improvisation

* fix

* defined errors

* improvisation

* improvisation

* improvisation

* updates test

* adds comment for exported types

* review changes

* review changes

* fix

* fixes

* Changes for making BYBIT compatible with existing code base

* Test file changes

* Changes for making BYBIT compatible with existing code base

* Changes for making BYBIT compatible with existing code base

* fix lint issues

* fix

* review changes

* review changes

* review changes

* review changes

* review changes

* review changes

* review changes

* review changes

* review changes

* review changes

* WIP

* add test cases for new API's

* minor improvements

* add missing API and their tests

* minor fixes

* add bybitTime

* add bybitTimeSec, bybitTimeMilliSec, bybitTimeNanoSec and necessary support

* fix GetTradeHistory function

* error handling

* test fixes

* add GetServerTime API

* adds GetHistoricCandlesExtended and review changes

* test fixes

* minor fix

* integrating CMF Bybit recent change log

* minor fixes

* adds extractCurrencyPair

* minor fixes

* minor fix

* review changes

* adds variable declaration of error

* review commit

* adds embeddable type in API response for all API and integrate it

* fixes

* adds authentication WS connection

* review changes

* review changes

* compatible changes

* adds asset to GetWithdrawalsHistory

* adds asset_type in rpc.proto

* adds asset argument in gctcli withdrawal request command

* improve error handling in exchange API error

* web socket fix

* review changes

* improvements

* improvements

* minor fix

* review changes

* fixing wrapper issues

* fixes

* fixes

* review changes

* add test cases

* fix for GetActiveOrders

* lint fixes

* fixes in websocket

* adds wrapper testcases

* adds wrapper testcases

* adds wrapper testcases

* fixes

* fix issue with GetHistoricCandlesExtended

* fix merge issues

* improving error reporting

* adds wrapper testcases and a minor fix

* gctrpc changes

* adds test cases
fixes in websocket

* review changes for ws

* review changes in WS

* fix gctrpc

* merge fixes

* review changes

* WIP

* updates pair in configs

* adds new asset USDCMarginedFutures

* adds URL const for USDCMarginedFutures

* adds API support

* minor fixes

* adds kline API

* minor fix

* adds API

* adds API

* adds API

* WIP

* WIP

* WIP

* adds support for USDC auth requests to SendAuthHTTPRequest

* adds SendUSDCAuthHTTPRequest

* run test and fix them

* rollback support added for Auth. USDC request inside SendAuthHTTPRequest

* adds API and test cases

* adds API and test cases

* adds APIs and test cases

* adds APIs

* adds rate limit for USDC

* adds USDCMarginedFutures to wrapper

* adds USDC testcases in wrapper and fix few issues

* minor test fixes

* minor test fixes

* fix lint issues

* WIP

* Merge changes

* minor fixes

* remove "else" and optimize

* review changes

* review changes

* review changes

* fix lint issue

* merge fix

* fix test

* fix templates and run them

* changes after merge

* review changes and improvements

* code improvement

* fixes with respect to changes in API response in documentation

* fixed review change in test

* adds check in CancelExistingOrder

* update exchange template

* review changes

* adds GetDepositAddress API

* WIP: adds GetOrderHistory

* complete GetOrderHistory

* fixes

* adds test case

* fixes and add WithdrawFund API

* WIP

* WIP

* updating all SendAuthHTTPRequest call

* adds WithdrawCryptocurrencyFunds

* update test cases

* fix lint issues

* fixes after merge

* adds GetAvailableTransferChains and few fixes

* minor fix in GetDepositAddress

* minor fix with WS ping/pong handling

* add ping handler for WS Auth.

* fix typo mistake

* update doc
2022-08-08 11:29:43 +10:00

646 lines
17 KiB
Go

package bybit
import (
"context"
"encoding/json"
"errors"
"net/http"
"strconv"
"strings"
"time"
"github.com/gorilla/websocket"
"github.com/thrasher-corp/gocryptotrader/common"
"github.com/thrasher-corp/gocryptotrader/common/crypto"
"github.com/thrasher-corp/gocryptotrader/currency"
"github.com/thrasher-corp/gocryptotrader/exchanges/asset"
"github.com/thrasher-corp/gocryptotrader/exchanges/order"
"github.com/thrasher-corp/gocryptotrader/exchanges/stream"
"github.com/thrasher-corp/gocryptotrader/exchanges/ticker"
"github.com/thrasher-corp/gocryptotrader/exchanges/trade"
"github.com/thrasher-corp/gocryptotrader/log"
)
const (
wsFuturesPath = "realtime"
)
// WsFuturesConnect connects to a Futures websocket feed
func (by *Bybit) WsFuturesConnect() error {
if !by.Websocket.IsEnabled() || !by.IsEnabled() {
return errors.New(stream.WebsocketNotEnabled)
}
var dialer websocket.Dialer
err := by.Websocket.Conn.Dial(&dialer, http.Header{})
if err != nil {
return err
}
pingMsg, err := json.Marshal(pingRequest)
if err != nil {
return err
}
by.Websocket.Conn.SetupPingHandler(stream.PingHandler{
Message: pingMsg,
MessageType: websocket.PingMessage,
Delay: bybitWebsocketTimer,
})
if by.Verbose {
log.Debugf(log.ExchangeSys, "%s Connected to Websocket.\n", by.Name)
}
go by.wsFuturesReadData()
if by.IsWebsocketAuthenticationSupported() {
err = by.WsFuturesAuth(context.TODO())
if err != nil {
by.Websocket.DataHandler <- err
by.Websocket.SetCanUseAuthenticatedEndpoints(false)
}
}
return nil
}
// WsFuturesAuth sends an authentication message to receive auth data
func (by *Bybit) WsFuturesAuth(ctx context.Context) error {
creds, err := by.GetCredentials(ctx)
if err != nil {
return err
}
intNonce := (time.Now().Unix() + 1) * 1000
strNonce := strconv.FormatInt(intNonce, 10)
hmac, err := crypto.GetHMAC(
crypto.HashSHA256,
[]byte("GET/realtime"+strNonce),
[]byte(creds.Secret),
)
if err != nil {
return err
}
sign := crypto.HexEncodeToString(hmac)
req := Authenticate{
Operation: "auth",
Args: []interface{}{creds.Key, intNonce, sign},
}
return by.Websocket.Conn.SendJSONMessage(req)
}
// SubscribeFutures sends a websocket message to receive data from the channel
func (by *Bybit) SubscribeFutures(channelsToSubscribe []stream.ChannelSubscription) error {
var errs common.Errors
for i := range channelsToSubscribe {
var sub WsFuturesReq
sub.Topic = subscribe
sub.Args = append(sub.Args, formatArgs(channelsToSubscribe[i].Channel, channelsToSubscribe[i].Params))
err := by.Websocket.Conn.SendJSONMessage(sub)
if err != nil {
errs = append(errs, err)
continue
}
by.Websocket.AddSuccessfulSubscriptions(channelsToSubscribe[i])
}
if errs != nil {
return errs
}
return nil
}
// UnsubscribeFutures sends a websocket message to stop receiving data from the channel
func (by *Bybit) UnsubscribeFutures(channelsToUnsubscribe []stream.ChannelSubscription) error {
var errs common.Errors
for i := range channelsToUnsubscribe {
var unSub WsFuturesReq
unSub.Topic = unsubscribe
formattedPair, err := by.FormatExchangeCurrency(channelsToUnsubscribe[i].Currency, asset.Futures)
if err != nil {
errs = append(errs, err)
continue
}
unSub.Args = append(unSub.Args, channelsToUnsubscribe[i].Channel+dot+formattedPair.String())
err = by.Websocket.Conn.SendJSONMessage(unSub)
if err != nil {
errs = append(errs, err)
continue
}
by.Websocket.RemoveSuccessfulUnsubscriptions(channelsToUnsubscribe[i])
}
if errs != nil {
return errs
}
return nil
}
// wsFuturesReadData gets and passes on websocket messages for processing
func (by *Bybit) wsFuturesReadData() {
by.Websocket.Wg.Add(1)
defer by.Websocket.Wg.Done()
for {
select {
case <-by.Websocket.ShutdownC:
return
default:
resp := by.Websocket.Conn.ReadMessage()
if resp.Raw == nil {
return
}
err := by.wsFuturesHandleData(resp.Raw)
if err != nil {
by.Websocket.DataHandler <- err
}
}
}
}
func (by *Bybit) wsFuturesHandleData(respRaw []byte) error {
var multiStreamData map[string]interface{}
err := json.Unmarshal(respRaw, &multiStreamData)
if err != nil {
return err
}
t, ok := multiStreamData["topic"].(string)
if !ok {
log.Errorf(log.ExchangeSys, "%s Received unhandle message on websocket: %v\n", by.Name, multiStreamData)
return nil
}
topics := strings.Split(t, dot)
if len(topics) < 1 {
return errors.New(by.Name + " - topic could not be extracted from response")
}
switch topics[0] {
case wsOrder25, wsOrder200:
if wsType, ok := multiStreamData["type"].(string); ok {
switch wsType {
case wsOperationSnapshot:
var response WsFuturesOrderbook
err = json.Unmarshal(respRaw, &response)
if err != nil {
return err
}
var p currency.Pair
p, err = by.extractCurrencyPair(response.OBData[0].Symbol, asset.Futures)
if err != nil {
return err
}
err = by.processOrderbook(response.OBData,
response.Type,
p,
asset.Futures)
if err != nil {
return err
}
case wsOperationDelta:
var response WsCoinDeltaOrderbook
err = json.Unmarshal(respRaw, &response)
if err != nil {
return err
}
if len(response.OBData.Delete) > 0 {
var p currency.Pair
p, err = by.extractCurrencyPair(response.OBData.Delete[0].Symbol, asset.Futures)
if err != nil {
return err
}
err = by.processOrderbook(response.OBData.Delete,
wsOrderbookActionDelete,
p,
asset.Futures)
if err != nil {
return err
}
}
if len(response.OBData.Update) > 0 {
var p currency.Pair
p, err = by.extractCurrencyPair(response.OBData.Update[0].Symbol, asset.Futures)
if err != nil {
return err
}
err = by.processOrderbook(response.OBData.Update,
wsOrderbookActionUpdate,
p,
asset.Futures)
if err != nil {
return err
}
}
if len(response.OBData.Insert) > 0 {
var p currency.Pair
p, err = by.extractCurrencyPair(response.OBData.Insert[0].Symbol, asset.Futures)
if err != nil {
return err
}
err = by.processOrderbook(response.OBData.Insert,
wsOrderbookActionInsert,
p,
asset.Futures)
if err != nil {
return err
}
}
default:
by.Websocket.DataHandler <- stream.UnhandledMessageWarning{Message: by.Name + stream.UnhandledMessage + "unsupported orderbook operation"}
}
}
case wsTrades:
if !by.IsSaveTradeDataEnabled() {
return nil
}
var response WsFuturesTrade
err = json.Unmarshal(respRaw, &response)
if err != nil {
return err
}
counter := 0
trades := make([]trade.Data, len(response.TradeData))
for i := range response.TradeData {
var p currency.Pair
p, err = by.extractCurrencyPair(response.TradeData[0].Symbol, asset.Futures)
if err != nil {
return err
}
var oSide order.Side
oSide, err = order.StringToOrderSide(response.TradeData[i].Side)
if err != nil {
by.Websocket.DataHandler <- order.ClassificationError{
Exchange: by.Name,
Err: err,
}
}
trades[counter] = trade.Data{
TID: response.TradeData[i].ID,
Exchange: by.Name,
CurrencyPair: p,
AssetType: asset.Futures,
Side: oSide,
Price: response.TradeData[i].Price,
Amount: response.TradeData[i].Size,
Timestamp: response.TradeData[i].Time,
}
counter++
}
return by.AddTradesToBuffer(trades...)
case wsKlineV2:
var response WsFuturesKline
err = json.Unmarshal(respRaw, &response)
if err != nil {
return err
}
var p currency.Pair
p, err = by.extractCurrencyPair(topics[len(topics)-1], asset.Futures)
if err != nil {
return err
}
for i := range response.KlineData {
by.Websocket.DataHandler <- stream.KlineData{
Pair: p,
AssetType: asset.Futures,
Exchange: by.Name,
OpenPrice: response.KlineData[i].Open,
HighPrice: response.KlineData[i].High,
LowPrice: response.KlineData[i].Low,
ClosePrice: response.KlineData[i].Close,
Volume: response.KlineData[i].Volume,
Timestamp: response.KlineData[i].Timestamp.Time(),
}
}
case wsInstrument:
if wsType, ok := multiStreamData["type"].(string); ok {
switch wsType {
case wsOperationSnapshot:
var response WsFuturesTicker
err = json.Unmarshal(respRaw, &response)
if err != nil {
return err
}
var p currency.Pair
p, err = by.extractCurrencyPair(response.Ticker.Symbol, asset.Futures)
if err != nil {
return err
}
by.Websocket.DataHandler <- &ticker.Price{
ExchangeName: by.Name,
Last: response.Ticker.LastPrice,
High: response.Ticker.HighPrice24h,
Low: response.Ticker.LowPrice24h,
Bid: response.Ticker.BidPrice,
Ask: response.Ticker.AskPrice,
Volume: response.Ticker.Volume24h,
Close: response.Ticker.PrevPrice24h,
LastUpdated: response.Ticker.UpdateAt,
AssetType: asset.Futures,
Pair: p,
}
case wsOperationDelta:
var response WsDeltaFuturesTicker
err = json.Unmarshal(respRaw, &response)
if err != nil {
return err
}
if len(response.Data.Delete) > 0 {
for x := range response.Data.Delete {
var p currency.Pair
p, err = by.extractCurrencyPair(response.Data.Delete[x].Symbol, asset.Futures)
if err != nil {
return err
}
by.Websocket.DataHandler <- &ticker.Price{
ExchangeName: by.Name,
Last: response.Data.Delete[x].LastPrice,
High: response.Data.Delete[x].HighPrice24h,
Low: response.Data.Delete[x].LowPrice24h,
Bid: response.Data.Delete[x].BidPrice,
Ask: response.Data.Delete[x].AskPrice,
Volume: response.Data.Delete[x].Volume24h,
Close: response.Data.Delete[x].PrevPrice24h,
LastUpdated: response.Data.Delete[x].UpdateAt,
AssetType: asset.Futures,
Pair: p,
}
}
}
if len(response.Data.Update) > 0 {
for x := range response.Data.Update {
var p currency.Pair
p, err = by.extractCurrencyPair(response.Data.Update[x].Symbol, asset.Futures)
if err != nil {
return err
}
by.Websocket.DataHandler <- &ticker.Price{
ExchangeName: by.Name,
Last: response.Data.Update[x].LastPrice,
High: response.Data.Update[x].HighPrice24h,
Low: response.Data.Update[x].LowPrice24h,
Bid: response.Data.Update[x].BidPrice,
Ask: response.Data.Update[x].AskPrice,
Volume: response.Data.Update[x].Volume24h,
Close: response.Data.Update[x].PrevPrice24h,
LastUpdated: response.Data.Update[x].UpdateAt,
AssetType: asset.Futures,
Pair: p,
}
}
}
if len(response.Data.Insert) > 0 {
for x := range response.Data.Insert {
var p currency.Pair
p, err = by.extractCurrencyPair(response.Data.Insert[x].Symbol, asset.Futures)
if err != nil {
return err
}
by.Websocket.DataHandler <- &ticker.Price{
ExchangeName: by.Name,
Last: response.Data.Insert[x].LastPrice,
High: response.Data.Insert[x].HighPrice24h,
Low: response.Data.Insert[x].LowPrice24h,
Bid: response.Data.Insert[x].BidPrice,
Ask: response.Data.Insert[x].AskPrice,
Volume: response.Data.Insert[x].Volume24h,
Close: response.Data.Insert[x].PrevPrice24h,
LastUpdated: response.Data.Insert[x].UpdateAt,
AssetType: asset.Futures,
Pair: p,
}
}
}
default:
by.Websocket.DataHandler <- stream.UnhandledMessageWarning{Message: by.Name + stream.UnhandledMessage + "unsupported ticker operation"}
}
}
case wsInsurance:
var response WsInsurance
err = json.Unmarshal(respRaw, &response)
if err != nil {
return err
}
by.Websocket.DataHandler <- response.Data
case wsPosition:
var response WsFuturesPosition
err = json.Unmarshal(respRaw, &response)
if err != nil {
return err
}
by.Websocket.DataHandler <- response.Data
case wsExecution:
var response WsFuturesExecution
err = json.Unmarshal(respRaw, &response)
if err != nil {
return err
}
for i := range response.Data {
var p currency.Pair
p, err = by.extractCurrencyPair(response.Data[i].Symbol, asset.Futures)
if err != nil {
return err
}
var oSide order.Side
oSide, err = order.StringToOrderSide(response.Data[i].Side)
if err != nil {
by.Websocket.DataHandler <- order.ClassificationError{
Exchange: by.Name,
OrderID: response.Data[i].OrderID,
Err: err,
}
}
var oStatus order.Status
oStatus, err = order.StringToOrderStatus(response.Data[i].ExecutionType)
if err != nil {
by.Websocket.DataHandler <- order.ClassificationError{
Exchange: by.Name,
OrderID: response.Data[i].OrderID,
Err: err,
}
}
by.Websocket.DataHandler <- &order.Detail{
Exchange: by.Name,
OrderID: response.Data[i].OrderID,
AssetType: asset.Futures,
Pair: p,
Price: response.Data[i].Price,
Amount: response.Data[i].OrderQty,
Side: oSide,
Status: oStatus,
Trades: []order.TradeHistory{
{
Price: response.Data[i].Price,
Amount: response.Data[i].OrderQty,
Exchange: by.Name,
Side: oSide,
Timestamp: response.Data[i].Time,
},
},
}
}
case wsOrder:
var response WsOrder
err = json.Unmarshal(respRaw, &response)
if err != nil {
return err
}
for x := range response.Data {
var p currency.Pair
p, err = by.extractCurrencyPair(response.Data[x].Symbol, asset.Futures)
if err != nil {
return err
}
var oSide order.Side
oSide, err = order.StringToOrderSide(response.Data[x].Side)
if err != nil {
by.Websocket.DataHandler <- order.ClassificationError{
Exchange: by.Name,
OrderID: response.Data[x].OrderID,
Err: err,
}
}
var oType order.Type
oType, err = order.StringToOrderType(response.Data[x].OrderType)
if err != nil {
by.Websocket.DataHandler <- order.ClassificationError{
Exchange: by.Name,
OrderID: response.Data[x].OrderID,
Err: err,
}
}
var oStatus order.Status
oStatus, err = order.StringToOrderStatus(response.Data[x].OrderStatus)
if err != nil {
by.Websocket.DataHandler <- order.ClassificationError{
Exchange: by.Name,
OrderID: response.Data[x].OrderID,
Err: err,
}
}
by.Websocket.DataHandler <- &order.Detail{
Price: response.Data[x].Price,
Amount: response.Data[x].OrderQty,
Exchange: by.Name,
OrderID: response.Data[x].OrderID,
Type: oType,
Side: oSide,
Status: oStatus,
AssetType: asset.Futures,
Date: response.Data[x].Time,
Pair: p,
Trades: []order.TradeHistory{
{
Price: response.Data[x].Price,
Amount: response.Data[x].OrderQty,
Exchange: by.Name,
Side: oSide,
Timestamp: response.Data[x].Time,
},
},
}
}
case wsStopOrder:
var response WsFuturesStopOrder
err = json.Unmarshal(respRaw, &response)
if err != nil {
return err
}
for x := range response.Data {
var p currency.Pair
p, err = by.extractCurrencyPair(response.Data[x].Symbol, asset.Futures)
if err != nil {
return err
}
var oSide order.Side
oSide, err = order.StringToOrderSide(response.Data[x].Side)
if err != nil {
by.Websocket.DataHandler <- order.ClassificationError{
Exchange: by.Name,
OrderID: response.Data[x].OrderID,
Err: err,
}
}
var oType order.Type
oType, err = order.StringToOrderType(response.Data[x].OrderType)
if err != nil {
by.Websocket.DataHandler <- order.ClassificationError{
Exchange: by.Name,
OrderID: response.Data[x].OrderID,
Err: err,
}
}
var oStatus order.Status
oStatus, err = order.StringToOrderStatus(response.Data[x].OrderStatus)
if err != nil {
by.Websocket.DataHandler <- order.ClassificationError{
Exchange: by.Name,
OrderID: response.Data[x].OrderID,
Err: err,
}
}
by.Websocket.DataHandler <- &order.Detail{
Price: response.Data[x].Price,
Amount: response.Data[x].OrderQty,
Exchange: by.Name,
OrderID: response.Data[x].OrderID,
AccountID: strconv.FormatInt(response.Data[x].UserID, 10),
Type: oType,
Side: oSide,
Status: oStatus,
AssetType: asset.Futures,
Date: response.Data[x].Time,
Pair: p,
Trades: []order.TradeHistory{
{
Price: response.Data[x].Price,
Amount: response.Data[x].OrderQty,
Exchange: by.Name,
Side: oSide,
Timestamp: response.Data[x].Time,
},
},
}
}
default:
by.Websocket.DataHandler <- stream.UnhandledMessageWarning{Message: by.Name + stream.UnhandledMessage + string(respRaw)}
}
return nil
}