For projects that require large amounts of data such as the Bitcoin Trading Bot, it was crucial to write >100 million data points from the API into a local SQL database. From there, data could easily be queried into a Pandas DataFrame using a python connector in VS Code IDE. The dimensional model included the following tables: Orderbook, OHLCV, Account Balance, Orders, and Positions.
Utilizing CTEs can be helpful to reuse and simplify code. In the example shown, a CTE was used on Sales data which allowed for tidy calculations and legible processing steps. SQL was used for many of my open source Tableau projects which are published on my Tableau Public profile.
Nick Belgau 