Bruin - Chess Template

This pipeline is a simple example of a Bruin pipeline. It demonstrates how to use the bruin CLI to build and run a pipeline.

The pipeline includes three sample assets already:

• chess_games.asset.yml: Transfers chess game data from source database to DuckDB.
• chess_profiles.asset.yml: Transfers chess player profiles data from source to DuckDB.
• player_summary.sql:Creates a summary table of chess player stats, including games, wins, and win rates as white/black.

Setup

The pipeline already includes an empty .bruin.yml file, fill it with your connections and environments. You can read more about connections here.

Here's a sample .bruin.yml file:

environments:
    default:
        connections:
            duckdb:
                - name: "duckdb-default"
                  path: "/path/to/your/database.db"

            chess:
                - name: "chess-connection"
                  players:
                      - "MagnusCarlsen"
                      - "Hikaru"

You can simply switch the environment using the --environment flag, e.g.:

Running the pipeline

bruin CLI can run the whole pipeline or any task with the downstreams:

bruin run ./chess/pipeline.yml

You can also run a single task:

bruin run assets/hello.py

Starting the pipeline execution...

[2023-03-16T18:25:59Z] [worker-0] Running: hello
[2023-03-16T18:26:00Z] [worker-0] [hello] >> Hello, world!
[2023-03-16T18:26:00Z] [worker-0] Completed: hello (103ms)


Executed 1 tasks in 103ms

You can optionally pass a --downstream flag to run the task with all of its downstreams.

That's it, good luc