Skip to content

Build and send prod manifest on each PR #65

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
alexandermorozov wants to merge 2 commits into
base: master
Choose a base branch
from
Open

Build and send prod manifest on each PR #65

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
0bcd26f
Build and send prod manifest on each PR
alexandermorozov Jun 8, 2022
da6e666
et's increase the price
alexandermorozov Jun 8, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions .github/workflows/dbt.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,10 @@ jobs:
steps:
- name: checkout
uses: actions/checkout@v2
with:
# We need to checkout full git tree to be able to find and checkout
# the merge-base. By default the action checks out only PR HEAD commit.
fetch-depth: 0

- uses: actions/setup-python@v2
with:
Expand Down Expand Up @@ -47,10 +51,29 @@ jobs:
run: |
set -ex
datafold dbt upload --ci-config-id 77 --run-type ${DATAFOLD_RUN_TYPE} --target-folder ./target/ --commit-sha ${GIT_SHA}

# Switch to "merge base" commit
export PR_COMMIT=$(git rev-parse HEAD)
export MERGE_BASE=$(git merge-base origin/master HEAD)
echo "merge base is $MERGE_BASE"
git checkout $MERGE_BASE

# Do compile of the "merge base" in prod environment
export SNOWFLAKE_SCHEMA=BEERS
dbt compile --full-refresh --profiles-dir ./
datafold dbt upload --ci-config-id 77 --run-type production --target-folder ./target/ --commit-sha ${MERGE_BASE}

# Switch back to the HEAD of the current PR in case later stages
# do something with the repo.
git checkout $PR_COMMIT
env:
DATAFOLD_APIKEY: ${{ secrets.DATAFOLD_APIKEY }}
DATAFOLD_RUN_TYPE: "${{ github.ref == 'refs/heads/master' && 'production' || 'pull_request' }}"
GIT_SHA: "${{ github.ref == 'refs/heads/master' && github.sha || github.event.pull_request.head.sha }}"
SNOWFLAKE_ACCOUNT: ${{ secrets.SNOWFLAKE_ACCOUNT }}
SNOWFLAKE_USER: ${{ secrets.SNOWFLAKE_USER }}
SNOWFLAKE_PASSWORD: ${{ secrets.SNOWFLAKE_PASSWORD }}
SNOWFLAKE_SCHEMA: "${{ github.ref == 'refs/heads/master' && 'BEERS' || 'BEERS_DEV' }}"

- name: dbt test
run: dbt test --profiles-dir ./
Expand Down
2 changes: 1 addition & 1 deletion models/beers/sales.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ SELECT
order_lines.order_line AS order_line,
orders.created_at AS order_created_at,
order_lines.quantity AS order_li_quantity,
order_lines.price AS order_li_price_each,
order_lines.price + 1 AS order_li_price_each,
order_lines.quantity * order_lines.price AS order_li_price_total

FROM {{ ref('orders') }} orders
Expand Down