dbt – Boris blog! http://idesmanb.com Just another boring site Sun, 16 Oct 2022 14:32:38 +0000 en-US hourly 1 https://wordpress.org/?v=6.3.2 http://idesmanb.com/wp-content/uploads/2020/12/cropped-logo-32x32.bmp dbt – Boris blog! http://idesmanb.com 32 32 DBT 1.0.0 on AWS MWAA http://idesmanb.com/2022/10/16/dbt-1-0-0-on-aws-mwaa/?utm_source=rss&utm_medium=rss&utm_campaign=dbt-1-0-0-on-aws-mwaa http://idesmanb.com/2022/10/16/dbt-1-0-0-on-aws-mwaa/#comments Sun, 16 Oct 2022 14:25:01 +0000 http://idesmanb.com/?p=461 Read More »]]> Initially I thought that it sounds too good to be true: https://docs.aws.amazon.com/mwaa/latest/userguide/samples-dbt.html

Then I decided to give it a try – only to realise that dbt-core=0.21.1 ?!

Then I went for dbt-core=1.3.0 – it didn’t work -> collision with apache-ariflow=2.2.2

Then I tried dbt-core=1.0.0 – that one worked. It will work for you too, just use the following requirements.txt

apache-airflow[postgres,mysql,google]==2.2.2

json-rpc==1.13.0
minimal-snowplow-tracker==0.0.2
packaging==20.9
networkx==2.6.3 
mashumaro==2.9
sqlparse==0.4.2

logbook==1.5.3
agate==1.6.1
dbt-extractor==0.4.0

pyparsing==2.4.7 
msgpack==1.0.4
parsedatetime==2.6
pytimeparse==1.1.8
leather==0.3.4
pyyaml==6.0

# Airflow constraints are jsonschema==3.2.0
jsonschema==3.1.1
hologram==0.0.14
dbt-core==1.0.0

psycopg2-binary==2.8.6
dbt-postgres==1.0.0
dbt-redshift==1.0.0
]]> http://idesmanb.com/2022/10/16/dbt-1-0-0-on-aws-mwaa/feed/ 1