Your data volume is smaller than what I was managing here, so it's definitely doable all on premises. I liked this setup, it was pretty easy to manage and all the tools worked together well. I've also worked for a place where everything was on prem - MS SQL server on prem and PowerBI report server. My sense was this client was just had a lot of money to throw at BI, because PBI was just one BI tool out of several they were using, and they had all sorts of DBs. The Azure SQL instances didn't require a gateway which made for one less thing to manage. Azure Data Factory was used for ETL from a variety of sources into the Azure SQL databases, but all the on-prem servers were direct connections in PowerBI Desktop so they then needed a gateway for reports published to the PBI premium workspace. I've worked for a client where they had PowerBI premium and a mixed environment with on-prem databases and Azure SQL instances. The advantage of building on Azure is you get to give Microsoft more of your money =P What is the best stack to work with in your experience? What is your BI tech stack (BI tool + database + etl)?Īre you happy with it or would you change it for something else? MSSQL (especially for SSIS and SSAS) also look interesting. Lately, I’ve been also looking into the dbt+airflow stack (maybe with postgres), although I’m quite skeptical about losing control of the DDL (like defining partitions). On paper, they look quite more expensive compared to their on premise counterparts. We already have the servers to install the on-prem database, although I’m interested about what are the advantages of modern cloud data warehouses like Azure Synapse or Snowflake. Since Oracle is crazy expensive and since none is happy about how the data has been modeled in the data warehouse, we are considering to build from the ground up the BI stack. Our data volumes are not gigantic (approx 200GB of data total, only a couple of tables with 5M+ rows). Right now, the data warehouse is running on Oracle and the ETL is done through Talend Open Studio jobs scheduled via cron. My company is considering to migrate their BI from OBIEE to PBI (pro licenses for ~100 users).
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |