At the moment my employer has a group that creates tableau dashboards and one other very giant group that creates advert hoc and common reporting for exterior shoppers.
Each of those groups pull information from many databases and different sources. For every report they both create a script that lives on their machine, a saved proc that lives in a supply database, generally a scheduled job on a jenkins occasion, or manually copy and paste the outcomes of a question. It is a badly documented mess.
My resolution, that may have the least impression on how they work, and value to implement, is to create a database on which the entire extracted information will dwell, so the stories and dashboards solely entry this single supply. A activity scheduler to run common extraction jobs, and a reasonably easy customized software program software that tracks adjustments to the supply databases and alerts the venture homeowners (of the roles) however will also be utilized by the database homeowners to find out which downstream jobs shall be impacted by adjustments to their databases.
I used to be questioning if what I’ve described already exists as an idea (is a presentation database a factor?) or if there exists software program that would do the majority of the heavy lifting for me? I after any instruments that I’d look into as alternate options, or ideas that may assist my higher design this resolution.