# Database Modeling

1. [Types of DBs](https://simonatta.medium.com/database-types-2dac81461709)
2. Data Vault Modeling
   1. [**Data vault modeling**](https://en.wikipedia.org/wiki/Data_vault_modeling) is a [database](https://en.wikipedia.org/wiki/Database) modeling method that is designed to provide long-term historical storage of [data](https://en.wikipedia.org/wiki/Data) coming in from multiple operational systems. It is also a method of looking at historical data that deals with issues such as auditing, tracing of data, loading speed and resilience to change as well as emphasizing the need to trace where all the data in the database came from. This means that every [row](https://en.wikipedia.org/wiki/Row_\(database\)) in a data vault must be accompanied by record source and load date attributes, enabling an auditor to trace values back to the source. It was developed by [Daniel (Dan) Linstedt](https://en.wikipedia.org/w/index.php?title=Daniel_Linstedt\&action=edit\&redlink=1) in 2000. - wikipedia
   2. its a design pattern to build dwh for enterprise analytics. it has hubs (core business concepts) links (relationshipts between hubs) satellites store info about these two. good for lakehouse paradigm. [link has a good image.](https://www.databricks.com/glossary/data-vault#:~:text=What%20is%20a%20data%20vault,hubs%2C%20links%2C%20and%20satellites.) - databricks
3. Data Fabric
   1. [Data Fabric](https://preetihemant.medium.com/modern-data-architecture-models-69e90b725a05) - is a data architecture, that follows a set of steps that determine its flow. The first step takes data through an integration phase. In the integration phase, data is ingested and then cleaned, transformed and loaded into storage. Then, there is the data quality phase where quality assessment is performed on the stored data. This data is then made available for different use cases through a combination of a data lake and a data warehouse, Typical use cases are BI, analytics and machine learning. Data governance policies are defined for the ingested data and a data catalog is used for discoverability - by  preeti hemant.
   2. (short) [Netapp](https://www.netapp.com/data-fabric/what-is-data-fabric/#:~:text=A%20data%20fabric%20is%20an,on%20premises%2C%20and%20edge%20devices.)
   3. (good) [IBM](https://www.ibm.com/topics/data-fabric) - Data Management layer, Data Ingestion Layer, Data Processing, Data Orchestration, Data Discovery, Data Access.
   4. (good) [Gartner](https://www.gartner.com/smarterwithgartner/data-fabric-architecture-is-key-to-modernizing-data-management-and-integration) - the pillars of data fabric
   5. [talend](https://www.talend.com/resources/what-is-data-fabric/)
   6. (good but lengthy) [spiceworks](https://www.spiceworks.com/tech/big-data/articles/what-is-data-fabric/) - architectural components, best practices
   7. (good) [k2view](https://www.k2view.com/what-is-data-fabric) - has a great figure of integration storage catalog, cleansing & masking, transformation & enrichment, governance, webservices.
   8. (good) [tibco](https://www.tibco.com/reference-center/what-is-data-fabric) - application & services, dev & integration, security, storage management, transport, endpoints.
   9. [mesh vs fabric](https://www.datanami.com/2021/10/25/data-mesh-vs-data-fabric-understanding-the-differences/)
4. [data virtualization](https://www.ibm.com/analytics/data-virtualization) - single view without movement of data.
5. [tools for deploying data models in prod](https://www.superdatascience.com/podcast/tools-for-deploying-data-models-into-production)

## Data Warehouse

1. (good) [a guide from strategy to implementation](https://www.analytics8.com/blog/what-is-a-data-warehouse/)


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://www.opscompendium.com/dataops/database-architecture-and-modeling.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
