Wisdom
Axis
Home
Tableau
Tableau Interview Questions
Tableau Certification Details
Tableau Job Openings
Tableau Sample Data
Taleau Sample Resume
Power BI
Power BI Interview Questions
Power BI Certification Details
Power BI Job Openings
Power BI Sample Data
Python
Python for Beginners
How to install Python
Python Interview Questions
SQL
SQL for Beginners
SQL Interview Questions
QlikView
QlikView Interview Questions
QlikView Certification Details
QlikView Job Openings
QlikView Sample Data
Snowflake
Data Science
Big Data
Blog
Cloud
Certifications
Azure Data Scientist Associate
IBM Data Science Certifications
Snowflake Certifications
Q&A
Search Wisdom Axis for specific information
Snowflake Architecture, Key components, Layers, pictorial presentation, Database Storage, Query Processing and Cloud Services, Hybrib model shared-disk and shared-nothing.
Snowflake
Snowflake Architecture
Snowflake SnowPro Certifications
See All
Snowflake Architecture, Key components, Layers, pictorial presentation with details and descriptions
Snowflake’s architecture is a Hybrid model, because it combines traditional shared-disk and shared-nothing database architectures. Similar to shared-disk architectures, Snowflake uses a central data repository for persisted data that is accessible from all compute nodes in the platform. At the same time, similar to shared-nothing architectures, Snowflake processes queries using MPP (Massively Parallel Processing) compute clusters where each node in the cluster stores a portion of the entire data set locally. This Hybrid architecture (shared-disk and shared-nothing) approach provides the data management simplicity of a shared-disk architecture, but with the highly scalable performance and scale-out benefits of a shared-nothing architecture.
Snowflake Architecture, Key components and Layers Details
Snowflake’s unique architecture consists of three key components (or) layers:
* Database Storage * Query Processing * Cloud Services
Database Storage
When data is loaded into Snowflake, Snowflake reorganizes that data into its internal optimized, compressed, columnar format. Snowflake stores this optimized data in cloud storage. Snowflake manages all aspects of how this data is stored — the organization, file size, structure, compression, metadata, statistics, and other aspects of data storage are handled by Snowflake. The data objects stored by Snowflake are not directly visible nor accessible by customers; they are only accessible through SQL query operations run using Snowflake.
Query Processing
Query execution is performed in the processing layer. Snowflake processes queries using “virtual warehouses”. Each virtual warehouse is an MPP compute cluster composed of multiple compute nodes allocated by Snowflake from a cloud provider. Each virtual warehouse is an independent compute cluster that does not share compute resources with other virtual warehouses. As a result, each virtual warehouse has no impact on the performance of other virtual warehouses.
Cloud Services
The cloud services layer is a collection of services that coordinate activities across Snowflake. These services tie together all of the different components of Snowflake in order to process user requests, from login to query dispatch. The cloud services layer also runs on compute instances provisioned by Snowflake from the cloud provider. Services managed in this layer include: • Authentication • Infrastructure management • Metadata management • Query parsing and optimization • Access control