Create Snowflake warehouse
The Create Snowflake warehouse entry creates a new Snowflake virtual warehouse from within a PDI job. This entry builds the warehouse with the attributes you specify. For more information about working with Snowflake in PDI, see PDI and Snowflake.
You can create a virtual warehouse to address your specific business needs. Within the step, you can set size, scaling, automated suspension, and other properties for your warehouse. Later, if your business needs change, you can adjust the specifications of your warehouse using the Modify Snowflake warehouse job entry.
For more information about Snowflake warehouse settings, see the Snowflake documentation.
The following field is general to this job entry:
- Entry Name: Specify the unique name of the Create Snowflake warehouse entry on the canvas. You can customize the name or leave it as the default.
The Create Snowflake warehouse entry includes several options for creating a virtual warehouse and defining its attributes. Each option is described below.
Database connection and warehouse
In this section, specify the Snowflake database connection and identify the virtual warehouse you want to create. For more information about naming virtual warehouses, see the Snowflake documentation.
|Database connection||Select an existing Snowflake database from the list.|
If you do not have an existing connection, click New. If you need to modify an existing connection, click Edit. See Define Data Connections for instructions.
Note: If timeout errors occur, see Snowflake timeout errors to troubleshoot.
|Warehouse name||Specify a valid identifier for the virtual warehouse you are creating. The name must be unique for your Snowflake account.|
|Warehouse comment||Specify a description or other information to identify or
distinguish this virtual warehouse or its purpose.|
This information is useful in configurations that include multiple virtual warehouses.
This section of the Create Snowflake warehouse entry includes the warehouse options that can be specified from within a PDI job when you create the virtual warehouse.
The Auto suspend (in seconds) option verifies that when the warehouse is inactive, it stops consuming credits. The Auto resume warehouse option verifies that the warehouse starts up again as soon as it is needed.
After you create the virtual warehouse, you can use the Modify Snowflake warehouse entry to change these settings at any time, even while it is running, to accommodate the need for more or less computing resources.
For information about virtual warehouse sizes, scaling policies, and resource monitor permissions, see the Snowflake documentation.
|Warehouse size||Select a size for this new virtual warehouse:|
CautionThe size determines both the number of servers in each cluster in the warehouse and the number of credits consumed while the warehouse is running.
|Scaling policy||Select the policy for automatically starting and shutting down
clusters in a multi-cluster warehouse running in Auto-scale mode.|
The following policies are available:
|Auto suspend (in seconds)||Specify the time, in seconds, for this virtual warehouse to
auto-suspend when it becomes inactive. When a warehouse is suspended, it does not
accrue any credit usage.|
The default value is 600 seconds (10 minutes).
You must specify a number of 60 or greater because the minimum amount of time a warehouse can run before it suspends is 60 seconds (1 minute).
CautionIf you leave this option blank, the warehouse will never suspend. Leave this option blank only if your query workloads require a continually running virtual warehouse.
|Resource monitor||Select the name of an existing resource monitor to assign to this
existing virtual warehouse. |
The default value is blank. No resource monitor will be assigned to this warehouse.
NoteA resource monitor is a permissions-based control to govern the monthly credits used by the warehouse and all other warehouses to which the monitor is assigned.
|Auto resume warehouse||Specify whether to automatically resume a warehouse when a SQL
statement, such as QUERY, is submitted.|
The maximum and minimum cluster settings work together. Depending on your processing needs, you can use the cluster settings to run a multi-cluster warehouse in either Maximized mode or Auto-scale mode.
- If you set the minimum and maximum cluster count with the same value, then the warehouse runs in Maximized mode.
- If you set the minimum cluster count less than the maximum cluster count, then the warehouse runs in Auto-scale mode.
See the Snowflake documentation for more details.
|Minimum cluster count||If you are creating a multi-cluster warehouse, select the minimum
number of server clusters for this virtual warehouse.|
Valid values are 1 to 10. The default value is 1. This value must be equal to or less than the Maximum cluster count.
|Maximum cluster count||Select the maximum number of server clusters for this virtual
warehouse. Valid values are 1 to 10. The default value is
NoteHigher values require the Snowflake Enterprise Edition.
You can define the initial state of the warehouse once it is created. You can also determine what happens within the PDI job if the requested new warehouse already exists.
|If warehouse exists||Select a result for the PDI job if the identified
warehouse already exists.|
|Initially suspend warehouse after creation||Specify whether the warehouse is created initially in the suspended state.|