Admin 101 will feature an exploration of the cluster structure, how to provision a cluster and how Qubole performs AutoScaling of nodes. The course will also focus on user administration including how to create groups and manage access to resources inside of Qubole. Additional basic security features in Qubole will be presented and discussed.
Qubole Education Admin 101 contains “Try It” sections which contain instructions that can be followed inside of a personal account if you have access to the Clusters interface and can edit Clusters.
Qubole Education Admin 101 contains quiz questions after several of the lessons – it will be necessary to answer the quiz questions to complete the lessons and the course.
Estimated Time: 30 to 45 minutes
Resource Groups & Security1 of 2
Resource Group In MicroSoft Azure the Resource Group is the high level grouping of all Resources that Qubole requires and will connect to when bringing up clusters and processing commands. The Resources in the Resource Group will share the same lifecycle permissions and policies and are tied to an Azure Region. Resource Groups may be [...]
Azure VMS & Storage2 of 2
Azure VMs & Instance Storage When deploying Azure VMs and Instance there are three disk types to be aware of - OS, Data and Temp. The resource allocation per disk will depend on the instance type selected and the data disk size depends on the instance type that is selected. The OS is deployed inside [...]
Qubole Clusters1 of 6
Qubole Clusters Each cluster is configured with a distributed file system (DFS) to support interaction with the cloud storage system. On top of each distributed file system is an sophisticated engine to process the data. The resource and engine options will change based on the system selected. Each QDS account comes with four pre configured [...]
Qubole Cluster AutoScaling2 of 6
Master & Slave Nodes A cluster is defined as a collection of nodes which are virtual machine instances. Each cluster contains a master node which provides directions to slave nodes thereby managing the processing and therefore the resources on the system. The master node runs processes for managing the tasks and resources and the slave [...]
Try It - Cluster Composition3 of 6
Overview You will review the Cluster Composition page and the default settings for the Standard_DS13_V2 Azure instance type. Code Navigate to the Clusters Interface and identify the hadoop2 cluster and select the Edit option to review the Cluster Composition page. In the list of Slave Instance Types select the Standard_DS13_V2 and record the amount of memory and the [...]
Qubole Security4 of 6
Qubole Security Qubole allows administrators the ability to configure a session timeout threshold for users processing data through the Qubole User Interface. This configuration setting is applied for the entire account and after the specified duration of inactivity users will be required to sign in again. The default for is 1440 minutes or 24 hours [...]
Qubole Cluster Labels5 of 6
Cluster Labels Cluster Labels, in addition to acting as a unique identifier, serve as an abstract layer between the QDS and the clusters receiving instructions. Jobs created through the QDS command line are executed against a node specified by a label and if no label is supplied the the command is routed to the first [...]
Users, Groups & Roles6 of 6
Users & Accounts A user in Qubole is tied to the email address provided during signup and represents a single individual. In Qubole there are also Accounts which are tied to a specific set of Azure credentials and these represent different cloud configurations. The platform allows a single user to have multiple accounts and users [...]