Graal Platform Documentation

Graal Platform Documentation

  • Docs
  • Help

›Overview

Overview

  • What is Graal Platform?
  • Why use our platform?
  • How Graal Platform works?
  • Concepts
  • Jobs & workflows
  • Security

Quickstart

  • Quickstart

Tutorials

  • Get started with Python
  • Get started with Dask
  • Get started with XGBoost
  • Get started with Apache Spark and Maven
  • Get started with Apache PySpark
  • Get started with Apache Beam and Gradle
  • Use the API
  • Using the command line tool (graalctl)
  • Using secrets
  • Migration from Databricks
  • Get started with Tensorflow
  • Get started with Pytorch
  • Get started with Mxnet
  • Setting up the Hadoop bridge
  • Get started with Apache Flink and Maven
  • Get started with Dbt
  • Get started with Pulsar
  • Get started with Apache Spark Streaming Pulsar
  • Get started with Debezium
  • Get started with the SDK

How-to guides

  • Using Graal Platform with Azure Data Factory
  • Publishing your artefacts with Azure DevOps
  • Using Graal Platform with Apache Airflow
  • Publishing your artefacts with Jenkins
  • Spark
  • Network, VPN, gateway and firewall
  • Logs
  • Pricing

Security

  • Overview
  • Comply with requirements
  • Infrastructures under Graal Systems
  • Responsibilities

Troubleshoot & debug

  • Troubleshooting
  • Common issues
  • Debug jobs

Concepts

Tenants

A tenant represents an organization.

Projects

A project is a container that holds related resources for a group, a technical project or an organization. A project organizes objects (libraries, jobs, and workflows) into folders and provides access to data objects and computational resources.

Jobs

The main unit of organization for running your code. Jobs organize, display, and control access to runs.

Runs

The execution of a job.

Workflows

Workflows combine multiple jobs and conditions in order to build complex data processing pipelines

Runtimes

Runtimes are frameworks like Apache Spark, TensorFlow, Keras, PyTorch, and others, packaged with popular libraries.

Billing

GCU

Graal Platform bills based on compute units (GCUs), units of processing capability per hour based on instance type.

Authentication and authorization

User

A unique individual who has access to the system.

Identity

A unique "system user" who has access to the system.

Group

A collection of users and/or identities.

RBAC

A list of permissions attached to the project, job, or any other resource. An RBAC specifies which users or identities are granted access to the objects, as well as what operations are allowed on the assets. Each entry in a typical RBAC specifies a subject and an operation.

← How Graal Platform works?Jobs & workflows →
  • GCU
  • User
  • Identity
  • Group
  • RBAC
Graal Platform Documentation
Overview
What is Graal Platform?
Quickstart
Apache SparkApache FlinkApache BeamPythonTensorflowDaskDistributed XGBoost
Links
HomeConsoleCopyrights
Copyright © 2023 Graal Systems