Graal Platform Documentation

Graal Platform Documentation

  • Docs
  • Help

›How-to guides

Overview

  • What is Graal Platform?
  • Why use our platform?
  • How Graal Platform works?
  • Concepts
  • Jobs & workflows
  • Security

Quickstart

  • Quickstart

Tutorials

  • Get started with Python
  • Get started with Dask
  • Get started with XGBoost
  • Get started with Apache Spark and Maven
  • Get started with Apache PySpark
  • Get started with Apache Beam and Gradle
  • Use the API
  • Using the command line tool (graalctl)
  • Using secrets
  • Migration from Databricks
  • Get started with Tensorflow
  • Get started with Pytorch
  • Get started with Mxnet
  • Setting up the Hadoop bridge
  • Get started with Apache Flink and Maven
  • Get started with Dbt
  • Get started with Pulsar
  • Get started with Apache Spark Streaming Pulsar
  • Get started with Debezium
  • Get started with the SDK

How-to guides

  • Using Graal Platform with Azure Data Factory
  • Publishing your artefacts with Azure DevOps
  • Using Graal Platform with Apache Airflow
  • Publishing your artefacts with Jenkins
  • Spark
  • Network, VPN, gateway and firewall
  • Logs
  • Pricing

Security

  • Overview
  • Comply with requirements
  • Infrastructures under Graal Systems
  • Responsibilities

Troubleshoot & debug

  • Troubleshooting
  • Common issues
  • Debug jobs

Logs

For logs to be captured by Graal Platform, your jobs should be writing them to STDOUT/STDERR, rather than a log file – see the framework-specific guidance in the menu.

How to automatically copy your logs elsewhere (soon)

If you want to set up your own storage for your jobs logs, you can set up a "log drain" service that sends the logs to S3 or your preferred location.

Historic log data

Logs are currently retained for 180 days, and you will only see data for jobs deployed within the projects where you have access.

Troubleshooting missing logs

Not seeing the logs you expect? Here are a few questions to ask yourself to help identify the problem.

  • Check the time period in the upper right corner, since the default is "Last 15 minutes". You may need to expand that time period to hours or days.
  • Check Graal Platform status to see if the logs services is under scheduled maintenance.
← Network, VPN, gateway and firewallPricing →
Graal Platform Documentation
Overview
What is Graal Platform?
Quickstart
Apache SparkApache FlinkApache BeamPythonTensorflowDaskDistributed XGBoost
Links
HomeConsoleCopyrights
Copyright © 2023 Graal Systems